Вакансия Technical Lead / Senior Data Engineer

Skills

• Kafka
• Apache Spark
• Hadoop
• Yarn
• MySQL
• AirFlow
• Snowflake
• Amazon S3
• Kubernetes
• PySpark
• Python
• AWS

Описание вакансии

As a Data & Application Engineer, you are responsible for the engineering team and the technology that the team owns. You will not only work as a coach for your team but also as a technical leader, ensuring that the right technical decisions are made when building our data and reporting product(s).
As a data and analytics team, we are responsible for building a cloud-based Data Platform for our client and its stakeholders across brands. We aim to provide our end users from different Finance departments, e.g.., Risk, FPA, Tax, Order to Cash, the best possible platform for all of their Analytics, Reporting & Data needs.
Collaborating closely with a talented team of engineers and product managers, you'll lead the delivery of features that meet the evolving needs of our business on time. You will be responsible to conceptualize, design, build and maintain data services through data platforms for the assigned business units. Together, we'll tackle complex engineering challenges to ensure seamless operations at scale and in (near) real-time.
If you're passionate about owning the end-to-end solution delivery, thinking for future and driving innovation and thrive in a fast-paced environment, join us in shaping the future of the Data and Analytics team.

Responsibilities

• Strategy and Project Delivery
• Together with the business Subject Matter Experts and Product Manager, conceptualize, define, shape and deliver the roadmap to achieving the company priority and objectives
• Lead business requirement gathering sessions to translate into actionable delivery solutions backlog for the team to build
• Lead technical decisions in the process to achieve excellence and contribute to organizational goals.
• Lead the D&A teams in planning and scheduling the delivery process, including defining project scope, milestones, risk mitigation and timelines management including allocating tasks to team members and ensuring that the project stays on track.
• Have the full responsibility in ensuring successful delivery by the D&A teams to deliver new products on time, set up processes and operational plans from end to end, e.g., collecting user requirement, design, build & test solution and Ops Maintenance
• Technical leader with a strategic thinking for the team and the organization. Visionary who can deliver strategic projects and products for the organization.
• Own the data engineering processes, architecture across the teams
• Technology, Craft & Delivery
• Experience in designing and architecting data engineering frameworks, dealing with high volume of data
• Experience in large scale data processing and workflow management
• Mastery in technology leadership
• Engineering delivery, quality and practices within own team
• Participating in defining, shaping and delivering the wider engineering strategic objectives
• Ability to get into the technical detail (where required) to provide technical coach, support and mentor the team
• Drive a culture of ownership and technical excellence, including reactive work such as incident escalations
• Learn new technologies and keep abreast of existing technologies to be able to share learnings and apply these to a variety of projects when needed

Role Qualifications and Requirements:

• Bachelor degree
• At least 5 years of experience leading and managing one or multiple teams of engineers in a fast-paced and complex environment to deliver complex projects or products on time and with demonstrable positive results.
• 7+ years' experience with data at scale, using Kafka, Spark, Hadoop/YARN, MySQL (CDC), Airflow, Snowflake, S3 and Kubernetes
• Solid working experience working with Data engineering platforms involving languages like PySpark, Python or other equivalent scripting languages
• Experience working with public cloud providers such as Snowflake, AWS
• Experience to work in a complex stakeholders' organizations
• A deep understanding of software or big data solution development in a team, and a track record of leading an engineering team in developing and shipping data products and solutions.
• Strong technical skills (Coding & System design) with ability to get hands-on with your team when needed
• Excellent communicator with strong stakeholder management experience, good commercial awareness and technical vision
• You have driven successful technical, business and people related initiatives that improved productivity, performance and quality
• You are a humble and thoughtful technology leader, you lead by example and gain your teammates' respect through actions, not the title
• Exceptional and demonstrable leadership capabilities in creating unified and motivated engineering teams