Вакансия Lead Data Engineer

Skills

• Data lake
• ETL
• ELT
• Microsoft Azure
• Azure Synapse
• Snowflake
• Azure Databricks
• CI/CD

Описание вакансии

EY Belgium Modern Data Platform team supports our clients in defining and rolling out the right data architecture, data platform and infrastructure that support their needs, implement and maintain automated data pipelines, and infuse data through business intelligence and analytics. We are currently looking for a Data Engineer to lead the team and performing business development with other team leaders.

Key Responsibilities

As Data Engineering lead, you will have the following responsibilities:

• Lead clients discussions going from defining the problem, Advising on the solution (Data Architecture, Best practices guidance) and supporting implementation.
• Lead the design, development, and maintenance of efficient data pipelines.
• Create robust data products that leverage cloud Data platforms such Azure Synapse, Snowflake and Databricks
• Use cloud services to build scalable, reliable, and efficient data solutions.
• Help translate data and analytics requirements into data solutions based on the approved technical designs.
• Define the technology stack, best practices, and standards for data engineering and analytics.
• Enable test automation and ensure CI/CD pipelines are in good health.
• Implement monitoring of data applications and track product quality, performance, and stability.
• Carry out effective technical design reviews to ensure that the right architecture patterns are used by the team.
• Optimize and fine-tune data processing workflows for performance and reliability.
• Identify and resolve issues within organizations and processes.
• Educate clients and partners about the data analytics landscape.
• Provide guidance on industry trends, emerging technologies, and best practices.
• Lead a team of Data Engineers to thrive by promoting teamwork, providing guidance, and encouraging skill enhancement.

Skills and Attributes for Success

• Master’s degree in computer science, engineering, mathematics or another relevant subject
• Minimum 5+ years’ experience in Data Engineering
• Experience with batch and real-time processing frameworks.
• Expertise in proactive performance monitoring, conducting data quality testing, and troubleshooting performance issues of complex warehouse data tables.
• Experience in assembling data from multiple sources and analyzing and modeling complex datasets.
• Hands-on Experience with production Cloud / DevOps environments and Data Lake, Data transformation, ETL/ELT, and other data concepts
• Practical knowledge of cloud possibilities and limitations in areas like distributed systems, load balancing, networking, massive data storage, and security.
• Solid Experience of leveraging Microsoft Azure ecosystem to manage the development and maintenance of cloud platform operations.
• Understanding of data architecture concepts such as data modeling, Big Data storage, Lambda architecture, data vault, and dimensional modeling, Data Fabric and Data Mesh is nice to have.
• Excellent analytical skills and problem solver
• Strong communicator who understands team dynamics, able to support where needed and lead when asked.
• Experience in leading and coaching technical teams.
• Fluent in Dutch and/or French, proficient business English