Вакансия Data Engineer

Skills

• AWS
• ETL
• PySpark
• SQL
• NoSQL
• DataBricks
• Agile
• Unit testing

Описание вакансии

We are seeking a skilled Data Engineer to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure to enable efficient data processing, analysis, and reporting. The ideal candidate must have strong experience with Databricks, AWS, Python, PySpark, SQL, and NoSQL databases.

Key Responsibilities:

• Design, develop, and maintain data infrastructure on AWS cloud platform;
• Develop ETL pipelines to extract, transform, and load data from various sources to data warehouse using PySpark and SQL;
• Develop automated data quality checks and validation processes to ensure data integrity;
• Develop data models and schemas to support data analysis and reporting;
• Collaborate with data analysts and scientists to design and implement data solutions that meet business requirements;
• Monitor and maintain the performance, availability, and scalability of the data infrastructure.

Requirements:

• Minimum of 3 years of experience as a Data Engineer;
• Strong experience with AWS cloud services;
• Strong experience with Spark (PySpark) for data processing and transformation;
• Strong experience with SQL and NoSQL databases;
• Experience with data modeling and schema design;
• Strong problem-solving and analytical skills;
• Excellent communication in English and collaboration skills;
• Ability to work in a fast-paced environment and handle multiple projects simultaneously.

Preferred Qualifications:

• Experience with Databricks;
• Experience with software development best practices, such as Agile methodology and unit testing.