Вакансия Data Engineer

Skills

• AWS
• ETL
• ELT
• Amazon S3
• AWS Lambda
• AWS Glue
• Athena
• AWS SQS
• CloudWatch
• EC2
• SQL
• Python
• Apache Spark
• С#
• CI/CD
• Git
• Shell
• Terraform
• YAML
• MSSQL
• T-SQL
• SSIS
• SSAS
• SSRS
• Microsoft Power BI
• DAX
• Visual Studio
• Agile

Описание вакансии

What you will do:

• ETL/ELT development: design, develop, and maintain ETL/ELT routines on AWS cloud data lakes and MS SQL on-prem DWH (SSIS)
• Reporting: design, develop, and maintain reports using Power BI and SSRS (AWS QuickSight experience is a plus)
• Data cube management: maintain existing data cubes using multidimensional and tabular models from various data sources (SSAS) and migrate data cubes to AWS data lakes
• Data modeling: design and develop scalable and extendable data models, including logical/physical layers and ETL processes (on-premise/on-cloud)
• Technical analysis: conduct technical analysis of existing solutions and prepare supporting technical documentation
• Data analysis: analyze and organize raw data, evaluate business needs, and prepare data for analysis
• Self-service support: assist business users with Power BI self-service, including teaching, data sourcing, DAX formula building, and optimization
• Collaboration: work closely with data engineers, architects, data scientists, and business stakeholders to deliver efficient data engineering solutions
• Maintenance: maintain existing solutions, resolve incidents, and optimize data infrastructure
• Automation: develop and automate data workflows, including data ingestion, aggregation, and ETL processing
• Data preparation: prepare raw data in data lakes/data warehouses into consumable datasets for stakeholders
• DevOps integration: collaborate with the DevOps team to automate deployment processes using PowerShell and DevOps Azure
• Data quality: improve data quality and efficiency across the data infrastructure.

Your profile:

• Education: Degree in computer science, IT, or a similar field; a master’s degree is a plus;
• Data engineering certification is a plus.

• 3-5 years of experience with AWS cloud and AWS services (S3 Buckets, Lambda, Glue, Athena, SQS queues, CloudWatch, EC2);
• Proficiency in programming languages: SQL, Python, Spark, C#;
• Familiarity with software DevOps CI/CD tools: Git, Shell Script, Terraform, YAML;
• 5+ years of experience with MS SQL (T-SQL, SSIS, SSAS, SSRS);
• Experience with Power BI and DAX;
• Proficiency with MS Visual Studio and SQL Management Studio;
• Technical expertise in data models and data analysis techniques (AI and ML techniques are a plus);
• Solid understanding of database schema design;
• Comprehensive understanding of privacy and security development best practices.

• Analytical and numerical thinking;
• Strong teamwork and communication skills;
• Experience working directly with technical and business teams;
• Ability to learn quickly, be organized, and be detail-oriented;
• Excellent problem-solving skills and ability to troubleshoot complex data pipeline issues;
• Strong collaboration skills with the ability to work effectively in a cross-functional team environment;
• Experience with Agile development methodologies is a plus.

• Knowledge of other relational databases such as Sybase, MySQL, DynamoDB, and MongoDB;
• Knowledge of other reporting tools: Tableau, AWS QuickSight;
• Technical expertise in data models and data analysis techniques (AI and ML techniques).