Вакансия Data & ML Engineer

Skills

• Python
• SQL
• Apache Spark
• AWS Glue
• Azure Data Factory
• Google Cloud Dataflow
• Generative AI
• ETL
• Transformers
• LangChain
• GPT
• Claude
• Elasticsearch
• OpenSearch
• Docker
• Kubernetes
• CI/CD
• Git
• AWS
• GCP

Описание вакансии

We are looking for a skilled and motivated Data & ML Engineer to join our IT team. In this role, you will design, build, and maintain scalable data pipelines and infrastructure to support analytics, reporting, and decision-making, as well as develop and deploy AI agents and generative AI solutions. You will collaborate closely with analysts and software engineers to ensure efficient data flow and integrity across systems.

What you will do

• Design, develop, and maintain reliable data pipelines and ETL processes
• Build and optimize data systems and architectures for real-time and batch processing
• Develop AI agents using LLMs, multi-agent frameworks, and advanced prompting strategies
• Build and maintain vector databases and embedding pipelines for semantic search and RAG
• Integrate search engines and retrieval systems with AI agents
• Develop and manage data models, schemas, and integration strategies
• Ensure data quality, consistency, and security across all platforms
• Work with cloud technologies (AWS, Azure, GCP) to deploy and manage solutions
• Monitor and troubleshoot data infrastructure performance
• Document data flows, processes, and best practices

Who we are looking for

• Bachelor’s or Master’s degree in Computer Science, Data/ML Engineering, or related field
• Strong knowledge of SQL and Python
• Familiarity with data warehousing, big data technologies (e.g., Spark), and data lakes
• Hands-on experience with cloud-based data services (AWS Glue, Azure Data Factory, GCP Dataflow)
• Strong problem-solving skills and attention to detail

Preferred qualifications

• 3+ years of experience in ML engineering, including work with generative AI
• Experience with statistical data processing, and distributed ETL pipelines
• Experience with ML libraries (Transformers, LangChain) and foundation models (GPT, Claude, etc.)
• Knowledge of transformer architectures and attention mechanisms
• Knowledge of Elasticsearch/OpenSearch integration and optimization
• Experience with Docker/Kubernetes for deployment and orchestration
• Familiarity with CI/CD pipelines and version control (Git)
• Relevant certifications (AWS, Google Cloud, etc.)