Grid Dynamics — вакансії

The customer is planning to migrate the data to Gitlab. Experienced engineers with migration experience are needed to assist the current team.

Client description:

The Client along with Bloomingdales is one of the oldest and biggest department store chains in USA. The Client is focusing on online retail and DevOps Team is constantly improving and refining the delivery process. Engineers work on CI/CD pipelines based on Jenkins and Jenkins pipelines written in Groovy, communicate with Development and QA departments from customer side and help them with application code (mostly written in Java) delivery from GitLab to production. The DevOps Team supports their own portal for test environments deployment, which is based on GCP and Kubernetes. The infrastructure which is being changed right along with code requirements is monitored by Prometheus. The variety of tasks from different areas ensures that engineers will not only deal with routine problems but also improve their skills and learn new technologies.

Details on tech stack:

• Linux/*NIX administering
• Bash/Python scripting
• Jenkins
• Kubernetes, Docker, Helm
• Git or other version control systems
• GCP
• Chef/Ansible

Min requirements to the candidate:

• Experience in migration is a must (GCP, Gitlab, etc)
• Linux/*NIX administering, Bash/Python scripting
• Knowledge of CI/CD principles and best practices
• Git or other version control systems
• English – at least Intermediate
• Kubernetes, Docker, Helm

We are building scalable data pipelines and infrastructure to generate reports based on massive datasets. Our team is responsible for designing, developing, and validating jobs using the latest versions of Scala and Apache Spark, ensuring accurate statistical results for our stakeholders.
This is a distributed team environment, offering an exciting opportunity to collaborate with top Big Data engineers across Europe and overseas.
While this role primarily focuses on Big Data engineering, experience with CI/CD and DevOps practices is a strong advantage, as infrastructure-related tasks will also be part of the job.

Essential functions

• Design and Develop Scalable Data Pipelines
• Implement and Validate Big Data Solutions
• Integrate and Manage Infrastructure
• Collaborate in a Distributed Environment

Qualifications

• Strong expertise in Spark and Scala
• Hands-on experience with Hadoop
• Proficiency in processing and computation frameworks: Kafka, Spark
• Experience with database engines: Oracle, PostgreSQL, Teradata, Cassandra
• Understanding of distributed computing technologies, approaches, and patterns

Would be a plus

• Experience with Data Lakes, Data Warehousing, or analytics systems

Grid Dynamics, a global software services company driving enterprise-level digital transformation solutions for Fortune 1000 corporations, is looking for a Senior Data Engineer .

Essential functions

• Design and optimize data ingestion systems to ensure a consistent flow of high-quality data into the platform, creating a solid foundation for developing data products and supporting comprehensive KPI tracking and analysis.
• Demonstrate expertise in Infrastructure as Code (IaC), utilizing tools like Terraform or CloudFormation to automate infrastructure deployment and management.
• Translate business requirements into robust technical architecture, including designing physical schema and logical data models.
• Engage with stakeholders to understand their needs, providing technical guidance for current and future data platform projects.
• Analyze user interaction with the data platform, focusing on patterns of use to identify areas for improvement and optimize user engagement over time.
• Implement and maintain data governance frameworks, emphasizing automated processes for data quality checks, compliance adherence, and secure data handling, while collaborating with engineering teams to integrate governance protocols into data pipelines and platform architecture.
• Participate actively in all Data Platform Engineering team meetings and knowledge-sharing sessions, contributing to team learning and process improvement.

Qualifications

• AWS Services: Expertise in AWS services, especially Glue, S3, Athena, EMR, EC2, and MWAA.
• Programming Languages: Proficiency in Python, PySpark, SQL, and/or Scala.
• Big Data Technologies: Hands-on experience with Spark, and Trino, Presto
• Data Platforms: Experience in building data platforms, not just using them. (MUST HAVE)

Would be a plus

• Data Engineering: 3+ years of work experience as a Data Engineer in a cloud-based environment, with a focus on AWS.
• ETL and Data Modeling: Advanced understanding of ETL processes, data modeling techniques, and best practices.
• Data Governance and Quality: Experience in applying data governance policies, implementing data contracts, and using data quality frameworks like Great Expectations and Soda.
• Data Architecture: Strong understanding of data architecture to enable ML and data analytics.
• Data Mesh: Familiarity with data mesh architecture and principles, with an appreciation for decentralized data management and shared data ownership.