Вакансії Data Engineer / Big Data Architect

We are seeking an Azure Data Engineer to join our team. In this role, you will be responsible for creating Microsoft Fabric pipelines and organizing ETL/ELT processes for a leading investment management company.

Requirements

• Perfect level of SQL
• Practical experience with Azure data services (especially Azure Data Factory) or MS Fabric
• Practical experience with Python
• Good knowledge level and practical experience with Spark, especially PySpark
• Experience with Azure Security services and Azure Portal
• Knowledge and practical experience with data warehousing, data governance and management

Nice to have

• Practical experience with MS SQL
• Practical experience with PostgreSQL
• Practical experience with Redshift
• Practical experience with Java and Scala
• Practical experience with PowerBI

We are seeking a skilled Data Engineer to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure to enable efficient data processing, analysis, and reporting. The ideal candidate must have strong experience with Databricks, AWS, Python, PySpark, SQL, and NoSQL databases.

Key Responsibilities:

• Design, develop, and maintain data infrastructure on AWS cloud platform;
• Develop ETL pipelines to extract, transform, and load data from various sources to data warehouse using PySpark and SQL;
• Develop automated data quality checks and validation processes to ensure data integrity;
• Develop data models and schemas to support data analysis and reporting;
• Collaborate with data analysts and scientists to design and implement data solutions that meet business requirements;
• Monitor and maintain the performance, availability, and scalability of the data infrastructure.

Requirements:

• Minimum of 3 years of experience as a Data Engineer;
• Strong experience with AWS cloud services;
• Strong experience with Spark (PySpark) for data processing and transformation;
• Strong experience with SQL and NoSQL databases;
• Experience with data modeling and schema design;
• Strong problem-solving and analytical skills;
• Excellent communication in English and collaboration skills;
• Ability to work in a fast-paced environment and handle multiple projects simultaneously.

Preferred Qualifications:

• Experience with Databricks;
• Experience with software development best practices, such as Agile methodology and unit testing.

We are looking for a commercially minded, highly skilled Data Engineer to have an important part in implementing 3Shape’s company-wide Customer Data Strategy. As part of our BI team in Ukraine, you’ll collaborate closely with the Customer Data Strategy team in Denmark, working to shape and develop initiatives that are a cornerstone of our overall business strategy.
The Customer Data Strategy is a high-priority initiative at 3Shape and holds significant potential and buy-in from senior management. The team, which currently includes a Data Analyst, Data Engineer, Data Architect, and Manager, is in an exciting phase of expansion – and this is your opportunity to contribute to its future.

Key responsibilities:

• Develop, implement, maintain and optimize Azure Databricks in collaboration and alignment with cross-functional teams to enable a ‘one-stop-shop’ for analytical data in 3Shape
• Translate customer-focused commercial needs into concrete data products, incl. detailing of technical requirements by facilitating workshops with non-technical stakeholders
• Build data products to unlock commercial value, and help integrate systems, create pipelines etc. to automate and optimize key commercial processes
• Coordinate and facilitate technical alignment meetings between functions, incl. ensuring that what is being build is aligned with the Data Architect, business needs & best practices, i.e. IT security and data compliance
• Act as customer data ambassador towards a broad range of stakeholders to improve ‘data literacy’, ensure best practice and convey technical concepts to non-technical stakeholders.

What we are hoping you have/are:

• A master’s degree in Computer Science, Data Engineering or equivalent and 1-2 years of experience working with data engineering in a larger organization, a tech start-up or as an external consultant
• Extensive experience with Azure Databricks, Apache Spark, and Delta Lake
• Experience integrating various IT platforms and systems into Databricks
• Proficiency in Python, PySpark and SQL, and a previous experience with optimizing and automating data engineering processes
• Good understanding of the importance of quality and what it means to contribute with high-quality code
• Familiarity with GitHub and GitHub Actions for CI/CD processes
• Knowledge of Terraform for infrastructure provisioning and management is beneficial
• Technical flair and curiosity – we want you to be comfortable asking questions and we encourage a ‘dig deeper’ mindset
• Good problem-solving and communication skills and ability to work in a collaborative team environment and engage effectively with a broad group of stakeholders, incl. non-technical stakeholders and senior management
• A ‘go-do’ attitude & deep motivation for making a successful digital transformation journey
• Full professional proficiency in English.

Join one of the most exciting Danish tech companies in the medical device industry and make an impact. With us you will be able to work on solutions used by thousands of dental professionals worldwide.

Itera is looking for an engaged, curious, and collaborative Data Engineer with solid technical background skills and excellent communication skills to become part of the development team.
We are looking for an open-minded person, who confesses continuous self-development and can solve challenging tasks under guidance\support or by himself. This position is ideal for those looking for the opportunity to work in an international, self-motivated, and distributed team with modern technologies.

Tasks and responsibilities:

• Build, maintain, design as well as optimize and tune data processing pipelines.
• Work together with data analyst and data scientists on the deployment and monitoring of our solution
• Help define our development environment and communicate the best development practices within the organization (i.e. code reviews, testing, etc.).
• Work with the product management team to find the best solutions to meet our customers’ needs.
• Ensure compliance with data governance and security policies.
• Enable teams and local sites across the organization to develop data-driven products and services through cross-team initiatives and collaboration.

Professional requirements:

• Minimum Master’s Degree with subjects such as computer science
• Developer/programming experience;
• Good understanding of API and deployment of the applications;
• Good knowledge of version control and git is a plus;
• Experience with Python, R or similar in work setting;
• Ability to build data pipelines in Python & Spark;
• Experience with building data solutions in Clouds (S3, Glue, Athena ,Redshift, Sagemaker or similar);
• Good knowledge of various types of data sources (files, databases, streams) and data formats (CSV, Parquet, Avro, etc.);
• Good understanding and experience solving complex problems and challenges;
• Own research experience or relevant experience from research environments is an advantage;
• Good English, oral and written.

Preferred qualifications:

• Analytical and structured;
• Result oriented;
• Approachable, professional, takes initiative and outgoing;
• Open-minded and enjoys trying out new technology;
• Customer oriented;
• Team player.

Intego Group is looking for experienced Senior Clinical Statistical Programmers to join the global team working from our offices or remotely.
As a clinical project team member, the Senior Clinical Statistical Programmer applies advanced-level programming techniques and leadership to reporting and analysis of clinical trials.
The Senior Clinical Statistical Programmer will be responsible for overall timelines, significant project milestones, and overall project quality, integrity, and productivity. May serve on, or lead a departmental initiative, specialized projects, and working groups. Can serve as a project team leader. Also, this person should be a Subject Matter Expert (SME) as a technology troubleshooter.

Job responsibilities:

• Responsible for the processing of clinical data required for analysis of clinical trials for Phase 1-4.
• Develop SAS code and table templates for preparing, processing, and analyzing clinical data.
• Generate and QC summary tables, data listings, and graphs for in-house analyses of study data or publications using SAS standard coding practices.
• Create/acquire tools to improve programming efficiency or quality.
• Validate the work of other programmers/analysts.
• Create/review programming plan, specifications for datasets, and TLF’s.

General requirements:

• A minimum of a Bachelor’s degree in Computer Science, Mathematics, Statistics, Pharmaceuticals Sciences, Life Sciences, and related areas is required. A Master’s is preferred;
• A minimum of 4 years of hands-on relevant career experience in the pharmaceutical or biotechnology industry;
• Have excellent knowledge of SAS programming and associated features and their applications in the pharmaceuticals industry environment, particularly clinical trial data sets;
• Familiar with CDISC conventions, i.e., SDTM and ADaM models, and hands-on experience implementing these models;
• Strong understanding of clinical trial data and hands-on in data manipulations, analysis, and reporting of analysis results;
• Must understand the role of all the functional areas in the clinical trial process;
• Must have a basic understanding of the FDA/ICH guidelines, the software development life cycle, 21 CFR Part 11, and other relevant FDA regulations;
• Must possess the basic knowledge of statistics such as p-values, confidence intervals, linear regression analysis, advanced general linear models, frequencies, survival analysis, non-parametric analysis, and randomization software, and demonstrate proficiency in implementing new ideas in clear, efficient SAS code for the purposes of data analysis and reporting;
• Must demonstrate intermediate UNIX, Oracle Clinical or equivalent clinical DM system, and relational database theory;
• Track record of generating new ideas and solutions to data analysis;
• Excellent application development skills;
• Thorough understanding of relational database components and theory;
• SAS certification is an advantage;
• It would be an asset to have had experience working on FDA submissions;
• The candidate should demonstrate clear and timely written and verbal communication with peers, customers, and management;
• Should be able to present effective presentations to small groups such as Project Teams or during Statistical Programming meetings.

As a Senior Data Manager within our Central Data team, you will play a key role in developing and implementing effective data management and governance to increase data quality. You will work closely with business data owners and users, domain product owners, data producers, data consumers, legal, infosec and senior leadership to define the data ecosystem, data governance policies, procedures, and best practices that ensure the discoverability, compliance, quality and interoperability of our data products.

You will:

• Create and enforce standards and best practices across domains, promoting data awareness for effective data management and fostering a culture of data-driven decision-making
• Run the change management process to ensure successful adoption of data governance and our new data catalog
• Formulate techniques for quality data collection to ensure adequacy, accuracy and legitimacy of data
• Developing and implementing data processes and practices, including data lineage tracking, data quality management, metadata management, data issue resolution etc.
• Establish rules and procedures for data sharing
• Collaborating with domain data product owners, data engineers and relevant stakeholders to assess data governance needs, introduce necessary standards and data quality controls, and ensure compliance
• Establishing metrics, monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them
• Establish metrics and monitor adoption and adherence to data operations policies and procedures
• Collaborating with Platform teams to ensure data governance principles are integrated into data systems, applications, and infrastructure

You have:

• Proven experience as a data manager or relevant area
• Past success with defining and leading company wide governance initiatives
• Past success in implementing and rolling out a data catalog org wide
• Experience crafting communication and engagement strategies for securing buy-in with operational and executive leadership levels
• Strong change management and program management experience
• Excellence understanding of data management, quality and data governance functions
• Strong knowledge, understanding and implementation proficiency of data governance principles, concepts, policies, procedures, guidelines and in data governance tools and technologies
• Experience working with a Data Mesh architecture or similar decentralized data governance models is a plus
• Familiarity with data privacy, security, and data protection regulations (e.g., GDPR, CCPA) and their implications on data governance
• A self-starting and ownership mentality with the technical ability to proactively onboard yourself using documentation and training resources to new data tools (e.g. data catalogs, observability tools, data platforms)
• Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders at all levels

In this position you will:

• participate in Data Management systems implementation projects: Data Lakehouse, Data Streaming, Metadata management, Reference Data Management,
• apply data engineering and development best practices to current delivery process (like: CI/CD, Code Management, Testing, Knowledge Management, Documentation etc.),
• participate in and drive Data Management systems implementation projects,
• develop data pipelines to bring new data to Enterprise Data Fabric
• ensure that all Data Policies are met within Enterprise Data Fabric.
• ensure that implemented systems correspond with target Data Architecture,
• establish and maintain agile delivery process based on one of frameworks: Kanban, Scrum.

We are looking for you, if you:

• have min. 3 years of experience as a Data Engineer,
• are familiar and proficient in the use of Kafka (Confluent) and Python,
• have experience with MS SQL Server, PostgreSQL, Oracle,
• have worked with Git, ETL: SSIS, RDBMS: MS SQL Server, PostgreSQL, Oracle,
• have knowledge of English (min. B2+),
• have experience working in an international environment (Middle East client).

Hi! We are looking for a Data Engineer to work with our client – a UK company offering digital music licensing for independent labels.
When you join our team, you will have the opportunity to work on the scale of the data around 4 billion rows per month! Due to a need to produce huge analytic tables, we use Iceberg.

Your main responsibilities for this position will be:

• designing, building, and maintaining the data infrastructure necessary for optimal extraction, transformation, and loading of data from a variety of data sources.
• developing and implementing data collection systems that integrate a variety of sources such as proprietary company data.
• working on AWS-based infrastructure.

This offer will be a perfect match for you if you have:

• at least 5 years of relevant data experience.
• understanding data orchestration tools like Airflow to extend it with new data pipelines and troubleshoot its operational issues.
• proven experience in building and maintaining ETL pipelines
• familiarity with cloud computing services, particularly AWS.

It would be nice if you have:

• knowledge of tools like Iceberg, Athena, and Dermio.
• degree in Computer Science or related field.

Growe welcomes those who are excited to:

• Create end-to-end ETL workflows using Apache Airflow, define task dependencies and scheduling to ensure timely and accurate data processing;
• Establish best practices for organizing data within S3 buckets, including folder structures, partitioning strategies, and object tagging for improved data discoverability and management;
• Provide access controls and permissions management on S3 buckets and Athena tables using IAM policies, ensure compliance with regulatory requirements and data governance standards;
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver scalable and reliable solutions;
• Document data storage architectures, ETL pipelines, and query optimization techniques maintain clear and up-to-date documentation for reference and knowledge sharing within the team.

We need your professional experience:

• Proven experience working as a data engineer with a focus on AWS services;
• Strong proficiency in building data pipelines using Apache Airflow;
• Expertise in AWS services such as S3, Athena, Glue, IAM roles, Redshift;
• Solid understanding of ETL processes and data modeling concepts;
• Proficiency in SQL and experience working with large datasets;
• Familiarity with version control systems (e.g., Git) and CI/CD pipelines;
• Experience with Terraform;
• Excellent problem-solving and troubleshooting skills;
• Understanding of MLOps will be a plus;
• Experience with Kafka and DBT will be a plus;
• Level of English: Intermediate/Upper-Intermediate.

We appreciate if you have those personal features:

• Strong communication and presentation skills;
• Attention to detail;
• Proactive and result-oriented mindset.

We are seeking those who align with our core values:

• GROWE TOGETHER: Our team is our main asset. We work together and support each other to achieve our common goals;
• DRIVE RESULT OVER PROCESS: We set ambitious, clear, measurable goals in line with our strategy and driving Growe to success;
• BE READY FOR CHANGE: We see challenges as opportunities to grow and evolve. We adapt today to win tomorrow.