Вакансия Senior Data Engineer

Skills

• Python
• Pandas
• PySpark
• SQLAlchemy
• ETL
• ELT
• DataBricks
• AWS
• CI/CD
• Pytest

Описание вакансии

Beaconcure is transforming the clinical research space by automating data validation processes with its AI-powered platform, Verify. Their solution accelerates drug and vaccine approval, ensuring the accuracy and integrity of statistical analysis in clinical trials. As a Senior Data Engineer, you’ll be instrumental in building robust data pipelines and infrastructure to support rapid, secure medical advancements. You'll work alongside data scientists, analysts, and engineers to ensure data flows reliably and at scale.

Required skills:

• 3+ years of experience in Python development (or 1+ year in Python and 2+ years in another language)
• Hands-on experience with Pandas, PySpark, SQLAlchemy
• Strong understanding of ETL/ELT pipelines and data architecture
• Proficiency with Databricks or similar platforms
• Experience with AWS cloud services
• Good communication and problem-solving skills

Nice to Have

• Experience with CI/CD and orchestration tools
• Familiarity with MLOps frameworks
• Background in life sciences or pharma
• Experience with PyTest and regular expressions

Scope of work:

• Design and implement scalable ETL pipelines using Python and modern data frameworks
• Optimize structured and semi-structured data workflows for performance and reliability
• Collaborate with cross-functional teams to support data-driven decision making
• Work with Databricks and distributed data processing platforms
• Ensure high standards of data quality, documentation, and production readiness
• Contribute to the evolution of Beaconcure’s cloud-based data infrastructure (AWS)