Вакансія BigData Engineer

Skills

• Apache Spark
• Presto
• Hive
• Apache Flink
• Apache Beam
• AWS
• Kubernetes
• Java
• Python
• Ray
• ML
• AI

Опис вакансії

We are looking for engineers well versed in cloud data infrastructure to advise customers by building solutions using diverse technologies like Spark, Flink, Kafka, Ray and others. As part of this group, you will educate customers on the value proposition of the cloud data platform, address their challenges and deliver solutions that go from proof of concept to production.You will be expected to effectively partner with cross-functional engineering teams and customers.

Essential functions

• Must have:
  • AWS experience with kubernetes operating knowledge.
  • Excellent communication skills
  • Big data experience with Spark or Flink
  • Experience with automation for testing, monitoring and CI/CD

Qualifications

• 8+ YOE, with 5+ years of experience working with big data technologies and cloud environments
• Hands-on experience on batch processing (Spark, Presto, Hive) or streaming (Flink, Beam, Spark Streaming)
• Experience in AWS and knowledge in its ecosystem. Experience in scaling and operating kubernetes.
• Excellent communication skills is a must, experience working with customers directly to explain how they would use the infrastructure to build solutions that meet their business goals
• Proven ability to work in an agile environment, flexible to adapt to changes
• Able to work independently, research on possible solutions to unblock customer
• Programming experience in Java or Python
• Fast learner and experience with other common big data open source technologies is a big plus
• Knowledge on machine learning is a nice-to-have

Would be a plus

• Experience working in a customer-facing or consulting role
• Programming experience in Java and Python
• Knowledge on Ray
• Knowledge on Machine Learning and AI