Вакансия Senior Big Data Engineer (Golang)

Skills

• Golang
• SQL
• NoSQL
• Kafka
• Apache Pulsar
• ELK
• Redis
• Apache Spark
• Apache Flink
• Kubernetes

Описание вакансии

About the Product:

The product of our client stands at the forefront of advanced threat detection and response, pioneering innovative solutions to safeguard businesses against evolving cybersecurity risks. It is a comprehensive platform that streamlines security operations, empowering organizations to swiftly detect, prevent, and automate responses to advanced threats with unparalleled precision and efficiency.

About the Role:

We are looking for a proactive, innovative, and responsible Senior Big Data Engineer with extensive knowledge and experience with GoLangб streaming and batching processes, building DWH from scratch. Join our high-performance team to work with cutting-edge technologies in a dynamic and agile environment.

Key Responsibilities:

• Design & Development: Architect, develop, and maintain robust distributed systems with complex requirements, ensuring scalability and performance.
• Collaboration: Work closely with cross-functional teams to ensure the seamless integration and functionality of software components.
• System Optimization: Implement and optimize scalable server systems, utilizing parallel processing, microservices architecture, and security development principles.
• Database Management: Effectively utilize SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databases in system design and development.
• Big Data Tools: Leverage big data tools such as Spark or Flink to enhance system performance and scalability(experience with these tools is advantageous).
• Deployment & Management: Demonstrate proficiency in Kubernetes (K8S) and familiarity with GTP tools to ensure efficient deployment and management of applications.

Required Competence and Skills:

• At least 5 years of experience in Data Engineering domain.
• At least 2 years of experience with GoLang.
• Proficiency in SQL, NoSQL, Kafka/Pulsar, ELK, Redis and column store databases.
• Experienced with big data tools such as Spark or Flink to enhance system performance and scalability.
• Proven experience with Kubernetes (K8S) and familiarity with GTP tools to ensure efficient deployment and management of applications.
• Ability to work effectively in a collaborative team environment.
• Excellent communication skills and a proactive approach to learning and development.

Advantages:

• Experience in data cybersecurity domain.
• Experience in startup growing product.