Lead Data Engineer - Scala/Spark
Mumbai, Maharashtra, India • Posted June 02, 2026
Job Type:
Full-time
Location:
Mumbai, Maharashtra
Posted:
June 02, 2026
Category:
Computer Occupations
Application Deadline:
July 12, 2026
Role Description
Job Title : Lead Data Engineer - Scala/Spark
Job Location : Bengaluru
Exp Range : 6-12 years
Position Overview :
We are seeking a Senior Data Engineer with deep expertise in Scala-based Spark development and end-to-end deployment of data pipelines on Kubernetes cluster, orchestrated via Airflow.
Key Responsibilities:
•
Design & implement robust, scalable, batch & real-time data engineering solutions using Apache
Spark (Scala) & Spark structure streaming.
•
Architect well-structured Scala projects using reusable, modular, and testable codebases aligned with SOLID principles and clean architecture principles & practices.
• Develop, Deploy & Manage Spark jobs on Kubernetes clusters, ensuring eTicient resource utilization, fault tolerance, and scalability.
• Orchestrate data workflows using Apache Airflow — manage DAGs, task dependencies, retries, and SLA alerts.
• Write and maintain comprehensive unit tests and integrati...
Job Location : Bengaluru
Exp Range : 6-12 years
Position Overview :
We are seeking a Senior Data Engineer with deep expertise in Scala-based Spark development and end-to-end deployment of data pipelines on Kubernetes cluster, orchestrated via Airflow.
Key Responsibilities:
•
Design & implement robust, scalable, batch & real-time data engineering solutions using Apache
Spark (Scala) & Spark structure streaming.
•
Architect well-structured Scala projects using reusable, modular, and testable codebases aligned with SOLID principles and clean architecture principles & practices.
• Develop, Deploy & Manage Spark jobs on Kubernetes clusters, ensuring eTicient resource utilization, fault tolerance, and scalability.
• Orchestrate data workflows using Apache Airflow — manage DAGs, task dependencies, retries, and SLA alerts.
• Write and maintain comprehensive unit tests and integrati...
Interested in this role?
Click the button below to start your application for Lead Data Engineer - Scala/Spark at Xebia.
Apply Now