Lead Data Engineer - Scala/Spark

Job Title : Lead Data Engineer - Scala/Spark Job location : Bengaluru Exp Range : 5-14 years Notice Period : immediate - 15 days We are seeking a Senior Data Engineer with deep expertise in Scala-based Spark development and end-to-end deployment of data pipelines on Kubernetes cluster, orchestrated via Airflow. The ideal candidate should have a strong software engineering foundation, excellent understanding of distributed systems, proficient in software design, modern project/code structuring skills, with good understanding on CI/CD processes and implementation which enables them to deliver reliable, scalable and robust data solutions. Should have overall experience of minimum 6-8 years with minimum 5Years in Hadoop, Spark. Key Responsibilities: • Design & implement robust, scalable, batch & real-time data engineering solutions using Apache Spark (Scala) & Spark structure streaming. • Architect well-structured Scala projects using reusable, modular, and testable codebases aligned with ...