Lead Data Pipeline Engineer (Databricks)

About Position:

We are looking for an experienced Databricks Lead who can build, optimize, and maintain scalable data pipelines on the Databricks platform.

• Role: Databricks Lead
• Location: Pune/Gurgaon/Bangalore
• Experience: 9+ years
• Job Type: Full Time Employment

What You'll Do:

• Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).
• Implement data processing workflows across Bronze, Silver, and Gold layers using Delta Lake.
• Build and optimize batch and streaming pipelines using Structured Streaming.
• Perform Spark performance tuning, job optimization, and cost optimization.
• Collaborate with data architects, analysts, and business teams to deliver scalable data solutions.
• Ensure data quality, data valid...