Principal Databricks Data Engineer

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.Key RequirementsExperience in enterprise Data Warehouse and Data Lake platformsHands‑on experience with Databricks and Spark at scaleStrong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks LakehouseRedesign ingestion, transformation, and consumption patterns from HDFS‑based architecture to cloud object storage and Delta LakeRefactor legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelinesEnsure data reconciliation, audit integrity, and consistency during migrationDesign and govern enterprise Data War...