Data Engineer (SQL + Pyspark)

Skill: Data Engineer (SQL + Pyspark)

Location: Hyderabad

Experience: 8-13 Years

JD:

• Extensive experience in Pyspark, Msft Fabric or Azure data platforms, Azure Data factory, Databricks, Synapse or similar, SQL, Data lake storage.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments.
• Define, Design & implement tools & methodologies for data correction, reconciliation & quality across multiple sources
• Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow.
• Hands on experience in design, build of the Azure Data and Analytics solutions Experience with data clean up and archival strategy