Digital Engineering Staff Engineer

Job Description

Data Engineer-

Diverse Data Engineering activities on Azure Data platform.· Build & Deliver Data pipeline connecting various enterprise data sources both RDBMS, NoSQL & APIs. Develop data mappings to existing data sources.· Design and develop big data processing notebooks using Azure Databricks· Scripting and programming using programming languages such as Python, PySpark etc.· Lead the data identification, data analysis efforts for data sources and work directly with data owner teams· Lead a team of junior Data Engineers in an Agile/Scrum setting· Develop data requirements for new data sources.· Design and development of data extraction, data ingestion, data quality rules implementation· Understand the data model, transform data to target schema from relational and semi structured source data.· Clean and process the data for Machine Learning consumption.· Provide Business Intelligence (PowerBI) and Data Warehousing (DW) solutions and support ...