Databricks Data Engineer

Responsibilities

• Design, build, and maintain scalable data pipelines to ingest, process, and transform structured and unstructured data
• Develop and optimize ETL/ELT processes to ensure high data quality, consistency, and reliability
• Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver actionable datasets
• Architect and manage data lakes, warehouses, and cloud-based data platforms (e.g., Azure)
• Implement data models, schemas, and data integration solutions aligned with business needs
• Ensure data governance, security, and compliance standards are followed across all data assets
• Monitor pipeline performance and troubleshoot data-related issues to ensure system stability and uptime
• Automate data workflows and enable real-time or near-real-time data processing where required
• Optimize storage, compute, and processing costs while...