Lead Azure Data Engineer (Databricks)

Overview

Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent

Lead the architecture of data platforms driving the future of financial services

The Role

As a Principal Azure Data Engineer (Databricks) at Capco, you'll architect and lead the delivery of enterprise-grade data solutions using the Databricks platform within the Azure ecosystem. You'll drive the design and implementation of streaming and batch data pipelines, helping our clients to modernise their data capabilities. Working with cross-functional teams, you’ll guide clients on best practices and technical strategy, ensuring quality and security standards are maintained across deployments.

What You’ll Do

• Lead the end-to-end delivery of Databricks-based solutions across Azure environments
• Architect secure and scalable pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
• Develop and en...