data engineer

Lead Data Engineer

Lead Data Engineer at Two Circles – a sports & entertainment marketing business growing audiences and revenues by leveraging fan data. Key responsibility is to design, build, and scale data integration capabilities using Scala, Spark, and AWS technologies for Helix data platform.

Responsibilities

• Own end-to-end delivery of Helix data engineering and integration projects from design through to deployment, monitoring, and production support.
• Build and operate scalable data ingestion and processing pipelines using AWS services (S3, EMR/Spark, ECS, Lambda).
• Develop and maintain data workflows that support customer identity resolution, fan segmentation, and golden record creation.
• Work with data storage and warehouse technologies such as PostgreSQL, Redshift, and S3-based data lakes.
• Design, implement, and optimize ETL/ELT pipelines for large-scale structured an...