Lead Data Pipeline Engineer

Sr. Data Engineer (6-9 yrs)

Responsibilities:

• Data masking: implement PII masking pipeline
• Builds & maintain synthetic data generator
• CI/CD pipeline integration with auto-seed data
• Validates generated data against the ground truth – referential integrity, volume accuracy, etc. data validation characteristics.

Technical skills:

• Python (Faker, factory-boy, custom generators) or Node.Js
• Database management: SQL Server, PostgreSQL — insert at scale
• CI/CD pipeline integration (GitHub Actions, Azure DevOps)
• Data masking techniques: tokenization, hashing, format-preserving encryption
• API-based data seeding (REST / GraphQL endpoints)
• Performance: generating & loading millions of records efficiently