Senior Data Engineer

Responsibilities:

• Support and manage Cloudera Data Platform (CDP) and Oracle database environments.
• Monitor, troubleshoot, and resolve data pipeline, job failure, and performance issues.
• Support batch and streaming data ingestion and optimize data storage (partitioning, retention, lifecycle).
• Develop, maintain, and optimize SQL queries, stored procedures, and database performance.
• Design and support ETL/ELT pipelines using tools like Spark, Talend, Sqoop, and Airflow.
• Integrate data from multiple sources (APIs, databases, flat files).
• Ensure data quality, consistency, governance, and compliance with enterprise standards.
• Develop and maintain Power BI dashboards, reports, and data models (DAX, star schema).
• Implement data security, access controls, and row-level security.
• Automate reporting and data refresh processes.
• Work with business users and IT teams to gather requirements...