Log In
Sign Up
Data Engineer – Azure / Databricks / Delta Lake
Experience: 4+ year’s experience
- 6-month extendable contract
- Abu Dhabi – Office based
Role Overview:
We are seeking a skilled Data Engineer with strong expertise in Azure-based data platforms, including Databricks and Delta Lake. The ideal candidate will be responsible for building, validating, and maintaining scalable data pipelines while ensuring high data quality and reliability across the data lifecycle.
Key Responsibilities:
- Develop, validate, and optimize ETL/ELT pipelines using Azure Databricks, Delta Lake, and Azure Data Factory (ADF)
- Perform data profiling, cleansing, and reconciliation between source and target systems
- Identify and resolve data issues such as duplicates, null values, schema mismatches, and incremental load failures
- Ensure data consistency and integrity across Bronze, Silver, and Gold layers in a Lakehouse architectur
- Design and implement automated data quality checks, validation frameworks, and monitoring solution
- Troubleshoot data pipeline issues and support defect resolution in collaboration with cross-functional team
- Work closely with Data Engineers, BI developers, and business stakeholders to ensure accurate data deliver
- Maintain data governance standards, documentation, and best practices
Required Skills:
- Strong proficiency in SQL and data analysis
- Hands-on experience with Azure Databricks and Delta Lake
- Experience with Azure Data Factory (ADF) for pipeline orchestration
- Knowledge of incremental data load strategies (CDC, watermarking, SCD)
- Experience in data profiling, validation, and reconciliation techniques
- Understanding of data governance and data quality frameworks collaborative environment
Data Engineer in Abu Dhabi, United Arab Emirates