Job Description
Job Description
We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.
Job Requirements
• Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats.
• Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities.
• Practical knowledge of structural data formats including Parquet, JSON, and CSV.
• Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment.
• Familiarity with unit testing data pipelines and implementing automated data quality checks.
Job Responsibilities
• Construct scalable data ingestion pipelines using Fab...
We're currently seeking a Data Engineer to build, maintain, and optimise robust data pipelines. This role develops efficient ETL/ELT workflows using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics.
Job Requirements
• Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats.
• Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities.
• Practical knowledge of structural data formats including Parquet, JSON, and CSV.
• Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment.
• Familiarity with unit testing data pipelines and implementing automated data quality checks.
Job Responsibilities
• Construct scalable data ingestion pipelines using Fab...