Databricks Engineer

The MDP Databricks Architect / Consultant / Developer designs, builds and operates modern analytics and data platforms using the Databricks Lakehouse Platform. The role enables organisations to deliver scalable, high-performance, governed data solutions across analytics, business intelligence (BI), data engineering, data science, and artificial intelligence/machine learning (AI/ML) workloads.

Key Responsibilities

• Design and implement modern data platforms using the Databricks Lakehouse Platform.
• Build ingestion and transformation pipelines using Databricks Workflows, Apache Spark (PySpark / Spark SQL) and Delta Lake, supporting batch, streaming and near real-time processing.
• Architect focus: Define and apply platform standards for data ingestion, modelling, data quality and governance; ensure alignment to cloud, security, identity and cost management requirements.
• Develop and optimise Databricks (Apache Spark) pipeline...