Job Description
Mandatory Skill:
Azure Databrick Structured Streamin Delta Lake Delta Live Tables (DLTSpark Declarative Pipelines (SDP DatabricksAsset Bundle Unity Catalo Auto Loade Cloud File Apache SparK
Preferred Experience eMigration of traditional ETL pipelines to Spark Declarative Pipeline
Enterprise-scale Lakehouse implementation Data Quality frameworks and governance solution
Large-scale streaming architectures processing millions of events per da
Experience implementing Medallion Architecture
Streaming & Real-Time Data Processing
Design and develop real-time streaming pipelines using Databricks Structured Streaming.
Build and maintain Kafka-based ingestion frameworks.
Handle late-arriving events using watermarks, event-time processing, and statef...