Job Description
ESSENTIAL SKILLS:
- Hands-on experience with Kafka and event streaming platforms for real-time data movement.
- Proven experience with API integration patterns, webhooks and event/webhook ingestion.
- Strong proficiency in Python for data engineering, ingestion pipelines and automation.
- Solid competence with enterprise databases and query languages, with practical experience with database performance tuning and query optimisation for OLTP/operational workloads.
- Experience in data modelling to design schemas and standardized data representations.
- Experience with schema registries and contract-first designs (Avro, Protobuf) to manage producer/consumer compatibility.
- Strong understanding and practice of data quality techniques and tooling to ensure trusted data.
- Knowledge of metadata management and cataloguing to support discoverability and lineage.
- Familiarity w...