Job Description
Overview
Design, build, and maintain data pipelines using Airflow and BigQuery. This includes design, development through testing, deployment, and ongoing monitoring and maintenance.
Responsibilities
- Design, build, and maintain pipelines using Airflow and BigQuery; develop, test, deploy, and monitor data pipelines.
- Data Modeling & Optimization: Collaborate with data analysts and stakeholders to define data requirements, and design efficient data models within BigQuery. Optimize queries and pipeline/dashboard performance for maximum efficiency.
- Custom Solutions: Serve as the dedicated data engineering resource for Custom Solutions, partnering with Data, Product, and Customer Success teams to translate bespoke client requests from validated proof-of-concept through to production; communicate technical details and project progress to stakeholders.
- Continuous Improvement: Contribute to the ongoing improvement of data infrastruc...