Job Description
GCP Data Engineer- Data Integration & system Engineer (GCP/Python/Bigquery)
Primary purpose: Design, build, and operate scalable data pipelines and data flows that enable NBA decisioning to operate reliably across on-premise and cloud platforms. Ensure that data is correctly migrated from Hadoop/Cloudera to Google Cloud Platform and integrated with Pega CDH / Infinity to support real-time and batch decisioning for MVP and future scale.
Responsibilities
- Design and implement end-to-end data pipelines across on-premise and Google Cloud Platform environments
- Build and maintain batch and near real-time data flows ensuring availability, freshness, and performance
- Drive migration and modernization of data from Hadoop/Cloudera to GCP (BigQuery and related services)
- Ensure reliable, scalable, and performant data delivery for decisioning and analytics use cases
- Implement and maintain data integra...