Senior Data Engineer-GCP
X
XPT Software Australia Pty Ltd
📍 Sydney, NSW, Australia
Job Description
Must Have Skills: Advanced GCP Data Engineering Expertise : Strong hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage for building large-scale data platforms. Data Architecture & Modeling : Deep understanding of data warehousing, dimensional modeling, and lakehouse architectures to support analytics and reporting. Leadership & Stakeholder Collaboration : Proven ability to lead engineering initiatives, mentor teams, and collaborate with business, analytics, and architecture stakeholders to deliver data solutions. Expertise Scalable Data Pipeline Development : Expertise in designing and implementing high-performance ETL/ELT pipelines (batch and real-time) using Python, SQL, and frameworks like Apache Beam or Spark. Nice to Have Skills: Experience with Containerization & Kubernetes : Experience with Docker and Kubernetes (GKE) for deploying and managing scalable data platforms. Knowledge of Streaming & Real-Time Processing : Familiarity ...