Senior Data Engineer - Senior Manager

State Street

📍 Bengaluru, Karnataka, India

Full time Computer Occupations

Job Description

Role: Senior Developer – Modern Data Platform Architect

Role Summary

We are seeking a highly skilled Senior Developer / Data Platform Engineer to design and build scalable data pipelines and modern Lakehouse solutions on Databricks-based platforms. The candidate should have strong expertise in PySpark, ETL/ELT frameworks, Data Quality, Apache Iceberg, and job orchestration, with exposure to asset management domain considered a strong advantage.

Key Responsibilities

1. Data Platform Development & Engineering

  • Design and develop scalable data ingestion and transformation pipelines using PySpark and SQL.
  • Build and manage batch and streaming ETL/ELT pipelines on Databricks. 
  • Implement data processing frameworks supporting high-volume enterprise datasets.
  • 2. Lakehouse Architecture & Iceberg Implementation

  • Design and maintain modern data Lakeho...
  • Apply for this Position