Job Description
Skill: Data Engineer (SQL + Pyspark)
Location: Hyderabad
Experience: 8-13 Years
JD:
- Extensive experience in Pyspark, Msft Fabric or Azure data platforms, Azure Data factory, Databricks, Synapse or similar, SQL, Data lake storage.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Must have experience on production environment specific to data processing and activities like Monitoring, Troubleshoot, Deployments.
- Define, Design & implement tools & methodologies for data correction, reconciliation & quality across multiple sources
- Good understanding on Data Cleansing, Ingestion ,Transformation and Visualization(PowerBI) flow.
- Hands on experience in design, build of the Azure Data and Analytics solutions Experience with data clean up and archival strategy