Databricks Data Engineer - Senior Manager

State Street

📍 Hyderabad, Telangana, India

Full time Computer Occupations

Job Description

Job Title

Databricks Data Engineer

Role Summary

&

Role Description

We are looking for a seasoned Data engineer worked extensively on Data Engineering and implementation at large scale. Have experience on both Azure and AWS cloud and expertise in Databricks platform.

  • Databricks Platform Expertise (Notebooks, Clusters, Jobs, Delta Lake)
  • Unity Catalog and RBAC configuration
  • Programming & Data Processing using (Scala, Python, PySpark, SQL)
  • Apache Spark optimization techniques
  • Azure Services (Data Factory, Blob Storage, Azure Databricks)
  • CI/CD with Azure DevOps
  • Ability to debug and optimize PySpark/SQL code
  • Real-world coding challenge performance
  • Communication and articulation of technical concepts
  • Secure Coding principles in Databricks, Data Governance and Compliance standards
  • Core/Must have skills

    Databricks Platform Expertise (No...

    Apply for this Position