Job Description
<p>We are looking for Data Engineer with strong experience in designing, developing, and maintaining scalable and secure ETL pipelines.<br /> <br /> <u><b>Key Responsibilities-</b></u></p> <ul> <li>Design, develop, and maintain scalable batch and big data processing pipelines using Apache Spark and Scala.</li> <li>Build and manage data solutions on AWS EMR for large-scale data processing.</li> <li>Work with Amazon S3 as the primary data lake/storage layer for ingesting, storing, and processing structured and unstructured data. </li> <li>Optimize Spark jobs for performance, scalability, and cost efficiencyDevelop reusable frameworks and components for data ingestion, transformation, and validation.</li> <li>Collaborate with data architects, analysts, business teams, and application teams to understand data requirements and deliver reliable solutions.</li> <li>Ensure da...