Job Description
We are seeking a Data Engineer with strong Spark fundamentals and experience working in cloud-based data environments. The ideal candidate will have hands-on expertise in building scalable data pipelines and leveraging modern development tools to improve productivity.
Required Skill
- sStrong experience with Apache Spark and Databrick
- sSolid understanding of distributed data processing and performance optimizatio
- nExperience with AWS data services and cloud ecosystems, including
- :Amazon S
- 3AWS Glu
- eAmazon Redshif
- tData queues such as Amazon SQ
- SUnderstanding of cloud storage, data movement, and ingestion concept
- sExperience using AI-assisted coding tools such as GitHub Copilo
t
What You'll
- DoBuild and maintain scalable data ingestion and processing pipelin
- esDevelop and optimize Spark-based workloa
- dsWork with cloud-native...