Job Description
Description We are looking for an experienced Data Engineer to join a team in Madison, Wisconsin, in a contract capacity with the potential for a permanent role. This position will focus on building and optimizing modern data solutions that support scientific and business decision-making, with particular relevance to bioinformatics and life sciences data. The ideal candidate brings deep expertise in cloud-based data engineering, strong hands-on experience with Databricks and Azure, and the ability to collaborate effectively with technical and non-technical partners.
Responsibilities:
• Design, build, and maintain scalable data pipelines and integration workflows that support reporting, analytics, and downstream scientific applications.
• Develop and optimize cloud-based data platforms using Databricks, Python, Spark, and Delta Lake to manage large and complex datasets efficiently.
• Create and enhance data models, database objects, and processing logic within relation...
Responsibilities:
• Design, build, and maintain scalable data pipelines and integration workflows that support reporting, analytics, and downstream scientific applications.
• Develop and optimize cloud-based data platforms using Databricks, Python, Spark, and Delta Lake to manage large and complex datasets efficiently.
• Create and enhance data models, database objects, and processing logic within relation...