Job Description
About the job
You will be joining a growing AI team with 10 other members and a core mission to turn data into measurable business value. Your primary role is to build and operate reliable data pipelines in a young scaleup on track for 300% YoY growth.
Your work will support projects ranging from AI voice agents and smart scheduling systems to large-scale data products serving 100,000+ merchants.
What you'll do
- Design, build, and own batch and streaming pipelines in Databricks (PySpark & Lakebase).
- Model data for analytics and ML; maintain clean, well-documented tables in Unity Catalog.
- Work with external APIs and internal teams to integrate new data sources
- Implement data quality, lineage, and observability.
- Optimize cost and performance
- Partner with data scientists and product teams to deliver features.
- Automate deployment and testing; keep pipelines simple and maintainable using Databric...