Job SummaryWe are seeking an experienced and passionate Senior Data Engineer to join our Data Platform team. You will be joining a small team responsible for architecting, building, and maintaining the scalable, enterprise-grade data systems that power our data products and capabilities. You'll straddle the worlds of DataOps, MLOps, and Infrastructure, enabling both the next generation of analytics functionality and an AI Platform to fuel our AI-driven product innovation.
Since data engineers are responsible for their pipelines at Over-haul, this role requires engineers to take ownership of the operational excellence in their domain. In addition, the ideal candidate will have excellent data intuition and share our passion for continuously improving how we handle streaming data at Over-haul.
This position is based in Austin, Texas, but remote work is available.
Who are you?- You have strong product ownership and good intuition on how data is used to drive business decisions
- You strive to write elegant code and are comfortable with independently picking up new technologies.
- You have mastery over Python programming language and SQL.
- You enjoy helping teams push the boundaries of analytical insights, creating new product features using data, and powering machine-learning models.
- You have a strong background in at least one of the following: distributed data processing or software engineering of data services.
- You are familiar with big data technologies like Spark and comfortable working with web-scale datasets.
- You are passionate about the end-to-end software development lifecycle, focusing on automation, testing, CI/CD, and documentation.
- You have an eye for detail, good data intuition, and a passion for data quality.
- You love working independently while also collaborating and giving/receiving candid feedback.
- You are comfortable working in a rapidly changing environment with ambiguous requirements. You are nimble and take intelligent risks.
Job Duties- Design and maintain streaming data pipelines using Databricks, and Spark
- Create ML Pipelines to feed data and update a variety of models.
- Develop ML models to enhance predictive analytics capabilities and support decision-making processes across various departments.
Work Experience- Experience with Cloud based Data Lake Tools
- Experience with designing and implementing data pipelines
- Python and SparkSQL/Spark experience
Pluses- Azure Data Tools, such as Data Lake, Synapse, or Fabric
- Power BI Experience
Certifications and Education- BS in Computer Science or Related field preferred, but not required
- Top employee health and well- being benefits
- Care giver/adoption/family leave
- Flexible Time Off Policy
- Casual dress
- Perks and discounts through employee assistance program
Perks and Benefits - Top employee health and well- being benefits
- Care giver/adoption/family leave
- Flexible Time Off Policy
- Casual dress
- Perks and discounts through employee assistance program
