Qualifications

• 6+ years experience in software engineering, data engineering, or MLOps
• Proficient in Python with practical knowledge of Pandas, PySpark, and PyArrow
• Solid grasp of Hadoop ecosystem and distributed computing
• Experience with CI/CD in machine learning environments
• Hands-on with monitoring tools for ML pipeline performance
• Strong team collaboration skills, especially in cross-functional teams
• Familiar with MLOps frameworks and possibly SLURM clusters

Responsibilities

• Optimize and maintain feature engineering pipelines on Hadoop infrastructures
• Refactor ML codebases for better usability and performance
• Collaborate on compute capacity planning and resource allocation
• Integrate model serving frameworks for deployment and testing
• Monitor and troubleshoot ML pipelines to ensure efficiency
• Share insights and document best practices for internal ML platforms
• Build near real-time ML pipelines with Kafka and Spark Streaming

Benefits

• Health and welfare benefits coverage options including medical, dental, and vision
• 401(k) plan participation
• Life insurance and voluntary plans
• Spending accounts for additional coverage needs