AI/ML Engineer - Databricks

Optimal Inc.

• $110K — $130K *
Technical Services
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in Data Engineering, Machine Learning Engineering, AI/ML, or related field.
  • 3+ years of hands-on experience with Databricks in production environment.
  • Strong knowledge of Databricks, PySpark, Spark SQL, Delta Lake, MLflow, Python, and SQL.
  • Proven track record of building and deploying production data pipelines and ML workflows.
  • Familiarity with cloud platforms such as AWS, Azure, or GCP.

Responsibilities

  • Design, develop, and optimize data and ML pipelines using Databricks.
  • Build scalable data processing solutions using PySpark and Spark SQL.
  • Manage data pipelines with Delta Lake.
  • Develop, train, and deploy machine learning models using Databricks and MLflow.
  • Prepare, transform, analyze data, and perform feature engineering for ML applications.
  • Optimize Databricks and Spark workloads for performance and scalability.
  • Collaborate with cross-functional teams to translate business challenges into data solutions.

Benefits

  • Opportunities for professional development and training.
  • Collaborative and innovative work environment.
  • Access to cutting-edge technology and tools.
  • Support for work-life balance practices.
Full Job Description
AI/ML Engineer - Databricks Position Summary We are seeking an experienced AI/ML Engineer with strong hands-on Databricks experience to develop and deploy data and machine learning solutions supporting manufacturing operations. The ideal candidate will have a strong background in Databricks, PySpark, SQL, MLflow, Python, and production ML workflows, with the ability to work with large-scale datasets and build scalable solutions. The ideal candidate will be someone who has recent, hands-on production experience with Databricks, rather than someone who has only listed Databricks as a skill. Candidates should be able to clearly explain the Databricks projects they have worked on, their role in building the solution, the technologies they used, and how the solution was deployed and supported in production. Key Responsibilities Design, develop, and optimize data and ML pipelines using Databricks. Develop scalable data processing solutions using PySpark and Spark SQL. Build and manage data pipelines using Delta Lake. Develop, train, and deploy machine learning models using Databricks and MLflow. Perform data preparation, transformation, feature engineering, and analysis for ML applications. Optimize Databricks and Spark workloads for performance and scalability. Implement production-ready ML workflows, including model tracking, deployment, and monitoring. Work with manufacturing, engineering, quality, and IT teams to translate business problems into data and ML solutions. Support AI/ML applications related to manufacturing, quality, process optimization, predictive maintenance, or other production use cases. Required Qualifications 5+ years of experience in Data Engineering, Machine Learning Engineering, AI/ML, or a related field. 3+ years of strong hands-on experience with Databricks in a production environment. Strong hands-on experience with Databricks, PySpark/Apache Spark, Spark SQL, Delta Lake, MLflow, Python, and SQL. Experience building and deploying production data pipelines and ML workflows. Strong understanding of data processing, transformation, feature engineering, and performance optimization. Experience working with cloud platforms such as AWS, Azure, or GCP. Experience with machine learning model development, training, deployment, and monitoring. Strong communication, analytical, and problem-solving skills. Preferred Qualifications Experience applying AI/ML in manufacturing, automotive, industrial, or production environments. Experience with machine vision, predictive maintenance, quality analytics, or manufacturing data. Experience with MLOps and production ML deployments. Experience with large-scale data platforms and cloud-based ML infrastructure. Experience working with manufacturing engineers, quality teams, plant operations, or other technical stakeholders.

Similar Jobs

More Jobs at Optimal Inc.

More Technical Services Jobs

Find similar AI/ML Engineer - Databricks jobs: