Data Engineer / AI Workflow Engineer

Compunnel

$90K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or similar field, or equivalent experience.
  • At least 5 years of experience in Data Engineering or ETL Development roles.
  • Strong proficiency in Python for ETL processes and data handling.
  • Proven track record in designing and maintaining enterprise data pipelines.
  • Experience with cloud-based or distributed data environments.
  • Familiarity with AI and machine learning workflows and integration.
  • Exceptional troubleshooting, analytical, and collaborative skills.

Responsibilities

  • Design and maintain scalable ETL pipelines for data ingestion and transformation.
  • Develop data engineering solutions that support analytics and AI initiatives.
  • Manage structured and unstructured data from various enterprise sources.
  • Collaborate with cross-functional teams to integrate AI into platforms.
  • Support AI workflows including model evaluation and operationalization.
  • Ensure data quality and governance across pipelines.
  • Automate workflows to boost efficiency and scalability.

Benefits

  • Participation in architecture discussions for enterprise data platforms.
  • Opportunities to refine and optimize cloud-based analytics solutions.
  • Collaboration with diverse teams including product and data science.
  • Engagement with cutting-edge AI technology within regulated sectors.
  • Potential for involvement in projects across various industries like healthcare and finance.
Full Job Description
Job Summary

We are seeking an experienced Senior Data Engineer to design, develop, and optimize enterprise data pipelines and AI-enabled data workflows. This role focuses on building scalable ETL solutions, integrating AI capabilities into enterprise platforms, and supporting data-driven analytics across regulated business environments. The ideal candidate will have strong expertise in Python, cloud-based data engineering, ETL development, and AI/ML workflow integration.

Key Responsibilities
• Design, develop, and maintain scalable ETL pipelines for data ingestion, transformation, and delivery across enterprise systems.
• Develop data engineering solutions supporting analytics, reporting, and AI-driven business use cases.
• Process and manage structured and unstructured data from multiple enterprise data sources.
• Collaborate with engineering, product, and data science teams to integrate AI solutions into enterprise platforms.
• Support AI development workflows including experimentation, model evaluation, deployment, optimization, and operationalization.
• Perform data preparation, feature engineering, and validation for AI and machine learning solutions.
• Ensure data quality, consistency, reliability, performance, and governance across enterprise data pipelines.
• Automate data processing workflows to improve operational efficiency and scalability.
• Monitor, troubleshoot, and optimize large-scale data processing pipelines.
• Develop and maintain technical documentation, data workflows, and implementation standards.
• Participate in architecture discussions and contribute to enterprise data platform improvements.
• Support deployment and maintenance of cloud-based analytics and AI solutions.

Required Qualifications
• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field, or equivalent professional experience.
• Minimum 5 years of experience in Data Engineering, ETL Development, or related technical roles.
• Strong hands-on experience with Python for ETL development and data processing.
• Experience designing, developing, and maintaining enterprise data pipelines.
• Experience working with cloud-based or distributed data processing environments.
• Experience processing and optimizing large-scale datasets.
• Familiarity with AI and machine learning development workflows.
• Experience integrating AI solutions into enterprise applications.
• Strong troubleshooting, debugging, analytical, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Qualifications
• Experience with enterprise AI tools and workflows, including Large Language Model (LLM) orchestration.
• Experience with prompt engineering and AI workflow automation.
• Experience working with AI copilots or enterprise AI platforms.
• Experience working in regulated enterprise environments.
• Experience collaborating with product, engineering, and data science teams.
• Experience supporting enterprise analytics, regulatory reporting, knowledge management, risk management, healthcare analytics, financial services, Legal Technology, or AI-enabled enterprise data platforms.

Education
• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field.
• Equivalent hands-on experience in data engineering or AI/ML workflows may be considered in lieu of a degree.

Similar Jobs

More Jobs at Compunnel

More Information Technology Jobs

Find similar Data Engineer / AI Workflow Engineer jobs: