McCarthy Holdings Inc

AI Engineer II

McCarthy Holdings Inc$90K — $120K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • 3-5 years of experience in software engineering, AI engineering, machine learning, data engineering, or related fields.
  • Bachelor's degree in Computer Science, Engineering, Data Science, or equivalent practical experience.
  • Experience deploying AI applications or machine learning solutions in production settings.
  • Proficient in Python and familiar with modern software engineering practices.
  • Knowledge of data pipelines, ETL/ELT processes, and API integrations.
  • Familiarity with SQL and relational data modeling.
  • Experience with cloud platforms such as Azure, AWS, or GCP.

Responsibilities

  • Design, develop, test, and maintain AI applications that support enterprise processes.
  • Build and support generative AI and agentic solutions using advanced AI practices.
  • Develop and maintain data pipelines and integrations for AI use cases.
  • Contribute to the design of data models that facilitate operational workflows.
  • Optimize prompts and retrieval strategies to enhance user experience.
  • Utilize AI-assisted development tools to ensure high code quality and security.
  • Participate in MLOps processes for continuous improvement of AI systems.

Benefits

  • Collaborative work environment with exposure to cutting-edge AI technologies.
  • Opportunities for continuous learning and professional development.
  • Engagement with business stakeholders to deliver impactful solutions.
  • Focus on responsible AI practices to ensure ethical application of technology.
  • Comprehensive support for deploying AI solutions in a production environment.
Full Job Description
POSITION SUMMARY

McCarthy is seeking a full-time AI Engineer II who will be part of the Engineering and Intelligence team. In this role, you will design, build, and support AI-powered applications and workflows that help drive business value across the enterprise.

Working closely with the AI Manager, business stakeholders, and fellow engineers, you will contribute to the development of production-grade AI solutions, including generative AI, agentic workflows, advanced analytics, and enterprise integrations. This is a hands-on engineering role focused on implementation, experimentation, deployment, and continuous improvement of AI capabilities.

The ideal candidate combines strong software engineering fundamentals with experience in AI and data-driven applications. Experience working within Palantir Foundry, including ontology-driven development, data products, operational workflows, and AI-enabled solutions, is strongly preferred.

RESPONSIBILITES
  • Design, develop, test, and maintain AI-powered applications, services, and workflows that support enterprise business processes.
  • Build and support generative AI and agentic solutions using modern AI engineering practices and frameworks.
  • Develop and maintain data pipelines, integrations, and reusable data products that enable AI and analytics use cases.
  • Contribute to the design and evolution of data models and ontologies that support operational and analytical workflows.
  • Develop and optimize prompts, retrieval strategies, and agent workflows to improve solution effectiveness, reliability, and user experience.
  • Leverage AI-assisted development tools and coding copilots to accelerate delivery while maintaining high standards for code quality, testing, security, and maintainability.
  • Participate in MLOps and PromptOps processes, including deployment, monitoring, evaluation, versioning, and continuous improvement of AI systems.
  • Collaborate with business and technical stakeholders to translate business requirements into practical technical solutions.
  • Support production AI solutions through troubleshooting, performance tuning, monitoring, and ongoing enhancement activities.
  • Contribute to documentation, reusable patterns, and engineering best practices that improve team effectiveness and solution consistency.
  • Follow established AI governance, security, and Responsible AI standards throughout the solution lifecycle.

QUALIFICATIONS
  • 3-5 years of experience in software engineering, AI engineering, machine learning, data engineering, or a related technical discipline.
  • Bachelor's degree in Computer Science, Engineering, Data Science, Information Systems, or a related field (or equivalent practical experience).
  • Experience building and deploying AI-enabled applications or machine learning solutions in production environments.
  • Strong programming skills in Python and experience with modern software engineering practices.
  • Data pipelines, ETL/ELT processes, and API-based integrations
  • SQL and relational data modeling
  • Cloud platforms such as Azure, AWS, or GCP
  • Containerized and serverless application deployment patterns
  • Building solutions on enterprise AI and data platforms such as Palantir Foundry, Azure AI, AWS, GCP, or Dataiku.
  • Generative AI platforms and frameworks such as OpenAI, Anthropic, LangChain, LlamaIndex, Hugging Face, or similar technologies.
  • Prompt engineering, evaluation methodologies, and retrieval-augmented generation (RAG) patterns.
  • Experience with Palantir Foundry is strongly preferred, including familiarity with:
    • Ontology-driven application development
    • AIP and AI-enabled workflows
    • Data products and pipeline development
    • Workshop applications and operational workflows
    • Code Repositories and software delivery within Foundry environments
    • Understanding of responsible AI concepts, including transparency, human oversight, security, and governance practices.

CHARACTERISTICS
  • Strong problem-solving and analytical skills with the ability to work through ambiguity and deliver practical solutions.
  • Effective communication skills and the ability to collaborate with technical and non-technical stakeholders.
  • Curiosity and enthusiasm for emerging AI technologies and software engineering practices.
  • Strong attention to quality, maintainability, and user experience.
  • Ability to learn new technologies quickly and apply them effectively in a business environment.
  • High degree of accountability, ownership, and commitment to delivering results.


About McCarthy Holdings Inc

McCarthy Holdings, Inc. is a construction company that provides general contracting, construction management, and design-build services. The company serves clients in the healthcare, education, commercial, and industrial sectors. McCarthy Holdings, Inc. was founded in 1864 and is based in St. Louis, Missouri.
Learn more about McCarthy Holdings Inc
Size
3,000 employees
Industry
Net Income
$100 million
5 Year Trend
+12%
Revenue
$4.4 billion

Similar Jobs

More Jobs at McCarthy Holdings Inc

More Information Technology Jobs

Find similar AI Engineer II jobs: