AI Software Engineer

Hallmark Health Care Solutions, Inc.

$115K — $137K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science, AI, Data Science, or related field.
  • 6+ years of software engineering experience, with 3+ years in AI/ML.
  • Hands-on experience building and deploying production-grade AI systems.
  • Ability to deliver AI initiatives independently in enterprise settings.
  • Proficient in Python and familiar with APIs and data engineering concepts.

Responsibilities

  • Design, develop, and deploy scalable AI systems focused on reliability and outcomes.
  • Translate complex business problems into practical AI solutions.
  • Lead multiple AI initiatives while coordinating with various stakeholders.
  • Drive proof-of-concepts and manage production implementations independently.
  • Implement Agentic AI workflows for intelligent decision support.

Benefits

  • 100% employer coverage for medical, dental, and vision insurance premiums.
  • $3,000 annual HSA contributions for enrolled employees.
  • Unlimited paid time off for work-life balance.
  • Pre-tax and Roth 401(K) retirement options.
  • On-site amenities including a gym, free parking, and provided lunches three times a week.
Full Job Description
AI Software Engineer

Department: Physician Enterprise Development

Employment Type: Full Time

Location: New Jersey Office

Reporting To: Atul Jain

Compensation: $115,000 - $137,500 / year

Description

*** Please note, this role is NOT 100% remote. We are considering applicants in the Princeton, NJ area who can interview in person and occasionally work in our NJ office.

What You'll Do

We are looking for a highly capable and hands-on AI Engineer to join our growing engineering and product innovation team. The ideal candidate should be able to understand complex business and AI requirements, architect practical AI-driven solutions, collaborate with technical leads and managers, and independently deliver production-grade AI initiatives.

What We Are Looking For
  • Someone who can think beyond demos and build AI systems that work reliably in real-world production environments.
  • A self-driven engineer who can take ownership of AI initiatives with minimal supervision.
  • A strong collaborator who can work effectively with leadership, managers, architects, and distributed engineering teams.
  • An individual passionate about solving meaningful business problems using practical AI innovation.

AI Solution Design & Delivery
  • Understand business problems and translate them into scalable AI/ML and Generative AI solutions.
  • Design, develop, and deploy enterprise-grade AI systems with a strong focus on reliability, scalability, monitoring, and measurable outcomes.
  • Lead or contribute to multiple AI initiatives simultaneously while coordinating with engineering leads, product managers, architects, and offshore teams.
  • Independently drive proof-of-concepts, pilots, and production implementations.


Agentic AI & LLM Systems
  • Design and implement Agentic AI workflows capable of multi-step reasoning, orchestration, task automation, and intelligent decision support.
  • Build AI agents using frameworks such as LangChain, LangGraph, LlamaIndex, CrewAI, MCP, or equivalent orchestration platforms.
  • Implement memory management, evaluation pipelines, guardrails, failure recovery, and observability for production AI systems.
  • Develop prompt engineering strategies and optimize LLM interactions for enterprise use cases.


RAG & Semantic Search
• Build scalable Retrieval-Augmented Generation (RAG) systems including:
• Document ingestion pipelines
• Chunking strategies
• Embedding generation
• Vector databases
• Hybrid semantic and keyword retrieval
• Re-ranking pipelines
• Citation traceability
• Work with vector stores such as FAISS, Pinecone, Weaviate, or similar technologies.
• Implement evaluation frameworks to measure retrieval quality and response accuracy.

AI/ML Engineering
  • Develop and optimize ML and Deep Learning models for predictive analytics, classification, forecasting, NLP, computer vision, and recommendation systems.
  • Work with modern ML frameworks such as PyTorch, TensorFlow, Scikit-learn, XGBoost, and Hugging Face.
  • Participate in model fine-tuning, instruction tuning, RLHF, LoRA, and PEFT initiatives where applicable.


Cloud, MLOps & Engineering Excellence
  • Build scalable AI infrastructure on cloud platforms such as Azure, AWS, or GCP.
  • Implement MLOps best practices including CI/CD pipelines, model monitoring, experiment tracking, infrastructure automation, and deployment orchestration.
  • Work with tools such as Docker, Kubernetes, Terraform, MLflow, Airflow, and GitHub Actions.
  • Optimize infrastructure usage, performance, and operational cost.


Collaboration & Leadership
  • Work closely with onsite and offshore engineering teams to ensure smooth delivery and communication.
  • Collaborate with technical leads, architects, QA teams, DevOps teams, and product stakeholders.
  • Mentor junior engineers and contribute to AI capability building within the organization.


What We're Looking For
  • Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Machine Learning, or related field.
  • 6+ years of software engineering experience with at least 3+ years focused on AI/ML and Generative AI initiatives.
  • Hands-on experience building and deploying production AI systems.
  • Experience delivering AI initiatives independently in enterprise environments.
  • Understanding of LLMs, Agentic AI architectures, and RAG systems.
  • Python programming skills and experience with APIs, distributed systems, and data engineering concepts.
  • Experience working in onsite/offshore collaboration models.
  • Excellent communication, analytical thinking, and problem-solving skills.

Preferred Skills
  • Experience in Healthcare, Workforce Management, Staffing, Compliance, or Enterprise SaaS domains.
  • Exposure to AI governance, compliance, security, and responsible AI practices.
  • Experience with Computer Vision, NLP, forecasting, or healthcare AI use cases.
  • Knowledge of HIPAA-compliant AI solution development is a plus.
  • Exposure to AI evaluation frameworks such as LangSmith, RAGAS, or equivalent.
  • Experience integrating AI solutions with enterprise platforms and third-party systems.


The Perks
  • Medical, Dental, and Vision Insurance with Employee Premiums Covered by HHCS at 100% and Company Cost Share for any Dependents Enrolled
  • $3000 Annual Company Contributions to HSAs for all Employees Enrolled in the HSA Eligible Health Plan
  • Unlimited Paid Time Off
  • Pre-Tax and Roth 401(K) Retirement Options
  • On-Site Gym, Free Parking, and Provided Lunches 3 Times per Week in the Dallas Office!

Similar Jobs

More Information Technology Jobs

Find similar AI Software Engineer jobs: