Justworks

Senior AI Engineer

Justworks$188K — $242K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 6+ years of professional hands-on software engineering experience
  • Depth in full-stack or backend engineering with a focus on production systems
  • 2+ years of experience building LLMs and AI tooling in production
  • Proficiency in designing and running evaluation frameworks for AI systems
  • Familiarity with LLM observability tools like LangSmith and Datadog
  • Experience collaborating with cross-functional stakeholders
  • Strong communication skills with non-technical audiences
  • Ability to work in ambiguous environments and self-scope projects

Responsibilities

  • Identify high-leverage AI opportunities within business functions and manage them from scoping to handoff
  • Resolve AI-specific system gaps across the organization
  • Analyze external AI trends and translate insights into actionable briefs
  • Develop AI-powered tools and pipelines with advanced AI models
  • Design frameworks to evaluate the performance and usefulness of AI systems
  • Implement observability for AI systems, including logging and monitoring
  • Facilitate alignment with stakeholders across different functions
  • Represent AI Frontiers in cross-functional discussions.

Benefits

  • Hybrid work environment
  • Collaborative and diverse team culture
  • Opportunities for learning and development
  • Focus on craftsmanship and shared learning
  • Commitment to customer impact and internal collaboration
Full Job Description
Department

Data & Analytics
About The Team

The Data & Analytics team is Justworks' data and AI center of excellence - a connected set of functions spanning business intelligence, data science, analytics engineering, platform data/ML engineering and AI builders. We've grown significantly over the last several years and continue to build momentum across the business, leveling up maturity in how we deliver insights, govern data, and enable the company to make better decisions. You'll find a highly collaborative & diverse group motivated by craft, shared learning, and a genuine commitment to growing our impact for customers while evolving how we work together for our people. Come build with us!
Who You Are

You're an engineer who gets energized by hard problems that don't have a predetermined solution - and you know how to ship your way to an answer. You've built production systems, navigated real infrastructure, and learned to move fast without leaving a mess. You pick up new domains quickly and use that understanding to build solutions that fit. You see frontier AI not as something you're experimenting with but as the means by which we transform an org. You're insatiably curious, never satisfied leaving a system the way you found it, and you know how to evaluate whether an AI system is actually working - not just whether it runs. Impact matters more to you than the tools you used to get there; you center the customer even when you're building internal tooling.

Justworks is looking for a Senior AI Engineer to join AI Frontiers, a small internal consultancy that finds where AI creates step-change improvements across the company - builds the thing, gets it to production, and transfers it to the team that will own it. You'll move across business functions as a functional accelerator, resolve AI-specific systems gaps nobody else is moving on, and read what's emerging externally before it becomes obvious inside. You build, prove the pattern, and hand off. Technical execution is table stakes. The harder skill is navigating ownership, alignment, and organizational complexity while still shipping.
Your Success Profile
What You Will Work On
  • Drop into business functions to identify where AI has the highest leverage, define what to build, and own the full arc from scoping through handoff
  • Spot and resolve AI-specific systems gaps across the org - missing shared infrastructure, fragmented adoption patterns, absent measurement benchmarks - and move on them faster than the rest of the org could
  • Scan externally for emerging AI capabilities and market patterns; translate signal into written briefs that inform what the team experiments on next
  • Build AI-powered tools and pipelines using frontier models, agent frameworks, and LLM infrastructure as core building blocks, not experiments
  • Design and implement evaluation frameworks (evals) to measure whether AI systems are performing as intended - not just technically functional but meaningfully useful
  • Instrument AI systems for observability: logging, tracing, cost tracking, latency monitoring, and anomaly detection using tools like Datadog, LangSmith, or equivalent
  • Navigate cross-functional ownership dynamics: identify the right stakeholders, build alignment, and hand off in a way that sticks
  • Represent AI Frontiers in cross-functional forums and executive reviews as a credible voice on what AI can and can't do
  • Perform other related responsibilities as needed based on department and/or organizational needs
How You Will Do Your Work

In the Senior AI Engineer role, how results are achieved is paramount for your success and ultimately result in our success as an organization. In this role, your foundational knowledge, skills, abilities and personal attributes are anchored in the following competencies:
  • Plans & Aligns - Ensures individual actions support company mission; communicates effectively; understands urgency and plans accordingly
  • Balances Stakeholders - Understands internal and external stakeholder requirements, expectations, and needs and acts fairly despite conflicting demands of stakeholders.
  • Influence and Leadership - fostering a community of knowledge-sharing, collaboration, mentorship, and forward-thinking across the organization.
  • Manages Complexity - Making sense of complex, high quantity, and sometimes contradictory information to effectively solve problems.
  • Good Judgment - Pauses before acting; asks questions to fully understand context; applies critical thinking and takes ownership of outcomes
  • Teamwork & Communication - Honors diverse thoughts and opinions; leverages unique skills to maximize efficiency
  • Skills and Knowledge - the capacity to actively learn and apply specific domain knowledge, know-how, and best practices to continually enhance and improve.

In addition, all Justworkers focus on aligning their behaviors to our core values known as COGIS. It stands for:
  • Camaraderie - Day to day you can be seen working together toward a higher purpose. You like to have fun. You're an active listener, treat people respectfully, and have a strong desire to know and help others.
  • Openness - Your default is to be open. You're willing to share information, understand other perspectives, and consider new possibilities. You're curious, ask open questions, and are receptive to thoughts and feedback from others.
  • Grit - You demonstrate grit by having the courage to commit and persevere. You're committed, earnest, and dive in to get the job done well with a positive attitude.
  • Integrity - Simply put, do what you say and say what you'll do. You're honest and forthright, have a strong moral compass, and strive to match your words with your actions while leading by example.
  • Simplicity - Be like Einstein: "Everything should be made as simple as possible, but no simpler."
Qualifications
  • 6+ years of professional hands-on software engineering experience
  • Full-stack or backend engineering depth - shipped and maintained production systems, not just prototypes
  • 2+ years, hands-on experience building with LLMs and AI tooling in production: agent frameworks, pipelines, retrieval systems, or AI-integrated workflows that real users depend on
  • Experience designing and running evals: you know how to define what "working" means for an AI system and build the measurement scaffolding to prove it
  • Familiarity with LLM observability tooling (LangSmith, Datadog LLM monitoring, or equivalent):you instrument what you build and use signal to improve it
  • Track record of working across functions: partnered with non-engineering stakeholders, understood their problem domain, built something that fit
  • Strong written and verbal communication with non-technical audiences - you can explain a technical tradeoff to an ops lead without losing them
  • Comfort with ambiguity: you scope your own work, write your own briefs, and don't need a detailed spec to get started
  • Nice to have: practical machine learning experience: familiarity with model behavior, data quality, iteration loops, and how those fundamentals translate into building reliable AI systems

The base wage range for this position based in our New York City Office is targeted at $188,000.00 - $242,000.00 per year.

#LI-DG2 #LI-Hybrid

Actual compensation is based on multiple factors that are unique to each candidate, including and not limited to skill set, level of relevant experience, and specific work location. Salary ranges for positions based in other locations may differ based on the cost of labor in that location.

For more information about Justworks' Total Reward Philosophy, including all of the perks and benefits we are proud to offer our team members, please visit Total Rewards @ Justworks.

About Justworks

Justworks is a professional employer organization (PEO) that provides payroll, benefits, HR, and compliance services to small and medium-sized businesses. The company's platform automates administrative tasks and provides access to health insurance, 401(k) plans, and other benefits. Justworks was founded in 2012 and is headquartered in New York, New York.
Learn more about Justworks
Size
1,000 employees
Industry
Founded
2012

Similar Jobs

More Jobs at Justworks

More Information Technology Jobs

Find similar Senior AI Engineer jobs: