Senior AI Platform Engineer, Atlas AI

Cognite$120K — $150K *
Enterprise Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's or Master's degree in Computer Science or related field or equivalent experience.
  • 8+ years in backend software engineering, platform engineering, or MLOps, with experience in complex systems.
  • 2+ years building applications or platforms utilizing AI/ML models or LLMs.
  • Expert proficiency in Python with strong software architecture and API design skills.
  • Experience with Kubernetes and multi-cloud services (AWS, Azure, GCP).
  • Demonstrated success in production-grade SaaS development with CI/CD processes.
  • Familiarity with LLM orchestration frameworks.

Responsibilities

  • Design and maintain core Python SDKs and services for the Atlas AI platform.
  • Build the scalable core agentic runtime for managing industrial agents.
  • Develop a secure framework for AI agent tool use, enabling safe integration of new tools.
  • Optimize and deploy LLM serving layer for low-latency inference.
  • Implement evaluation and observability protocols for AI services, including automated testing.
  • Oversee the full development lifecycle in a production SaaS environment, including incident response.
  • Translate technical vision into implemented services in collaboration with Solution Engineers.

Benefits

  • Competitive health, dental, vision, and disability coverage for employees and dependents.
  • Unlimited PTO and paid parental leave.
  • 401(k) with employer matching.
  • Diversity, Equity, and Inclusion (DEI) focused workplace with opportunities to work internationally.
  • Modern working environment with a strong organizational culture.
  • Paid mobile phone and Wi-Fi.
Full Job Description
Cognite operates at the forefront of industrial digitalization, building AI and data solutions that solve some of the world's hardest, highest-impact problems. With unmatched industrial heritage and a comprehensive suite of AI capabilities, including low-code AI agents, Cognite accelerates the digital transformation to drive operational improvements.

Our moonshot is bold: unlock $100B in customer value by 2035 and redefine how global industry works.

What Cognite is Relentless to achieve

We thrive in challenges. We challenge assumptions. We execute with speed and ownership. If you view obstacles as signals to step forward - not step back - you'll feel at home here. Join us in this venture where AI and data meet ingenuity, and together, we forge the path to a smarter, more connected industrial future.

How you'll demonstrate Ownership

We are seeking an AI Platform Engineer to join the Cognite Atlas AI Product team in Phoenix, AZ, to engineer, build, and operate the production-grade, multi-cloud platform that enables our internal and partner teams to build, deploy, and manage industrial AI agents. You will be responsible for creating the core services, frameworks, and infrastructure for our "agent builder workbench" and agent runtime, focusing on scalability, reliability, cost-efficiency, and security. Your work will directly impact industrial efficiency and sustainability, which is critical to our mission of powering a high-tech, sustainable, and profitable industrial future.

The Impact you bring to Cognite
  • Design, build, and maintain the core Python SDKs and services for the Atlas AI platform. Create clean abstractions that empower Solution Engineers to easily define and test agents and workflows.
  • Build the core agentic runtime, ensuring it is scalable, meets its SLOs, and can reliably manage the state, orchestration, and execution of industrial agents.
  • Develop a robust, governed, and secure framework for AI agent tool-use. Engineer the platform components that allow solution engineers to safely add new tools (e.g., API calls, database queries) and that manage the secure execution, monitoring, and access control for those tools.
  • Manage the LLM serving layer, including deploying and optimizing models for low-latency/high-throughput inference. Build and maintain model routing logic to select the most appropriate model (e.g., performance vs. cost) for a given task.
  • Implement evaluation and observability for all AI services. Create standardized frameworks for systematically evaluating the performance, accuracy, cost, and safety of LLMs and agentic workflows. Drive the implementation of robust, automated testing strategies for LLM-based systems.
  • Own the full development lifecycle for services in a production SaaS environment. This includes establishing automated code coverage goals, rigorous code reviews, defining SLOs, participating in on-call rotations, and ensuring a fast and effective incident response process.
  • Work closely with the Lead Architect to translate the technical vision into implemented, production-grade services. Act as a key partner for the Solution Engineers (your internal customers) to understand their needs and abstract common patterns into reusable, robust platform components.
  • Stay up to date on the latest developments in the field, and mentor junior developers.


Required Qualifications
  • Bachelor's or Master's degree in Computer Science or a related field, or equivalent practical experience.
  • 8+ years of professional experience in backend software engineering, platform engineering, or MLOps, with a proven track record of architecting and operating complex systems at scale.
  • 2+ years of hands-on experience building applications or platforms on top of AI/ML models or LLMs.
  • Expert-level proficiency in Python and a strong background in software architecture, robust API design, and building maintainable, well-documented SDKs for other developers.
  • Hands-on experience with Kubernetes (K8s) and building services on managed PaaS in a multi-cloud environment (AWS, Azure, GCP). Strong understanding of Infrastructure as Code (e.g., Terraform).
  • Proven experience building and operating production-grade SaaS software. Understanding of the full development life cycle, including CI/CD, monitoring, telemetry, and on-call incident response.
  • Practical experience with LLM orchestration frameworks (Bedrock, Vertex, Semantic Kernel, LangChain).
  • Strong verbal and written communication skills, with the ability to articulate complex technical designs and decisions clearly.


Preferred Experience
  • Hands-on experience deploying and managing LLMs in production using high-performance serving frameworks.
  • Experience with MLOps/LLMOps tools for tracing, monitoring, and evaluating LLM applications (LangSmith, Arize, Phoenix, or equivalent).
  • Experience with RAG Infrastructure, embedding generation pipelines, vector database integrations, and high-performance vector similarity search APIs.


A snapshot of our many perks and benefits as a Cogniter

* Competitive compensation

* 401(k) with employer matching

* Competitive health, dental, vision & disability coverages for employees and all dependents

* Unlimited PTO

* Paid Parental Leave Program

* Employee Referral Program

* Join a team of 60+ different nationalities with Diversity, Equality and Inclusion (DEI) in focus .

* A highly modern and fun working environment with sublime culture across the organization, follow us on Instagram @cognitedata to know more

* Opportunity to work with and learn from some of the best people on some of the most ambitious projects found anywhere, across industries

* Join our HUB to be part of the conversation directly with Cogniters and our partners.

* Paid mobile phone and WiFI

Equal Opportunity

Cognite is committed to creating a diverse and inclusive environment at work and is proud to be an equal opportunity employer. All qualified applicants will receive the same level of consideration for employment.

About Cognite

Cognite is a technology company that provides industrial data management and analytics solutions. The company's platform allows businesses to collect, process, and analyze data from industrial equipment and systems. Cognite's solutions help businesses optimize their operations, reduce costs, and improve safety. The company was founded in 2017 and is headquartered in Oslo, Norway.
Learn more about Cognite
Size
500 employees
Industry
Founded
2017

Similar Jobs

More Enterprise Technology Jobs

Find similar Senior AI Platform Engineer, Atlas AI jobs: