Illumio

Sr. Machine Learning Engineer

Illumio$130K — $180K *
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5-8 years of backend engineering experience with Java, Python, or Go.
  • Expertise in distributed systems and asynchronous architectures, particularly with Kafka.
  • Proficient in large-scale data processing using Apache Spark or Flink.
  • Hands-on experience with agentic frameworks and fine-tuning models.
  • Experience in observability using Langfuse and Evals frameworks.

Responsibilities

  • Architect and optimize high-throughput asynchronous systems for real-time data processing.
  • Design and maintain data pipelines to support high-volume analytics for AI applications.
  • Develop sophisticated AI agents for autonomous planning and reliable tool usage.
  • Lead architectural design for containerized services using Kubernetes on cloud infrastructure.
  • Ensure scalability and high availability in system designs.

Benefits

  • Access to cutting-edge technology for AI and data processing.
  • Work in a role that impacts enterprise solutions significantly.
  • Collaborate with a team focused on innovation and advanced technologies.
  • Opportunity to work with large datasets in a high-growth environment.
Full Job Description
As a Senior Software Engineer, you will architect high-scale distributed systems that process massive data volumes to fuel our Agentic AI ecosystem. You will lead the development of autonomous agents that don't just provide analytics, but take action-driving complex automation and insights for our enterprise customers. Your Impact: • Asynchronous Systems: Architect and optimize high-throughput, event-driven systems using Apache Kafka to handle real-time data flows. • Data Processing at Scale: Build and maintain large-scale data pipelines using Apache Spark or Flink to provide the high-volume analytics that power our AI. • Agentic Systems at Scale: Design sophisticated AI Agents capable of autonomous planning, memory management, and high-reliability tool-use across distributed environments. • Infrastructure & Orchestration: Lead the architectural design of containerized services on Kubernetes, ensuring high availability and scalability across Cloud Infrastructure (AWS/Azure/GCP). Your Toolkit: • 5-8 years of experience in backend engineering using Java, Python, or Go. • Expertise in distributed systems, asynchronous architectures (Kafka), and large-scale data processing (Spark/Flink). • Hands on experience with agentic frameworks (e.g., AutoGen, CrewAI, or custom orchestration layers), RAG, MCP, fine tuning models and prompt engineering. • Agentic observability using Langfuse, Evals frameworks for Testing/Resilience Bonus Points: • Advanced IaC: Expertise in building reusable Terraform modules and managing complex multi-region cloud deployments. • Vector DB Optimization: Deep experience in indexing strategies (HNSW vs IVF) and performance tuning for high-concurrency vector databases at scale. • AI Ops: Experience with LLM deployment optimization (e.g., vLLM, TensorRT-LLM) or managing proprietary model inference endpoints. This position involves access to software/technology that is subject to U.S. export controls. Any job offer made will be contingent upon the applicant's capacity to serve in compliance with U.S. export controls #LI-TD1 #LI-ONSITE

About Illumio

Illumio is a cybersecurity company that provides software for securing enterprise computing environments. The company was founded in 2013 by Andrew Rubin and PJ Kirner and is headquartered in Sunnyvale, California. Illumio's software uses micro-segmentation to protect against cyber threats by creating security policies that restrict access to sensitive data and applications. The company's software is used by a wide range of clients, including financial institutions, healthcare providers, and government agencies. Illumio has received numerous awards for its innovative approach to cybersecurity, including being named a Gartner Cool Vendor in 2016.
Learn more about Illumio
Size
500 employees
Industry
Founded
2013

Similar Jobs

More Jobs at Illumio

More Enterprise Technology Jobs

Find similar Sr. Machine Learning Engineer jobs: