Principal Software Engineer

Compunnel

$130K — $180K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • 10+ years of software engineering experience at Principal or Architect level
  • Hands-on expertise in Machine Learning Engineering and AI system development
  • Extensive background in Large Language Models (LLMs), RAG, and Agentic AI workflows
  • Advanced Python programming and software engineering expertise
  • Strong understanding of scalable system architecture and distributed systems
  • Experience designing and deploying production-grade AI applications
  • Excellent problem-solving and analytical skills
  • Strong collaboration and leadership abilities

Responsibilities

  • Design, develop, and implement scalable AI and machine learning systems in production environments
  • Lead architecture and engineering efforts for LLM, RAG, and agentic AI solutions
  • Develop and maintain high-quality Python applications and frameworks
  • Build and optimize AI pipelines, APIs, and distributed systems
  • Provide technical leadership and architectural guidance across AI and software engineering teams
  • Collaborate with cross-functional teams to deliver scalable and reliable AI solutions
  • Review code, mentor engineers, and establish engineering best practices

Benefits

  • Opportunities for innovation and continuous improvement in AI engineering processes
  • Collaboration with cross-functional teams
  • Mentoring and leadership development
  • Focus on advanced AI technologies and solutions
Full Job Description
Job Summary:

We are seeking an experienced Principal Software Engineer to lead the design and development of advanced AI and machine learning solutions with a strong focus on Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and agentic workflows. The ideal candidate will combine deep software engineering expertise with hands-on machine learning engineering experience to build scalable, production-ready AI systems. This role requires strong Python engineering skills, architectural leadership, and the ability to guide technical strategy across AI initiatives.

Key Responsibilities:

  • Design, develop, and implement scalable AI and machine learning systems in production environments
  • Lead architecture and engineering efforts for LLM, RAG, and agentic AI solutions
  • Develop and maintain high-quality Python applications and frameworks
  • Build and optimize AI pipelines, APIs, and distributed systems
  • Provide technical leadership and architectural guidance across AI and software engineering teams
  • Collaborate with cross-functional teams to deliver scalable and reliable AI solutions
  • Review code, mentor engineers, and establish engineering best practices
  • Troubleshoot and resolve complex engineering and system performance issues
  • Drive innovation and continuous improvement in AI engineering processes and system design
  • Ensure system reliability, scalability, security, and maintainability

Required Skills:

  • 10+ years of experience in software engineering with recent experience at Principal or Architect level
  • Strong hands-on experience in Machine Learning Engineering and AI system development
  • Extensive experience with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI workflows
  • Advanced Python programming and software engineering expertise
  • Strong understanding of scalable system architecture and distributed systems
  • Experience designing and deploying production-grade AI applications
  • Strong problem-solving, debugging, and analytical skills
  • Excellent collaboration, communication, and leadership abilities


Preferred Skills:

  • Experience with cloud platforms and AI infrastructure
  • Familiarity with MLOps, CI/CD pipelines, and containerization technologies
  • Experience with vector databases, orchestration frameworks, and AI workflow automation
  • Knowledge of API development and microservices architecture


Education:

Bachelor's or Master's degree in Computer Science, Engineering, Artificial Intelligence, or related field

Similar Jobs

More Jobs at Compunnel

More Information Technology Jobs

Find similar Principal Software Engineer jobs: