About This RoleWe are seeking a Principal AI Platform Engineer to build the shared product-integrity layer for customer-facing AI systems. This role will create the evaluation, observability, safety, and launch-readiness infrastructure needed to ship AI features with measurable quality, reliability, and customer impact. In this role, you will be responsible to:
- Build shared evaluation infrastructure for models, prompts, agents, and multimodal AI systems.
- Own golden datasets, regression suites, offline and online evals, and LLM-as-judge governance.
- Develop observability for model quality, latency, cost, drift, safety, and customer impact.
- Create launch-readiness gates for AI features across camera, agentic, personalization, multimodal, and energy products.
- Partner with Product, Analytics, Privacy, Security, and Engineering on trustworthy AI productization.
- Define reusable standards for AI quality, monitoring, safety, and operational readiness.
Required Qualifications:- Bachelor's degree in Computer Science, Software Engineering, Data Science, or related field
- 10+ years of software engineering, ML engineering, or AI platform experience
- Experience evaluating, deploying, or monitoring production AI systems
- Strong Python and data engineering skills
- Experience with offline/online evaluation, data quality, model monitoring, or observability systems
- Familiarity with LLM evaluation, prompt evaluation, model regression testing, or safety guardrails
- Strong communication skills and ability to set standards across teams
Preferred Qualifications:- Experience with LLM-as-judge, agent tracing, multimodal evals, golden datasets, or automated regression suites
- Experience with GCP/AWS, Vertex AI, SageMaker, MLflow, Datadog, OpenTelemetry, Private Cloud or similar tooling
- Experience with privacy-aware AI systems, customer trust metrics, or launch-readiness processes
- Experience supporting computer vision, GenAI, recommendation, or edge AI products
- Experience building developer platforms or internal AI tooling
Working at Vivint:
Learn about the Vivint Culture and why it's a great place to grow your career!
Here are some highlighted perks you should ask us about:
- Free daily lunch and drinks on site
- Paid holidays and flexible paid time away
- Employee/Friends/Family Discounts
- Onsite health clinic, gym, gaming tables
- Medical/dental/vision/life coverage & 24/7 Medical Hotline
- 401(k) + Employer Match
- Employee Resource Groups
- Quarterly Innovation Weeks
WORKING CONDITIONS:
This job operates in a professional office environment. This role routinely uses standard office equipment such as computers, phones, photocopiers, filing cabinets and fax machines.
SAFETY:
Vivint enforces a safety culture whereby all employees have the responsibility for continuously developing and maintaining a safe working environment. Each new employee is responsible for completing all training requirements. Additionally, the employee must accept they have responsibility for maintaining the safety of themselves, their co-workers, and the public. Employee must adhere to all written and verbal instructions, promptly report and correct all hazards or unsafe conditions, question non-standard operations or unmitigated hazards, and provide feedback to management on all safety issues.
We support the use of AI tools to help you prepare for your interview (e.g., practicing responses, researching the role, or refining your resume). However, during interviews and assessments, we expect responses to reflect your own thinking, experience, and communication. Use of AI to generate or read answers in real time, complete assessments, or misrepresent your qualifications is not permitted and may impact your candidacy.
