About this Role:
Overwatch is seeking a Test Automation Engineer to own and evolve how we validate edge-deployed imaging systems across software, Jetson-based compute, and hardware-integrated sensor payloads-through automation, tooling, and AI-assisted testing.
What You'll Do:
End-to-End System Testing
- Design and execute tests across UI, APIs, backend, and Jetson-based systems.
- Translate customer issues into reproducible test cases.
- Define expected behavior, tolerances, and failure conditions.
- Identify edge cases and integration gaps.
Test Automation & Tooling
- Build and maintain automated regression and integration tests.
- Test orchestration and execution.
- Log collection, parsing, and failure detection.
- Test telemetry and reporting.
- Expand coverage while reducing manual testing.
- Integrate automation into CI/CD pipelines
Hardware Integration Validation
- Validate software that runs on Jetson devices and interfaces with in-house smart-sensors and third-party payloads.
- Reproduce and debug software 14 hardware issues.
- Turn integration failures into repeatable tests.
- Maintain and support Hardware-in-the-loop (HIL) setups.
Field Issue Troubleshooting
- Investigate and reproduce customer-reported issues.
- Build tools and workflows for faster debugging (logs, replay, diagnostics).
- Feed findings back into automated test coverage.
AI-Assisted Testing
- Apply AI where it improves validation:
- UI testing (e.g., Playwright).
- Log analysis and anomaly detection.
- Evolve testing toward more adaptive, intelligent systems.
What Success Looks Like
- Critical workflows are automated and continuously validated.
- Integration issues are caught early and are reproducible.
- Customer issues are faster to diagnose and resolve.
- Testing scales with reduced manual effort.
Who You Are
- 5+ years of experience in test automation and hardware/software validation
- Experience with system, integration, or embedded testing.
- Comfortable working with software deployed to edge hardware (Jetson devices or similar).
- Strong systems thinking across software and hardware.
- Experience building test automation, tools, or frameworks.
- Proficient in Python and Linux environments.
- Bonus: Experience with HIL testing, Playwright, or AI-assisted testing.
Summary
This role combines system-level testing, automation, and real-world debugging. You will build the infrastructure and workflows that ensure our software and hardware systems work reliably in the field.
What We Offer
- Growth Opportunities: As a team member of a true startup, you will learn by doing and shape our future. The opportunities are limitless for those who want to grow their career.
- Impact Opportunity: We work on missions that matter to keep people safe and make the world better, and we do it at the speed of a startup.
- Late Start Wednesday: A weekly block to have focus time away from meetings and calls
- Time Off: Generous unlimited PTO policy
- Stock Options
- Medical and Dental premiums 100% covered
- 401K Matching
