In this role, you will research and apply computer vision and machine learning techniques for surface inputs and natural interactions, tackling challenges in hand tracking, micro-gestures, eye tracking, 3D reconstruction, and real-time image processing. You'll collaborate with researchers in Reality Labs Research (RLR) to translate discoveries into production-ready solutions that impact billions of people.
Responsibilities
Lead the productization of CVML models for Surface inputs, including Surface keyboard and Surface trackpad, from development through deployment
• Design and execute large-scale experiments with vision models and datasets, defining evaluation protocols and driving research direction
• Partner with cross-functional teams to ship ML models end-to-end, from prototype to production
• Develop prototypes for future VR/AR/MR experiences and integrate robust solutions into products
• Contribute to publications at top-tier venues such as CVPR, ICCV, ECCV, and NeurIPS
• Define and scope projects for other engineers, providing technical direction and success criteria
Minimum Qualifications
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 7+ years of industry experience in machine learning, computer vision, or related fields
• Experience shipping ML models to production, including the full ML production cycle from development to deployment
• Prototyping and engineering experience in at least one specialization: SLAM, State Estimation, Sensor Fusion, 3D reconstruction, object detection, segmentation and tracking, or scene understanding
• Experience writing production-quality code in Python and deep learning frameworks such as PyTorch
Preferred Qualifications
• Experience productizing and deploying ML models on edge devices
• Publication track record at conferences such as CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, or SIGGRAPH
• Experience with real-time SLAM, 3D reconstruction, sensor fusion, object/body tracking, or depth estimation
• PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics, or related field
• Experience developing CV/ML systems for edge devices (mobile phones, AR/VR headsets, custom hardware)
