OverviewWe are looking for a Senior Software Engineer - to design, build and operate scalable data pipelines that power GitHub Copilot and related model's growing data needs. You'll play a key role in the collection and curation of data powering the latest GitHub CoPilot and coding model innovation across the company.
In this role, you will work across the full development lifecycle-- design, implementation, testing, deployment and live site support - while honing your technical depth and engineering craftmanship.
You will build tools and systems that ingest, process, curate large-scale GitHub Copilot datasets. You will partner closely with product teams to create, enhance and operate data pipelines that are efficient, reliable, compliant and secure.
You will join a world class, collaborative engineering team of engineers using agile methodologies and DevOps practices deliver and run production services.
Responsibilities- Design, build, and optimize large-scale, robust data pipelines and architectures that support GitHub Copilot models, eval, and analytics initiatives.
- Develop and extend scalable ETL/ELT workflows, ensuring reliable ingestion, transformation, and storage of high-volume, high-velocity data from diverse sources.
- Continuously improving systems for availability, reliability, efficiency, observability, and performance while applying and sharing modern engineering practices.
- Staying current with new technologies, patterns, and tooling that strengthen our engineering and operational excellence.
- Acting as a Designated Responsible Individual (DRI) as part of on-call rotations to monitor, troubleshoot, and restore data services.
QualificationsRequired Qualifications:
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, or Python
- OR equivalent experience.
Preferred Qualifications:
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 3+ years of experience in developing scalable, multi-threaded infrastructure/backend software with C# or Python or similar language
- 3+ years of experience with planning, scheduling and delivery of software.
- Experience working with AI-assisted developer tools
- 5+ years of professional software development experience in data processing systems
- 2+ year(s) of development of data ETL services and cloud services
- 2+ year(s) of software engineering practices, coding and solid foundation in data structures, algorithms with proficient testing, debugging and analytical skills
- Relevant experience running a 24/7 Azure-based services
- Experience working with experimentation systems, telemetry systems and data to drive engineering, AI services and/or model building and product decision making
- Customer focus and a deep commitment to delivering products that create customer value and delightful experiences
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
