Moody's Investors Service

Let's begin! AI QA Engineer (15158)

Moody's Investors Service • $78K — $113K *
Charlotte, NC 28269In-Person
Information Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • Basic knowledge of software testing concepts such as manual, exploratory, regression, API, and integration testing.
  • Familiarity with programming or scripting, preferably Python, and an understanding of APIs, databases, and JSON.
  • Awareness of AI concepts, including limitations like hallucinations and inconsistencies.
  • Interest in evaluating AI-enabled products and prompt engineering.
  • Strong documentation skills for clearly detailing defects and their reproduction steps.
  • Excellent analytical and communication skills with team collaboration experience.
  • Enthusiasm for learning about AI tools and responsible practices.

Responsibilities

  • Execute various testing methodologies on software and AI products within an Agile team.
  • Review testing outputs for accuracy in AI-driven features, ensuring they meet expected standards.
  • Develop test scenarios and data specific to AI behavior assessment.
  • Utilize basic prompt and context engineering during testing procedures.
  • Employ AI-assisted tools under executive guidance to enhance testing accuracy.
  • Assist in maintaining AI evaluation tools and regression tests to ensure software quality.
  • Document and communicate defects effectively with stakeholders to facilitate resolutions.
  • Contribute to enhancing quality assurance processes and test documentation.

Benefits

  • Comprehensive medical, dental, and vision coverage.
  • Parental leave and paid time off.
  • 401(k) plan with employee and company contributions.
  • Life, disability, and accident insurance.
  • Discounted employee stock purchase plan.
  • Tuition reimbursement opportunities.
Full Job Description
Skills and Competencies
  • Basic understanding of software testing concepts, including manual, exploratory, regression, API, and integration testing methodologies
  • Basic programming or scripting knowledge, preferably in Python, with familiarity in APIs, databases, JSON, version control, and defect tracking tools
  • Basic understanding of AI concepts, large language models, and common AI limitations such as hallucinations, incomplete responses, and inconsistent outputs
  • Interest in prompt engineering, context engineering, and the evaluation of AI-enabled products
  • Ability to document defects clearly with steps to reproduce, expected results, and actual results
  • Strong analytical, communication, documentation, and problem-solving skills with the ability to collaborate across engineering and product teams
  • Basic understanding of artificial intelligence concepts, with curiosity and enthusiasm for learning how AI tools can be used to improve processes and drive efficiency. Interest in exploring AI systems and a willingness to develop awareness of responsible AI practices, including risk management and ethical use

Education
  • Bachelor's degree in Computer Science, Software Engineering, or a related field

Responsibilities

Support quality engineering efforts across an Agile team by executing software and AI product testing, documenting findings, and contributing to continuous improvement of QA processes.
  • Perform manual, exploratory, regression, API, and integration testing within an Agile team environment under close guidance
  • Test software features that include AI or large language model components, reviewing outputs for accuracy, relevance, completeness, consistency, and instruction-following
  • Create basic test scenarios, prompts, and test data for evaluating AI behavior and identifying issues such as hallucinations, incomplete responses, and inconsistent results
  • Apply basic prompt engineering and context engineering techniques during testing activities
  • Use AI-assisted tools such as Codex, Claude Code, and similar AI command-line interface tools under the guidance of senior team members
  • Assist with existing AI evaluation harnesses, test scripts, and regression checks to support quality validation efforts
  • Document defects with clear steps to reproduce, expected results, and actual results, and collaborate with engineers, developers, and product owners to investigate and resolve issues
  • Contribute to test documentation, reusable test cases, and the continuous improvement of quality assurance processes and standards

About the Team

Our Quality Engineering team is responsible for building reliable, high-quality software and AI-enabled products that our clients and stakeholders depend on. By joining our team, you will be part of exciting work in software testing, AI product evaluation, and quality engineering, while contributing to a collaborative environment that values continuous learning, innovation, and responsible AI adoption. This role offers a meaningful opportunity to develop practical, hands-on skills at the intersection of traditional quality assurance and emerging artificial intelligence technologies.

For US-based roles only: the anticipated hiring base salary range for this position is $78,300.00 - $113,550.00, depending on factors such as experience, education, level, skills, and location. This range is based on a full-time position. In addition to base salary, this role is eligible for incentive compensation. Moody's also offers a competitive benefits package, including not but limited to medical, dental, vision, parental leave, paid time off, a 401(k) plan with employee and company contribution opportunities, life, disability, and accident insurance, a discounted employee stock purchase plan, and tuition reimbursement.

About Moody's Investors Service

Moody's Investors Service is a bond credit rating business that provides research, credit rating, and financial risk analysis services. The company’s ratings and analysis track debt that covers various countries, corporate issuers, public finance issuers, and structured finance obligations. Additionally, the company also offers predictive ratings, research and investor briefings, pricing and valuation tools, and credit opinions. The company’s primary goal is to help investors analyze the credit risks associated with fixed-income securities. Moody’s Investor Service rates debt securities in several market segments related to public and commercial securities in the bond market. These include government, municipal and corporate bonds; managed investments such as money market funds, fixed-income funds, and hedge funds; financial institutions that include banks and non-bank finance companies; and asset classes in structured finance. Considered one of the Big Three credit rating agencies, Moody’s Investor Service employs approximately 6,100 people worldwide and maintains a presence in 28 countries. Moody’s Investor Service was founded by John Moody in 1999 and is headquartered in New York City, United States.

Moody's Investors Service Careers

Join the esteemed team at Moody's Investors Service, a leading global provider of credit ratings, research, and risk analysis. This is a prime opportunity to be part of a company that values professional growth, leadership, and innovation in the financial industry.

Work You’ll Do

At Moody's Investors Service, the focus is on empowering the financial community to make better decisions through high-quality, independent, and rigorous analytics. The team at Moody's Investors Service is dedicated to maintaining and enhancing the transparency, integrity, and efficiency of global markets.

Explore Job Opportunities and Internships

Moody's Investors Service offers a variety of career paths, including full-time positions and internships that provide valuable industry experience. The company is committed to fostering a culture of excellence where skilled, passionate, and solution-driven team players thrive.

Innovative Work Environment

Engage in work that matters with a team that combines deep industry expertise with innovation to deliver insights that matter to global markets. Moody's Investors Service is at the forefront of integrating cutting-edge technology and data analysis in the financial sector.

Professional Growth and Development

Moody's Investors Service believes in future-proofing careers by offering unmatched opportunities for professional development and advancement. Whether through leadership programs, diversity training, or networking events, employees are equipped to excel in their careers and contribute to the company's success.

Benefits and Culture

The culture at Moody's Investors Service is built on a foundation of respect, integrity, and inclusion. Employees enjoy comprehensive benefits designed to support their health, well-being, and financial security. The company's commitment to diversity and inclusive growth makes it a leader not just in financial services, but also as an employer of choice.

Join the Team

Discover the range of positions available, from analyst roles to leadership opportunities. Moody's Investors Service is actively hiring and looking for individuals who bring creativity, teamwork, and a strong work ethic to the table.

Prepare for Your Interview

To join Moody's Investors Service, start by tailoring your resume to highlight relevant skills and experiences. Prepare for your interview by researching the company's impact on the financial industry and come ready to discuss how your background aligns with the company's goals and values.

Stay Connected

Keep up to date with the latest from Moody's Investors Service by following their career blog. Gain insights from insiders, and stay informed about new job openings and industry news.

Career Advancement at Moody's Investors Service

With a steadfast commitment to nurturing talent and a clear path for career advancement, Moody's Investors Service remains a top choice for professionals aiming to excel in the financial sector. Explore how you can contribute to and benefit from the company's legacy of success.

Search Moody's Investors Service Jobs

Find the position that matches your skills and interests. Moody's Investors Service is looking for dedicated, curious, and innovative professionals to join their team. Explore the exciting and rewarding opportunities that await at Moody's Investors Service.
Learn more about Moody's Investors Service
Industry
Finance & Insurance
Founded
1900
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Moody's Investors Service

More Information Technology Jobs

Find similar Let's begin! AI QA Engineer (15158) jobs:

NationwideCharlotte, NC