Full Job Description
Your working location will be fully on-site located in State College, PA.
We are searching for an experienced analyst to join our Research Artificial Intelligence Department of the Applied Research Laboratory (ARL) at Penn State. This role will focus on planning, executing, and delivering high-quality labeled datasets that fuel machine learning models and research outcomes. You will also contribute to data labeling and analysis while leading and mentoring a team of junior analysts and interns to complete labeling projects accurately, consistently, and on schedule.
You will:
- Lead end-to-end execution of data labeling projects, including defining labeling standards, workflows, quality criteria, and acceptance thresholds in support of machine learning initiatives
- Perform data labeling and annotation across relevant data types, setting the standard for quality and consistency on the team
- Lead, mentor, and coordinate a team of junior analysts and interns, assigning work, reviewing output, and ensuring labeling accuracy, throughput, and timely delivery
- Develop and maintain labeling guidelines, taxonomies, and documentation to ensure consistency and repeatability across labelers
- Establish and monitor quality control processes, including inter-annotator agreement checks, spot audits, and error correction workflows
- Partner with data scientists, engineers, and research leads to understand model requirements and translate them into effective labeling schemas and datasets
- Track project progress, throughput, and quality metrics; report status and escalate risks or blockers as needed
- Ensure all data handling, labeling, and storage practices comply with applicable cybersecurity, information governance, and data-handling requirements
- Develop a strong understanding of the mission and the problems being solved, and apply that context to improve labeling quality and prioritization
- Support the dissemination of research and results to the broader technical and operational community, leveraging professional networks and outreach where possible
- Identify and recommend improvements to labeling tools, processes, and workflows to increase efficiency and quality
- Coordinate schedules, priorities, and resources across the labeling effort and with dependent project teams
Required Skills/Experience areas include:
- Demonstrated experience leading or performing data labeling, annotation, or data preparation for machine learning projects
- Past success leading, mentoring, or coordinating a team, including junior staff and/or interns
- Data quality principles and quality control methods (e.g., inter-annotator agreement, audit workflows)
- Familiarity with machine learning concepts and how labeled data supports model training and evaluation
- Strong understanding of the defense mission, including the operational problems that applied research seeks to address
- An existing professional network/connections and experience helping share or transition research to the broader technical or operational community
- Success supporting the military, IC, federal customers, in a security-controlled environment
- Familiarity with cybersecurity, information governance, and data-handling practices (e.g., NIST RMF)
- Success in environments where various forms of communication and organizational skills were crucial to be effective
- Current eligibility for access to classified information at the TS/SCI level or higher and may be subject to a government background investigation to upgrade clearance eligibility, if required
MINIMUM EDUCATION, WORK EXPERIENCE & REQUIRED CERTIFICATIONS
If filled as Technical Engineering Project Manager (ARL) - Senior Professional, this position requires:
Bachelor's Degree
6+ years of relevant experience; or an equivalent combination of education and experience accepted
Required Certifications: None
If filled as Technical Engineering Project Manager (ARL) - Advanced Professional, this position requires:
Bachelor's Degree
3+ years of relevant experience; or an equivalent combination of education and experience accepted
Required Certifications: None
ARL's purpose is to research and develop innovative solutions to challenging scientific, engineering, and technology problems in support of the Navy, the Intel Community (IC), and other federal government customers.
FOR FURTHER INFORMATION on ARL, visit our website at www.arl.psu.edu
SALARY & BENEFITS
The salary range for this position, including all possible grades, is $92,100.00 - $174,708.00.
Salary Structure - Information on Penn State's salary structure
Penn State provides a competitive benefits package for full-time employees designed to support both personal and professional well-being. In addition to comprehensive medical, dental, and vision coverage, employees enjoy robust retirement plans and substantial paid time off which includes holidays, vacation and sick time. One of the standout benefits is the generous 75% tuition discount, available to employees as well as eligible spouses and children. For more detailed information, please visit our Benefits Page.