About The Role:- We are looking for a skilled Linguistic Engineer to join our team to build, maintain, and analyze datasets powering LLM powered features.
- In this role, you will be instrumental in building and assessing the quality of data processed by our Large Language Model [LLM] production systems.
- Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross functional team of engineers, research scientists, project managers, and data scientists to build datasets for, report on, and generally guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.
Job Title: Linguistic Engineer
Key Responsibilities:- Aggregate cross-functional requests and translate requests into actionable, high quality, datasets via synthetic data collections and on live user traffic.
- Deliver analytics, statistics, and model performance results on datasets.
- Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
- Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
- Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
- Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
- Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.
Minimum Qualifications:- Bachelor's degree in Linguistics, Computational Linguistics, or related required
- Minimum 4+ years of relevant experience in Linguistics
- Experience with Data Annotation
- SQL and Python
- Linguistic Background
- Knowledge of linguistics (Phonetics, Syntax, Semantics, Dialectology) required.
- Ability to analyze numerical rating results and draw conclusions based on data.
- Written and oral communication skills necessary for communicating on project milestones and for reporting findings.
Preferred Qualifications:- Master's degree in Linguistics, Computational Linguistics, or related preferred
- Statistics and Data Science Experience.
- Advanced level proficiency in SQL and Python.
Location: Remote [USA]
Salary Range: The salary for this position is between $83,200 - $137,280 annually. Factors which may affect pay within this range may include geography/market, skills, education, experience, and other qualifications of the successful candidate.
Benefits: The Company offers the following benefits for this position, subject to applicable eligibility requirements: [medical insurance] [dental insurance] [vision insurance] [401(k) retirement plan] [long-term disability insurance] [short-term disability insurance] [5 personal days accrued each calendar year. The Paid time off benefits meet the paid sick and safe time laws that pertains to the City/ State] [10-15 days of paid vacation time] [6 paid holidays and 1 floating holiday per calendar year] [Ascendion Learning Management System]
Want to change the world? Let us know.Tell us about your experiences, education, and ambitions. Bring your knowledge, unique viewpoint, and creativity to the table. Let's talk!
Preferred Skills Linguistics
- Python
- SQL
- Data Annotation
- Artificial Intelligence (AI) tools
- LLMs (Large Language Models)
Job details Job ID 333010
Role Linguistic Engineer
Location Redmond, Washington, US
Job type Direct Hire
Recruiter Chirag
Email
[email protected]