Job Description

Position: Project Manager III
Location: Austin, Texas
Duration: Contract
Job ID: 169965
Job Description:

Job Description:

• The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) Models.
• This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights.
• Running evaluations that assess MT and QE performance and risk, connecting linguistic quality frameworks with data analysis.
• This role requires strong data science, analytical, organizational, and communication skills.

Qualifications:

• Demonstrable experience in NLP/ML Evaluations, or Localization Analytics.
• Knowledge of evaluation design and statistical analysis, including determining statistically significant sample sizes.
• Experience with benchmarking against human judgments, and applying MT & QE evaluation metrics.
• Skilled in analyzing evaluation results, ensuring findings are reliable and actionable.
• Proficiency with data analysis and visualization tools (e.g. Python, Tableau).
• Highly organized, analytical, detail-oriented, and methodical.
• Strong communication skills — able to communicate effectively with both technical and business audiences.
• Ability to explain technical results in a clear and understandable manner.
• Strong eye for patterns, anomalies, and trends across large datasets.

Schedule Notes:

• Hybrid schedule - 3 days onsite
• Open to ATX, San Diego, and Cupertino

Pay Range: $65 - $69/hr on W2
The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by appliable state or localities where you reside or work.

#LI-AS1

Job Tags

Full time, Contract work,

Similar Jobs