AI/ML Engineer - job 1 of 6

Job Summary

A company is looking for an AI/ML Engineer to take ownership of evaluation and quality across AI systems.

Key Responsibilities

• Design and build end-to-end evaluation infrastructure for AI systems
• Define and implement application-specific quality metrics beyond accuracy
• Collaborate with product and clinical leads to translate subjective requirements into structured evaluation criteria

Required Qualifications

• Experience building or owning evaluation infrastructure for LLMs or generative AI products
• Proficiency in designing QA workflows and human-in-the-loop systems
• Ability to create testable quality metrics from product goals
• Strong coding skills and experience shipping experiments
• Familiarity with working in cross-functional teams to define quality in real-world AI applications