Senior Product Manager - AI Quality

About the role:

Over the past several years, our company has experienced substantial growth and secured significant funding from prominent investors to support our expansion.

As we continue to evolve, we are looking to add an experienced Senior Product Manager to lead our Core AI Quality initiatives. This team plays a critical role at you.com: from determining our LLM strategy, to evaluating the quality of our AI with real user queries, industry benchmarks and more. This role is fundamental to improving you.com’s performance, and maintaining the highest standards of quality in the real world to drive continued business success. The ideal candidate will possess deep technical and analytical expertise and a proven track record in driving AI/ML teams to achieve success in scaled applications.

This is a hybrid role that requires in-office work at either of our San Francisco or New York co-working hubs.

Responsibilities: 

• Define and drive the vision, strategy, and roadmap for our AI quality initiatives: from evals, to LLMs, and more – ensuring alignment with company goals and market needs.
• Lead the end-to-end product development lifecycle from ideation, design, development, and launch, ensuring timely and high-quality delivery.
• Conduct internal benchmarks, industry benchmarks, and customer research to identify needs, deficiencies, market trends, and competitive landscape to inform the AI Quality product strategy.
• Work closely with engineering, sales, marketing, and customer success teams to ensure seamless product development and execution.
• Utilize your technical background to make informed decisions about product architecture, technology stacks, and integration strategies.
• Define and track key performance indicators (KPIs) to measure product success and drive continuous improvement.

Qualifications: 

• Experience: 5+ years of experience in product management, with a focus on AI/ML evaluation. Startup Experience: Proven track record of driving success as a PM in a startup environment.
• Technical Expertise: Strong background in data science, machine learning, or artificial intelligence, with a solid understanding of LLMs and their integration into products.
• Leadership: Demonstrated experience in leading product teams as an IC, with a strong ability to influence and inspire cross-functional teams. 
• Analytical Skills: Exceptional analytical and problem-solving skills, with the ability to make data-driven decisions and evaluate AI model performance.
• Communication: Excellent communication and presentation skills, with the ability to articulate complex technical ideas clearly and persuasively to a variety of audiences.
• Self-starter: Highly motivated, high energy, with a proactive attitude to continue to build a solid foundation for this team.
• Collaborative: Team player who thrives in a fast-paced, dynamic environment.
• Education: Equivalent experience or relevant coursework to a bachelor’s degree in Computer Science, Engineering, Data Science, or a related field. An advanced degree is a plus.