Senior Director - AI Evaluation Platform

• Skills: TensorFlow, Machine Learning, Deep learning, Large Language Models, PyTorch
• Experiences: Senior
• Employments: Full-time
• Benefits: Family leave, Flexible Spending Account, 401(k)
• Locations: North America (Remote), Canada (Remote), United States (Remote)

Description:

• Lead the CoreAI team to build and scale ServiceNow's AI evaluation platform for quality assurance of AI capabilities.
• Define strategy and roadmap for evaluation methodologies, including benchmark design and automated scoring systems.
• Drive innovation in evaluation methodologies and design comprehensive verifier stacks for robust evaluation.
• Collaborate with cross-functional teams to translate business needs into evaluation requirements.

Requirements:

• Experience integrating AI into work processes and decision-making.
• Extensive experience managing high-performing AI or platform engineering teams focused on evaluation and quality assurance.
• Deep technical expertise in AI evaluation methodologies and statistical methods for assessing model quality.
• Proven track record of building production-level evaluation platforms at scale.
• Strong leadership skills with experience managing large teams of 50+ engineers and researchers.
• Excellent communication skills for effective collaboration with stakeholders.
• Hands-on experience with deep learning frameworks like PyTorch or TensorFlow.
• Ph.D. or Master's degree in Computer Science, Machine Learning, or related field is a plus.

Benefits:

• Competitive base pay of $279,100 - $488,400, plus equity and variable compensation.
• Comprehensive health plans, 401(k) Plan with company match, and flexible time away plan.