Evaluating a coding assistant
hardEvaluating a coding assistant
Anthropic LLM Interview Question
Design the evaluation harness for an AI coding assistant. What would you measure, and how?
Asked of
- AI Engineer
- ML Engineer
- Software Engineer
- Applied Scientist
Similar questions
Company
Anthropic
Difficulty
hard
Topic
LLM
Round
System design