Low latency model serving

Low latency model serving

Pinterest ML System Design Interview Question

A ranking model has to return a score in under 100 milliseconds at peak traffic. How would you build the path that serves it?

Asked of

  • ML Engineer
  • Software Engineer
  • AI Engineer
  • Applied Scientist

Similar questions