Model Serving

KServe is an open-source component for serving machine learning models on Kubernetes.

Model Service refers to the deployment of AI models for real-time inference and decision-making in applications.

Ray Serve is a scalable model serving library for machine learning models built on Ray.