KFServing
Using KFServing for serving models
Serving
Serving of ML models in Kubeflow
Istio Integration (for TF Serving)
Using Istio for TF Serving
Seldon Serving
Model serving using Seldon
NVIDIA TensorRT Inference Server
Model serving using TRT Inference Server
TensorFlow Serving
Serving TensorFlow models
TensorFlow Batch Predict
Batch prediction for TensorFlow models
PyTorch Serving
Instructions for serving a PyTorch model with Seldon
Feedback
Was this page helpful?
Glad to hear it! Please tell us how we can improve.
Sorry to hear that. Please tell us how we can improve.
Last modified 13.07.2019: Improve organization of Kubeflow components (#920) (e1105bae)