BentoML — Developer tools for optimizing and serving AI model inference.
Model packaging, inference and serving.
- Recorded website languages
- English
Official sources: github.com
Related links
Ray™
Tools for distributed AI training, inference and workload scaling.
OpenVINO
Developer tools for optimizing and serving AI model inference.
ONNX™
Model formats, interoperability and tools for loading model data.
MindSpore
Machine-learning framework, developer documentation and model training tools.
PaddlePaddle
Machine-learning framework, developer documentation and model training tools.
ModelScope
Developer tools for discovering models and building AI applications.
OpenCompass
Tools and benchmarks for evaluating AI models.
vLLM™
Developer tools for optimizing and serving AI model inference.