Model Hosting Container Standards
JSON →The `model-hosting-container-standards` is a Python toolkit designed to facilitate standardized model hosting container implementations, specifically with robust Amazon SageMaker integration. It provides utilities to enable efficient deployment and inference for models, including support for advanced frameworks like TensorRT-LLM and vLLM. Currently at version 0.1.14, the library is actively developed with frequent patch releases, indicating ongoing enhancements and maintenance.
Traffic · last 30 days stale · no recent hits
total hits 12
actors 2 distinct systems
last hit 17d ago AhrefsBot
top countries 🇺🇸 United States · 🇨🇦 Canada · BD · 🇫🇷 France · SA