SageMaker Hugging Face Inference Toolkit
JSON →Open source library for serving Hugging Face models on Amazon SageMaker. It wraps the Hugging Face Transformers pipeline and provides built-in handlers for inference. Latest version 2.6.0 supports PyTorch 2.0+ and TensorFlow 2.x. Released quarterly.