{"id":8338,"library":"multi-model-server","title":"Multi Model Server (Deprecated)","description":"Multi Model Server (MMS) was an AWS Labs tool designed for serving neural network models for inference. This specific PyPI package and its underlying project have been deprecated and are no longer actively maintained. Users are strongly encouraged to migrate to TorchServe for ongoing support and new features. The last released version was 1.1.11.","status":"deprecated","version":"1.1.11","language":"en","source_language":"en","source_url":"https://github.com/awslabs/multi-model-server","tags":["ml","inference","deprecated","aws","torchserve","cli"],"install":[{"cmd":"pip install multi-model-server","lang":"bash","label":"Install Deprecated Multi Model Server"}],"dependencies":[],"imports":[{"note":"The `multi-model-server` package primarily provides a command-line interface (CLI) for starting the server, rather than a Python programmatic API for direct imports. No common Python library symbols are exposed for direct import and usage.","symbol":"Multi Model Server CLI","correct":"multi-model-server --start"}],"quickstart":{"code":"# 1. Install the deprecated server\npip install multi-model-server\n\n# 2. (Optional, but highly recommended for actual serving) Create a model archive.\n#    Note: torch-model-archiver is now part of TorchServe installation. \n#    If you need to archive models for this deprecated MMS, you might need\n#    an older, compatible version of torch-model-archiver or manually bundle.\n#    Example using (potentially incompatible) current torch-model-archiver syntax:\n#    torch-model-archiver --model-name mymodel --version 1.0 --model-file model.py --handler handler.py\n\n# 3. Start the Multi Model Server\nmulti-model-server --start","lang":"bash","description":"This quickstart demonstrates how to install and start the deprecated Multi Model Server using its command-line interface. Note that for actual model serving, you would typically archive models first. Given the project's deprecated status, this is provided for historical context or existing deployments only."},"warnings":[{"fix":"Migrate your model serving infrastructure to TorchServe (https://pytorch.org/serve/) for continued support, security updates, and new features.","message":"The `multi-model-server` project is officially deprecated and is no longer actively maintained. All active development has shifted to TorchServe.","severity":"breaking","affected_versions":"All versions, especially 1.x and earlier."},{"fix":"Immediately plan and execute migration to TorchServe to ensure your serving environment is secure and supported.","message":"This package will not receive security updates or bug fixes. Continuing to use it in production environments poses significant security risks due to unpatched vulnerabilities.","severity":"gotcha","affected_versions":"All versions, especially 1.x and earlier."},{"fix":"Interact with the server via its command-line interface or HTTP API. If you require programmatic Python control over a model server, TorchServe provides more appropriate client libraries and APIs.","message":"The `multi-model-server` PyPI package primarily provides a command-line interface (CLI) tool. It does not offer a standard Python library API for programmatic `import` and direct interaction.","severity":"gotcha","affected_versions":"All versions."}],"env_vars":null,"last_verified":"2026-04-16T00:00:00.000Z","next_check":"2026-07-15T00:00:00.000Z","problems":[{"fix":"The `multi-model-server` package is primarily a CLI tool. After installation, use `multi-model-server --start` from your terminal. If you need a programmatic Python API for model serving, consider TorchServe's client libraries or APIs.","cause":"Attempting to `import multi_model_server` as a typical Python library, which is not its primary design or use case.","error":"ModuleNotFoundError: No module named 'multi_model_server'"},{"fix":"The only long-term solution is to migrate your model serving workloads from `multi-model-server` to TorchServe, which is the actively developed successor and offers continued feature enhancements.","cause":"The `multi-model-server` project is deprecated and does not receive new features, bug fixes, or compatibility updates.","error":"Using multi-model-server, but need a feature available in TorchServe (e.g., advanced metrics, specific model formats, newer runtime environment)."},{"fix":"Upgrade to `multi-model-server` version `1.1.8` or newer if you absolutely must use this deprecated package. However, the definitive and recommended fix is to migrate to TorchServe, which actively maintains up-to-date dependencies and addresses security concerns.","cause":"Older versions of `multi-model-server` bundled vulnerable versions of the Log4j library. While some patches were released for this specific package, the overall project is deprecated, meaning future vulnerabilities might not be addressed.","error":"CVE-2021-44228: Apache Log4j2 JNDI Remote Code Execution vulnerability"}]}