LiteLLM Enterprise

0.1.37 · active · verified Sat Apr 11

LiteLLM Enterprise is a Python package designed to provide enterprise-grade features and functionality on top of the core LiteLLM library. It currently wraps and re-exports much of the base LiteLLM functionality. The package is at version 0.1.37 and appears to be in an early development stage, with its release cadence likely tied to the rapidly evolving LiteLLM ecosystem.

Warnings

gotcha The `litellm-enterprise` package's `__init__.py` re-exports all symbols directly from the core `litellm` library. This means that `from litellm_enterprise import X` is functionally identical to `from litellm import X` for most symbols. This can lead to confusion regarding the package's distinct functionality.
Fix: Be aware that most functionality currently mirrors `litellm`. While using `litellm_enterprise` imports is good practice for explicit intent, refer to `litellm` documentation for specific function behaviors.
gotcha Dedicated documentation for features unique to `litellm-enterprise` is currently scarce. Users will primarily need to refer to the comprehensive documentation of the main `litellm` library for usage patterns and API details.
Fix: Consult the main LiteLLM GitHub repository and documentation for details on core functionality. Look for discussions or examples related to 'enterprise' features within the broader LiteLLM ecosystem.
gotcha The version number of `litellm-enterprise` (0.1.x) is significantly lower than the `1.x.x` versions of the main `litellm` library. This disparity might indicate an early-stage project, potential API instability, or a different release cadence, which could impact expectations for production readiness.
Fix: Exercise caution when relying on `litellm-enterprise` for critical production systems, and monitor its development closely. Test thoroughly for compatibility with specific `litellm` versions.
gotcha While named 'enterprise', specific enterprise features like Role-Based Access Control (RBAC), advanced logging, or custom integrations often manifest through the LiteLLM Proxy or specific server configurations, rather than being solely exposed or enabled by this Python package directly. The package primarily facilitates accessing the underlying LiteLLM functionality.
Fix: Investigate LiteLLM Proxy documentation and deployment options if looking for comprehensive enterprise-level management and features. This package may serve as a client-side component.

Install

pip install litellm-enterprise Install latest version

Imports

completion
```
from litellm_enterprise import completion
```
The `litellm-enterprise` package's `__init__.py` re-exports all symbols from `litellm`. While `from litellm import completion` will work, importing directly from `litellm_enterprise` is recommended when explicitly using the enterprise package, to maintain clarity and prepare for any future distinct implementations.
Router
```
from litellm_enterprise import Router
```
Similar to `completion`, `Router` is re-exported from the base `litellm` library. Use `from litellm_enterprise import Router` to signify intent to leverage enterprise-related configurations or future enhancements.

Quickstart

This quickstart demonstrates a basic LLM completion call using the `litellm_enterprise` package. Ensure `OPENAI_API_KEY` is set in your environment. The functionality mirrors that of the core `litellm` package due to its re-export mechanism.

import os
from litellm_enterprise import completion

os.environ['OPENAI_API_KEY'] = os.environ.get('OPENAI_API_KEY', 'sk-your-openai-key')

try:
    response = completion(
        model="gpt-3.5-turbo",
        messages=[{"role": "user", "content": "What is LiteLLM?"}]
    )
    print(response.choices[0].message.content)
except Exception as e:
    print(f"An error occurred: {e}")

view raw JSON →