{"library":"qwen-omni-utils","title":"Qwen Omni Language Model Utilities","description":"Qwen Omni Language Model Utils is a Python library providing a toolkit to conveniently handle various types of audio and visual input for Qwen Omni multimodal models. It simplifies processing base64, URLs, and interleaved audio, images, and videos, offering an API-like experience. This library is current at version 0.0.9 and is actively maintained by the Qwen team as part of their multimodal large language model ecosystem.","language":"python","status":"active","last_verified":"Sun May 17","install":{"commands":["pip install qwen-omni-utils -U","pip install qwen-omni-utils[decord] -U\nsudo apt-get install ffmpeg"],"cli":null},"imports":["from qwen_omni_utils import process_mm_info"],"auth":{"required":false,"env_vars":[]},"quickstart":{"code":"import soundfile as sf\nimport torch\nfrom transformers import Qwen2_5OmniForConditionalGeneration, Qwen2_5OmniProcessor\nfrom qwen_omni_utils import process_mm_info\nimport os\n\n# NOTE: Replace with your actual model path or Hugging Face model ID\nmodel_id = \"Qwen/Qwen2.5-Omni-7B\"\n\n# Ensure you have a Hugging Face token if using private models\n# os.environ['HF_TOKEN'] = os.environ.get('HF_TOKEN', 'hf_YOUR_TOKEN_HERE') \n\n# Load model and processor (requires significant GPU memory)\n# model = Qwen2_5OmniForConditionalGeneration.from_pretrained(\n#     model_id, torch_dtype=\"auto\", device_map=\"auto\"\n# )\n# processor = Qwen2_5OmniProcessor.from_pretrained(model_id)\n\n# Example usage with process_mm_info (assuming model/processor loaded above)\n# This function prepares multimodal content for the processor.\n# content = [\n#     {\"type\": \"text\", \"text\": \"Describe this image:\"},\n#     {\"type\": \"image\", \"image\": \"https://example.com/image.jpg\"},\n#     {\"type\": \"text\", \"text\": \"And tell me about this audio:\"},\n#     {\"type\": \"audio\", \"audio\": \"https://example.com/audio.wav\"}\n# ]\n# processed_content = process_mm_info(content, processor)\n\nprint(\"qwen-omni-utils is successfully imported and ready to process multimodal inputs.\")\nprint(\"Refer to Qwen model documentation for full model loading and inference examples.\")","lang":"python","description":"This quickstart demonstrates how to import `process_mm_info` from `qwen_omni_utils`. While it shows how model and processor loading would typically be done, the actual heavy model loading and inference steps are commented out due to resource requirements. The `process_mm_info` function is key for preparing diverse multimodal inputs for the Qwen Omni models. Ensure you have `ffmpeg` installed for full video capabilities and a compatible `transformers` version.","tag":null,"tag_description":null,"last_tested":null,"results":[]},"compatibility":{"tag":null,"tag_description":null,"last_tested":"2026-05-17","installed_version":"0.0.9","pypi_latest":"0.0.9","is_stale":false,"summary":{"python_range":"3.10–3.9","success_rate":25,"avg_install_s":16.4,"avg_import_s":null,"wheel_type":"wheel"},"results":[{"runtime":"python:3.10-alpine","python_version":"3.10","os_libc":"alpine (musl)","variant":"qwen-omni-utils","exit_code":1,"wheel_type":null,"failure_reason":"build_error","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.10-alpine","python_version":"3.10","os_libc":"alpine (musl)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.10-slim","python_version":"3.10","os_libc":"slim (glibc)","variant":"qwen-omni-utils","exit_code":0,"wheel_type":"wheel","failure_reason":null,"import_side_effects":"broken","install_time_s":16.3,"import_time_s":null,"mem_mb":null,"disk_size":"601M"},{"runtime":"python:3.10-slim","python_version":"3.10","os_libc":"slim (glibc)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":16.6,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.11-alpine","python_version":"3.11","os_libc":"alpine (musl)","variant":"qwen-omni-utils","exit_code":1,"wheel_type":null,"failure_reason":"build_error","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.11-alpine","python_version":"3.11","os_libc":"alpine (musl)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.11-slim","python_version":"3.11","os_libc":"slim (glibc)","variant":"qwen-omni-utils","exit_code":0,"wheel_type":"wheel","failure_reason":null,"import_side_effects":"broken","install_time_s":15.5,"import_time_s":null,"mem_mb":null,"disk_size":"623M"},{"runtime":"python:3.11-slim","python_version":"3.11","os_libc":"slim (glibc)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":15.9,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.12-alpine","python_version":"3.12","os_libc":"alpine (musl)","variant":"qwen-omni-utils","exit_code":1,"wheel_type":null,"failure_reason":"build_error","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.12-alpine","python_version":"3.12","os_libc":"alpine (musl)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.12-slim","python_version":"3.12","os_libc":"slim (glibc)","variant":"qwen-omni-utils","exit_code":0,"wheel_type":"wheel","failure_reason":null,"import_side_effects":"broken","install_time_s":15.7,"import_time_s":null,"mem_mb":null,"disk_size":"605M"},{"runtime":"python:3.12-slim","python_version":"3.12","os_libc":"slim (glibc)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":16,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.13-alpine","python_version":"3.13","os_libc":"alpine (musl)","variant":"qwen-omni-utils","exit_code":1,"wheel_type":null,"failure_reason":"build_error","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.13-alpine","python_version":"3.13","os_libc":"alpine (musl)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"no_wheel","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.13-slim","python_version":"3.13","os_libc":"slim (glibc)","variant":"qwen-omni-utils","exit_code":0,"wheel_type":"wheel","failure_reason":null,"import_side_effects":"broken","install_time_s":16.2,"import_time_s":null,"mem_mb":null,"disk_size":"604M"},{"runtime":"python:3.13-slim","python_version":"3.13","os_libc":"slim (glibc)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":19,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.9-alpine","python_version":"3.9","os_libc":"alpine (musl)","variant":"qwen-omni-utils","exit_code":1,"wheel_type":null,"failure_reason":"build_error","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.9-alpine","python_version":"3.9","os_libc":"alpine (musl)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":null,"import_time_s":null,"mem_mb":null,"disk_size":null},{"runtime":"python:3.9-slim","python_version":"3.9","os_libc":"slim (glibc)","variant":"qwen-omni-utils","exit_code":0,"wheel_type":"wheel","failure_reason":null,"import_side_effects":"broken","install_time_s":18.1,"import_time_s":null,"mem_mb":null,"disk_size":"584M"},{"runtime":"python:3.9-slim","python_version":"3.9","os_libc":"slim (glibc)","variant":"decord","exit_code":1,"wheel_type":null,"failure_reason":"dependency_conflict","import_side_effects":null,"install_time_s":18.6,"import_time_s":null,"mem_mb":null,"disk_size":null}]}}