URL Normalize

2.2.1 · active · verified Thu Apr 09

URL Normalize is a Python library (current version 2.2.1) designed for standardizing and normalizing URLs, including support for internationalized domain names (IDN). It handles various aspects like scheme and host lowercasing, percent-encoding, path segment collapsing, and configurable default schemes and query parameter filtering. It is actively maintained with regular releases.

Warnings

breaking The default scheme for URLs without one has changed from 'http' to 'https'.
Fix: If your application relies on 'http' as the default, explicitly set `default_scheme='http'` when calling `url_normalize`.
breaking The minimum required Python version has been updated to 3.8.
Fix: Upgrade your Python environment to 3.8 or newer. For older Python versions, use `url-normalize` versions prior to 2.0.0.
breaking IDNA handling has been migrated to use IDNA 2008 with UTS46 processing, requiring the `idna` package.
Fix: Ensure the `idna` package is installed (`pip install idna`). Review IDN-specific normalization behavior as it might differ slightly from previous versions.
breaking The `sort_query_params` option has been removed as it was deemed incorrect in its previous implementation.
Fix: Remove the `sort_query_params` argument from your `url_normalize` calls. Query parameters are now sorted by default. If specific custom sorting is needed, it must be applied manually before normalization.

Install

pip install url-normalize Install with pip

Imports

url_normalize
```
from url_normalize import url_normalize
```
The primary normalization function `url_normalize` is typically imported directly from the package, not accessed as an attribute of the top-level `url_normalize` package.

Quickstart

Demonstrates basic URL normalization and how to normalize a path by providing a default domain and scheme.

from url_normalize import url_normalize

# Basic normalization
normalized_url = url_normalize("HTTP://www.Example.com:80/a/../b?c=2&c=1")
print(f"Normalized URL: {normalized_url}")
# Expected: https://www.example.com/b?c=1&c=2

# Normalizing a path with a default domain and scheme
normalized_path = url_normalize("/foo/bar", default_domain="example.com", default_scheme="http")
print(f"Normalized path with domain: {normalized_path}")
# Expected: http://example.com/foo/bar

view raw JSON →