{"library":"transformer-engine","type":"library","category":null,"description":"Transformer Engine (TE) is a library developed by NVIDIA for accelerating Transformer models on NVIDIA GPUs. It enables the use of 8-bit floating point (FP8) and 4-bit floating point (NVFP4) precision on architectures like Hopper, Ada, and Blackwell, significantly improving performance and reducing memory utilization during both training and inference. TE provides highly optimized building blocks for common Transformer architectures and an automatic mixed-precision-like API that integrates seamlessly with PyTorch and JAX. The library has frequent releases, often aligned with updates to NVIDIA's deep learning software stack.","language":"python","status":"active","version":"2.13.0","tags":["pytorch","jax","gpu","transformer","deep-learning","fp8","mixed-precision","nvidia","acceleration"],"last_verified":"Mon May 25","install":[{"cmd":"pip install transformer-engine","imports":["import transformer_engine.pytorch as te\nlinear_layer = te.Linear(in_features, out_features)","import transformer_engine.pytorch as te\nlayer_norm = te.LayerNorm(normalized_shape)","from transformer_engine.pytorch import fp8_autocast\nwith fp8_autocast():\n    output = model(input)","import transformer_engine.pytorch as te\ntransformer_block = te.TransformerLayer(...) "]}],"homepage":null,"github":null,"docs":null,"changelog":null,"pypi":"https://pypi.org/project/transformer-engine/","npm":null,"openapi_spec":null,"status_page":null,"smithery":null,"compatibility":{"summary":{"python_range":"3.10–3.9","success_rate":100,"avg_install_s":5.5,"avg_import_s":null,"wheel_type":"wheel"},"url":"https://checklist.day/v1/registry/transformer-engine/compatibility"}}