Funnel Transformer Small

JSON →
funnel-transformer llm
text

A small variant of the Funnel Transformer model that compresses sequence length for efficient encoding.

open-weights
releasedJun 2020