Tag: compute-efficient LLMs

Dynamic Large Concept Models: Compressing Tokens into Adaptive Concepts

TL;DR Researchers propose Dynamic Large Concept Models (DLCM), a hierarchical language modeling approach that learns variable-length concepts from latent representations…