Tag: Rust-library

How fast can text chunking get? Inside memchunk’s ultra-fast approach

TL;DR The team behind the chonkie chunking library built memchunk to test theoretical and practical limits of delimiter-based text chunking.…