Tag: zero-copy-FFI

How fast can text chunking get? Inside memchunk’s ultra-fast approach

TL;DR The team behind the chonkie chunking library built memchunk to test theoretical and practical limits of delimiter-based text chunking.…