A chunking lib in Rust that is ~20x faster [P]

Excerpt

Hey, I wanted a faster chunking library for my system without affecting the overall accuracy. Did not find many options. So I've build https://github.com/d1pankarmedhi/chunkr It has most of the chunking strategies like Character, Recursive, Markdown header, Late chunking, Hierarchical chunking, etc. It also supports native PDF loader, and other additional file types. Some stats (MBA M4 16GB): Test Case (matched parameters) Chunkr LangChain LlamaIndex Chonkie semchunk text-splitter Recursive (1 M