Versions
Description
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens (for use with large language models)
Repository
https://github.com/benbrandt/text-splitter.git
Project Slug
semantic-text-splitter
Last Built
5 hours, 26 minutes ago passed
Maintainers
Home Page
https://github.com/benbrandt/text-splitter
Badge
Tags
ai, nlp, split, text, tokenizer
Short URLs
semantic-text-splitter.readthedocs.io
semantic-text-splitter.rtfd.io
Default Version
python-v0.3.1
'latest' Version
main
