A native CLI + shared library that answers two questions fast: "how many tokens is this file?" and "where do I cut it at ≤N tokens without slicing a function in half?"
- single-purpose token-aware chunker for LLM agent tools
- drop-in replacement for calling tiktoken in a subprocess loop
- emits byte offsets
[start, end)+ token counts + boundary kind