KamoCRM

Reduce chunk size to fit all-MiniLM-L6-v2 token limit (256 max)

FixRAGService
Shipped
18 மார்ச், 2026 அன்று 2:54 AM UTC
Author
Kamo
Commit
a794078

Chunk target was 2000 chars (~512 tokens) but the embedding model only accepts 256 tokens, causing 413 validation errors. Reduce to 800 chars (~200 tokens) with 100 char overlap.

All changes

Like what you see shipping?

All of it arrives in your workspace on its own. Start on the free plan and read this page again in a month.

Start Free ForeverView Pricing