Reduce chunk size to fit all-MiniLM-L6-v2 token limit (256 max)

관련 상품

2026년 3월 18일 오전 2:54 UTC

이름 *

Kamo

뚱 베어

a794078

Chunk target was 2000 chars (~512 tokens) but the embedding model only accepts 256 tokens, causing 413 validation errors. Reduce to 800 chars (~200 tokens) with 100 char overlap.