Lower embedding batch size to 8 to match model backend limit

FixRAGService
Shipped
March 30, 2026 at 10:47 PM UTC
Author
Kamo
Commit
6a60a97

The TEI backend forces max_batch_requests=8 regardless of client config. Batches of 32 were still failing with connection errors.

All changes

Like what you see shipping?

Every one of these updates lands in your workspace automatically. Start free and watch it grow week after week.

Start Free ForeverView Pricing