Lower embedding batch size to 8 to match model backend limit

FixRAGService
Shipped
30 Machi 2026, 22:47 UTC
Author
Kamo
Commit
6a60a97

The TEI backend forces max_batch_requests=8 regardless of client config. Batches of 32 were still failing with connection errors.

All changes

Je, unaona nini kuhusu usafiri?

Kila moja ya hizi updates ardhi katika nafasi yako ya kazi moja kwa moja. Kuanza bure na kuangalia kukua wiki baada ya wiki.

Kuwa Huru MileleMtazamo wa bei