Lower embedding batch size to 8 to match model backend limit

出荷済み

2026年3月30日 22:47 UTC

プロフィール

Kamo

コンテンツ

6a60a97

The TEI backend forces max_batch_requests=8 regardless of client config. Batches of 32 were still failing with connection errors.