KamoCRM

Size every TEI thread pool to the 1-CPU limit, and let probes outlast a batch

FixKlusterServices
已装运
2026年9月25日 10:25 UTC
作者
Kamo
提交
5edb887

TEI 1.5's ONNX backend starts one inference thread per physical host core (24 on k1m1) and reads no thread setting, so under the pod's 1-CPU quota the CFS throttle froze the pool mid-batch: a batch of 8 went from 0.3 s to 5-11 s, /health (which waits for the batch in flight) outlasted kubelet's 1-s timeout, and liveness killed the model twice in one reindex. RAGService acks an event whose embed failed, so those KB and note updates were lost, and 106 Help Center articles never got vectors. - image cpu-1.5 -> cpu-1.9.4: from 1.6 the ONNX pool is sized from the cgroup CPU limit. Same model files; the vectors are bit-identical to 1.5's, so Qdrant's points stay valid. SP01's reranker runs the same tag. - --tokenization-workers 1, and OMP/MKL/RAYON_NUM_THREADS=1 (the image sets RAYON to 8), so every pool matches the limit even if TEI falls back to its candle backend. - liveness and readiness timeoutSeconds 1 -> 10. **************** (python3 -m unittest discover -s embedding-model/tests) pins the manifest, and with TEI_ROOTFS/TEI_MODEL_DIR runs the manifest's image, args and env under its CPU quota with five RAGService-shaped clients: cpu-1.5 ran 35 threads, 2.7 chunks/s and failed 102 of 121 probes; cpu-1.9.4 runs 6 threads, 8.1 chunks/s and fails none. KamoAI SP00 final review I-1.

所有更改

就像你看到的运输?

所有东西都是靠自己运入你的工作空间的 从免费计划开始,一个月后再读这页.

永远开始自由查看定价