KamoCRM

Size every TEI thread pool to the 1-CPU limit, and let probes outlast a batch

FixKlusterServices
관련 상품
2026년 9월 25일 오전 10:25 UTC
이름 *
Kamo
뚱 베어
5edb887

TEI 1.5's ONNX backend starts one inference thread per physical host core (24 on k1m1) and reads no thread setting, so under the pod's 1-CPU quota the CFS throttle froze the pool mid-batch: a batch of 8 went from 0.3 s to 5-11 s, /health (which waits for the batch in flight) outlasted kubelet's 1-s timeout, and liveness killed the model twice in one reindex. RAGService acks an event whose embed failed, so those KB and note updates were lost, and 106 Help Center articles never got vectors. - image cpu-1.5 -> cpu-1.9.4: from 1.6 the ONNX pool is sized from the cgroup CPU limit. Same model files; the vectors are bit-identical to 1.5's, so Qdrant's points stay valid. SP01's reranker runs the same tag. - --tokenization-workers 1, and OMP/MKL/RAYON_NUM_THREADS=1 (the image sets RAYON to 8), so every pool matches the limit even if TEI falls back to its candle backend. - liveness and readiness timeoutSeconds 1 -> 10. **************** (python3 -m unittest discover -s embedding-model/tests) pins the manifest, and with TEI_ROOTFS/TEI_MODEL_DIR runs the manifest's image, args and env under its CPU quota with five RAGService-shaped clients: cpu-1.5 ran 35 threads, 2.7 chunks/s and failed 102 of 121 probes; cpu-1.9.4 runs 6 threads, 8.1 chunks/s and fails none. KamoAI SP00 final review I-1.

모든 변경 사항

배송을 보는 것과 같이?

모든 것이 자신의 작업 공간에서 도착합니다. 무료 플랜을 시작하고 이 페이지를 다시 한 달에 읽으십시오.

무료 영원히 시작가격 비교