KamoCRM

An in-cluster model gets the time to read its prompt, inside the walk's budget

FixAIService
Spegnimento
28 settembre 2026 alle ore 10:06 UTC
Autore
Kamo
Impegno
a1d2743

kamo-llm reads a prompt at about 110 tokens a second on k3m1 before it writes a word, so an E2 prompt past ~6k tokens spent E2's whole 60 s per-attempt bound (and a stream its 60 s first-event bound) before the answer began, and the walk moved on. An attempt on an IN_CLUSTER model now also gets the prompt's reading time at **************** (50: half the measured rate, for the chars/4 estimate on JSON tool schemas and a short queue). No attempt runs past the walk's own budget, maxAttempts x the per-attempt bound, so the callers' rule (master section 11 'facade timeouts', SP04-F2: E10 3 x 120 s + 30 s) still holds; the ParameterFallback retry, which used to get a fresh full bound, is held to it too. SP99-T12.

Tutte le modifiche

Come quello che vedi la spedizione?

Tutto questo arriva nel vostro spazio di lavoro da solo. Iniziare sul piano gratuito e leggere di nuovo questa pagina in un mese.

Inizia gratis per sempreVisualizza il prezzo