An Ollama model's context is the window the server serves, not the trained one

Expédié: 28 septembre 2026 à 10:06 UTC
Auteur: Kamo
Commite: 68050c5

OllamaDiscovery took model_info.*.context_length from /api/show: the window the model was TRAINED for. The registry listed granite4:tiny-h at 1 048 576 (and qwen3:4b at 262 144) while kamo-llm serves 16 384 (OLLAMA_CONTEXT_LENGTH, klusterservices), so the router never excluded a prompt past 16k and trimming aimed at a million tokens; Ollama cuts such a prompt. The window now comes from GET /api/ps, the loaded model's context_length. A model the server has not loaded is reported without a window, and a sync keeps the stored one. At 16 384 the automated LONG_CONTEXT claim goes away, so the row's 1 048 576 no longer mirrors back into max_context_length. SP99-T12.

Tous les changements

Comme ce que tu vois expédier ?

Tout cela arrive dans votre espace de travail par lui-même. Commencez sur le plan gratuit et relisez cette page dans un mois.

Commencez gratuitement pour toujours Prix de visualisation