Michael and Claude Opus 5.5
cf83f5f629
Bench : une mesure honnête à profondeur réelle, en tâche de fond
...
L'ancien bench ne lisait pas le statut HTTP, inventait un partage 15/85
du temps quand les timings manquaient (et l'enregistrait comme mesuré),
tuilait un petit corpus qu'un brouillon recopiait, et ne disait rien du
prefill à 30k ni du chemin où le cache est repris. Synchrone, il était
coupé par les proxys (60-100 s) pendant que le moteur continuait, et un
simple GET suffisait à le lancer.
- Tâche de fond : POST /api/bench (202, 405 sur GET, 409 si occupé),
/api/bench/status pour la progression, /api/bench/cancel ; chaque
requête au moteur porte le contexte annulable.
- Verrou de génération tenu pendant toute la mesure : chat, tâches et
compaction reçoivent un refus clair ; les clients /v1 un 503 avec
Retry-After ; /slots occupé (client externe, CLI) refuse aussi.
- Mode rapide par défaut : préchauffage jeté + la ligne courte, sur le
chat avec gabarit, raisonnement et échantillonnage du preset, seed fixe.
- Mode complet (bouton « bench complet », loki bench --full) : prefill à
froid à D = min(CTX/2, 32k, ce qui laisse tenir les tours), 16k si des
poids tournent sur CPU, puis 3 tours user → assistant → user de code
jamais vu. Reprise du cache lue dans cache_n, jamais supposée ; note
pour les hybrides (points de contrôle). Pas d'ignore_eos.
- Rien n'est enregistré sans réponses 200 et timings réels, ni pour un
résultat partiel (budget de 6 min par requête, contexte plein).
- Empreinte enregistrée (configuration + CUDA_VISIBLE_DEVICES + protocole) ;
les anciennes mesures retombent sur le nom du modèle. Types de cache KV
et build du moteur affichés, KV quantifié signalé (zone grise).
- Linux : indication « possible thrash » (read_bytes, VmRSS), jamais
enregistrée.
- Effacement du slot en fin de bench inchangé (engineSideJob, différé :
il tourne aussi sur erreur et annulation).
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-04 02:52:54 +02:00
..
2026-10-02 23:30:00 +02:00
2026-10-04 02:52:54 +02:00
2026-08-14 21:33:15 +00:00
2026-08-20 09:31:59 +00:00
2026-08-14 21:37:51 +00:00
2026-08-16 11:02:35 +00:00
2026-08-14 21:37:51 +00:00
2026-08-20 09:31:59 +00:00
2026-08-16 20:43:47 +00:00
2026-08-18 21:58:04 +02:00
2026-10-03 23:57:08 +02:00
2026-10-04 02:52:54 +02:00
2026-10-02 23:13:56 +02:00
2026-10-03 23:37:55 +02:00
2026-10-03 23:37:55 +02:00
2026-08-14 21:33:15 +00:00
2026-08-20 10:32:44 +00:00
2026-08-20 10:32:44 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-19 08:28:53 +02:00
2026-08-14 21:33:15 +00:00
2026-08-29 17:53:14 +02:00
2026-10-04 00:16:41 +02:00
2026-10-04 00:16:41 +02:00
2026-09-12 20:20:33 +00:00
2026-08-14 21:33:15 +00:00
2026-09-12 20:20:33 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-16 20:43:47 +00:00
2026-10-03 22:43:04 +02:00
2026-10-03 22:43:04 +02:00
2026-08-20 09:31:59 +00:00
2026-10-03 23:04:08 +02:00
2026-10-03 23:37:55 +02:00
2026-10-03 23:37:55 +02:00
2026-10-03 23:57:08 +02:00
2026-10-03 23:57:08 +02:00
2026-10-03 22:58:23 +02:00
2026-10-04 00:09:24 +02:00
2026-10-03 23:11:31 +02:00
2026-10-03 23:11:31 +02:00
2026-10-03 22:27:04 +02:00
2026-10-03 22:47:38 +02:00
2026-10-03 22:53:44 +02:00
2026-10-04 00:16:41 +02:00
2026-10-04 00:16:41 +02:00
2026-10-03 22:37:59 +02:00
2026-10-03 22:37:59 +02:00
2026-10-04 00:16:41 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:19:37 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 01:31:00 +02:00
2026-10-02 23:23:21 +02:00
2026-10-04 01:04:03 +02:00
2026-10-04 01:25:39 +02:00
2026-09-12 20:25:48 +00:00
2026-10-02 23:07:46 +02:00
2026-10-04 02:52:54 +02:00
2026-08-16 15:33:55 +00:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:04:30 +02:00
2026-10-02 23:04:30 +02:00
2026-08-30 15:47:10 +02:00
2026-10-04 01:16:48 +02:00
2026-10-02 23:11:40 +02:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:08:46 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:04:51 +02:00
2026-10-02 23:04:51 +02:00
2026-08-30 15:47:10 +02:00
2026-10-02 23:05:08 +02:00
2026-10-04 02:27:54 +02:00
2026-10-04 02:27:54 +02:00
2026-10-04 01:34:36 +02:00
2026-10-02 23:11:40 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:59:10 +00:00
2026-09-07 22:33:55 +02:00
2026-10-02 23:13:56 +02:00
2026-09-22 13:33:39 +00:00
2026-09-22 13:33:39 +00:00
2026-10-04 02:19:03 +02:00
2026-10-02 23:34:42 +02:00
2026-10-02 23:34:42 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 01:31:00 +02:00
2026-09-12 21:05:19 +00:00
2026-09-22 13:19:37 +00:00
2026-08-16 15:33:55 +00:00
2026-08-20 09:31:59 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:47:57 +00:00
2026-10-02 23:32:29 +02:00
2026-10-02 23:32:29 +02:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:30:00 +02:00
2026-10-02 23:38:07 +02:00
2026-10-02 23:36:51 +02:00
2026-10-02 23:36:51 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:40:38 +02:00
2026-10-02 23:31:33 +02:00
2026-10-04 01:48:49 +02:00
2026-08-18 21:58:57 +02:00
2026-09-22 14:08:01 +00:00
2026-10-04 00:29:17 +02:00
2026-10-02 23:36:01 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:30:00 +02:00
2026-10-02 23:30:00 +02:00
2026-10-04 02:19:03 +02:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-10-04 00:53:38 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:52:54 +02:00
2026-10-04 02:52:54 +02:00
2026-10-04 02:52:54 +02:00
2026-10-04 02:52:54 +02:00
2026-08-18 08:56:32 +00:00
2026-10-02 23:36:01 +02:00
2026-10-04 01:54:19 +02:00
2026-08-20 08:49:09 +00:00
2026-08-20 08:49:09 +00:00
2026-10-04 01:25:39 +02:00
2026-10-04 01:25:39 +02:00
2026-08-16 19:45:43 +00:00
2026-10-04 02:52:54 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:18:35 +02:00
2026-10-04 01:16:48 +02:00
2026-10-02 23:18:35 +02:00
2026-10-03 23:44:33 +02:00
2026-10-03 23:44:33 +02:00
2026-08-15 14:36:04 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:34:42 +02:00
2026-08-18 10:53:09 +00:00
2026-08-17 10:06:14 +02:00
2026-08-17 10:06:14 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 01:34:36 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 01:34:36 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:27:43 +02:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:05:08 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-10-04 02:19:03 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-09-07 22:33:55 +02:00
2026-08-14 21:37:51 +00:00
2026-10-04 01:31:00 +02:00
2026-08-20 09:31:59 +00:00
2026-10-04 00:34:57 +02:00
2026-10-04 02:52:54 +02:00
2026-09-07 22:34:33 +02:00
2026-10-02 23:05:08 +02:00
2026-09-22 13:37:16 +00:00
2026-10-04 01:48:49 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-03 23:37:55 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:52:54 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:19:03 +02:00
2026-10-04 02:19:03 +02:00
2026-10-04 01:54:19 +02:00
2026-08-16 18:15:24 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-18 21:58:04 +02:00
2026-08-19 08:28:53 +02:00
2026-08-19 08:28:53 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:52:54 +02:00
2026-10-04 02:52:54 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-09-22 13:33:39 +00:00
2026-10-04 02:19:03 +02:00
2026-08-18 21:58:57 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:19:03 +02:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-10-04 00:09:24 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:35:38 +02:00
2026-10-04 02:35:38 +02:00
2026-10-04 02:19:03 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:19:03 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:27:54 +02:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:25:04 +02:00
2026-10-02 23:25:04 +02:00
2026-10-04 01:31:00 +02:00
2026-08-20 09:31:59 +00:00
2026-09-22 13:33:39 +00:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:25:04 +02:00
2026-09-22 13:33:39 +00:00
2026-10-04 02:19:03 +02:00
2026-10-04 02:27:54 +02:00
2026-10-02 23:40:38 +02:00
2026-10-04 01:31:00 +02:00
2026-10-04 01:31:00 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 02:52:54 +02:00
2026-10-02 23:04:05 +02:00
2026-10-02 23:04:05 +02:00
2026-08-14 21:33:15 +00:00
2026-10-04 01:48:49 +02:00
2026-08-18 08:35:51 +00:00
2026-08-14 21:33:15 +00:00
2026-08-30 15:47:10 +02:00
2026-10-03 23:52:31 +02:00
2026-10-02 23:13:56 +02:00
2026-08-14 21:33:15 +00:00
2026-08-16 15:33:55 +00:00
2026-08-18 22:48:11 +02:00
2026-08-18 22:48:11 +02:00
2026-08-16 15:33:55 +00:00
2026-10-02 23:05:34 +02:00
2026-10-02 23:05:34 +02:00
2026-08-20 10:32:44 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-16 20:43:47 +00:00
2026-08-15 11:35:40 +00:00
2026-09-07 22:34:33 +02:00
2026-08-16 19:45:43 +00:00
2026-08-16 19:45:43 +00:00
2026-09-22 13:37:16 +00:00
2026-10-04 02:52:54 +02:00
2026-10-02 23:21:18 +02:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:33:39 +00:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-08-16 15:33:55 +00:00
2026-10-02 23:13:56 +02:00
2026-10-04 02:01:11 +02:00
2026-10-04 02:01:11 +02:00