Michael and Claude Opus 5.5
f7f1a30d08
Moteur : files de lancement CUDA élargies (4x) sur deux GPU quand le pipeline entre cartes est possible
...
Sur plusieurs cartes, llama.cpp fait travailler les GPU en pipeline quand le
modèle y tient en entier ; encore faut-il que le CPU empile assez de
lancements CUDA d'avance. CUDA_SCALE_LAUNCH_QUEUES=4x agrandit cette file du
pilote : mêmes noyaux, même ordre, sortie identique — seul le prompt peut
gagner (+10-25 % en amont sur un 70B, non mesuré ici), le décodage ne bouge pas.
llama.cpp l'a retiré de ses défauts après des blocages sur Jetson : Loki ne le
pose donc que là où le pipeline peut réellement exister.
- launchQueuesEnv (pure) : 4x seulement si ≥ 2 GPU CUDA servis (--device,
sinon CUDA_VISIBLE_DEVICES, sinon nvidia-smi borné à 3 s) et aucun bloqueur :
-ot, --cpu-moe, --n-cpu-moe ≠ 0, -nkvo, -sm autre que layer, NGL chiffré
hors 999 — drapeaux d'EXTRA_ARGS ou LLAMA_ARG_* équivalents
- une variable déjà dans l'environnement n'est jamais touchée ;
CUDA_LAUNCH_QUEUES=off la coupe, 0.25x/0.5x/2x/4x l'imposent, toute autre
valeur est ignorée en le disant
- la valeur posée s'affiche sur la ligne « [loki serve] » ; la ligne de
commande ne change pas, BATCH/UBATCH non plus
- CUDA_LAUNCH_QUEUES survit aux bascules de preset (réglage machine qu'un
preset peut imposer)
- éditeur : « Experts MoE sur CPU » rappelle que ça coupe le pipeline sur 2 GPU
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com >
2026-10-03 22:43:04 +02:00
..
2026-10-02 23:30:00 +02:00
2026-10-03 22:43:04 +02:00
2026-08-14 21:33:15 +00:00
2026-08-20 09:31:59 +00:00
2026-08-14 21:37:51 +00:00
2026-08-16 11:02:35 +00:00
2026-08-14 21:37:51 +00:00
2026-08-20 09:31:59 +00:00
2026-08-16 20:43:47 +00:00
2026-08-18 21:58:04 +02:00
2026-08-16 20:43:47 +00:00
2026-10-02 23:13:56 +02:00
2026-10-02 23:13:56 +02:00
2026-08-14 21:33:15 +00:00
2026-08-20 10:32:44 +00:00
2026-08-20 10:32:44 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-19 08:28:53 +02:00
2026-08-14 21:33:15 +00:00
2026-08-29 17:53:14 +02:00
2026-09-12 20:20:33 +00:00
2026-09-12 20:20:33 +00:00
2026-09-12 20:20:33 +00:00
2026-08-14 21:33:15 +00:00
2026-09-12 20:20:33 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-16 20:43:47 +00:00
2026-10-03 22:43:04 +02:00
2026-10-03 22:43:04 +02:00
2026-08-20 09:31:59 +00:00
2026-10-03 22:37:59 +02:00
2026-10-03 22:27:04 +02:00
2026-10-03 22:43:04 +02:00
2026-10-03 22:43:04 +02:00
2026-10-03 22:37:59 +02:00
2026-10-03 22:37:59 +02:00
2026-10-03 22:43:04 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:19:37 +00:00
2026-08-14 21:33:15 +00:00
2026-08-15 11:54:52 +00:00
2026-10-02 23:23:21 +02:00
2026-10-02 23:38:07 +02:00
2026-10-02 23:38:07 +02:00
2026-09-12 20:25:48 +00:00
2026-10-02 23:07:46 +02:00
2026-10-02 23:36:51 +02:00
2026-08-16 15:33:55 +00:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:04:30 +02:00
2026-10-02 23:04:30 +02:00
2026-08-30 15:47:10 +02:00
2026-08-30 15:47:10 +02:00
2026-10-02 23:11:40 +02:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:08:46 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:04:51 +02:00
2026-10-02 23:04:51 +02:00
2026-08-30 15:47:10 +02:00
2026-10-02 23:05:08 +02:00
2026-09-22 13:33:39 +00:00
2026-10-02 23:11:40 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:59:10 +00:00
2026-09-07 22:33:55 +02:00
2026-10-02 23:13:56 +02:00
2026-09-22 13:33:39 +00:00
2026-09-22 13:33:39 +00:00
2026-10-02 23:08:46 +02:00
2026-10-02 23:34:42 +02:00
2026-10-02 23:34:42 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:34:42 +02:00
2026-09-12 21:05:19 +00:00
2026-09-22 13:19:37 +00:00
2026-08-16 15:33:55 +00:00
2026-08-20 09:31:59 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:47:57 +00:00
2026-10-02 23:32:29 +02:00
2026-10-02 23:32:29 +02:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:30:00 +02:00
2026-10-02 23:38:07 +02:00
2026-10-02 23:36:51 +02:00
2026-10-02 23:36:51 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:40:38 +02:00
2026-10-02 23:31:33 +02:00
2026-10-02 23:31:33 +02:00
2026-08-18 21:58:57 +02:00
2026-09-22 14:08:01 +00:00
2026-10-02 23:36:01 +02:00
2026-10-02 23:36:01 +02:00
2026-08-20 09:31:59 +00:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:30:00 +02:00
2026-10-02 23:30:00 +02:00
2026-10-02 23:36:51 +02:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:04:51 +02:00
2026-10-02 23:13:56 +02:00
2026-08-18 08:56:32 +00:00
2026-10-02 23:36:01 +02:00
2026-10-02 23:40:38 +02:00
2026-08-20 08:49:09 +00:00
2026-08-20 08:49:09 +00:00
2026-08-16 19:45:43 +00:00
2026-08-16 19:45:43 +00:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:18:35 +02:00
2026-09-12 21:05:19 +00:00
2026-10-02 23:18:35 +02:00
2026-08-15 14:36:04 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-18 21:58:57 +02:00
2026-10-02 23:34:42 +02:00
2026-08-18 10:53:09 +00:00
2026-08-17 10:06:14 +02:00
2026-08-17 10:06:14 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:08:46 +02:00
2026-08-14 21:33:15 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:27:43 +02:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:05:08 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-10-02 23:27:43 +02:00
2026-09-22 13:59:10 +00:00
2026-09-22 13:59:10 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-09-07 22:33:55 +02:00
2026-08-14 21:37:51 +00:00
2026-10-02 23:04:51 +02:00
2026-08-20 09:31:59 +00:00
2026-09-07 22:34:33 +02:00
2026-10-02 23:05:08 +02:00
2026-09-22 13:37:16 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-16 19:45:43 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:41:37 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-09-07 22:34:33 +02:00
2026-08-16 18:15:24 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-18 21:58:04 +02:00
2026-08-19 08:28:53 +02:00
2026-08-19 08:28:53 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-20 22:13:16 +02:00
2026-08-18 23:19:21 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-09-22 13:33:39 +00:00
2026-08-18 21:58:57 +02:00
2026-08-18 21:58:57 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-08-14 21:37:51 +00:00
2026-10-03 22:32:14 +02:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-15 11:07:45 +00:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:25:04 +02:00
2026-10-02 23:25:04 +02:00
2026-10-02 23:25:04 +02:00
2026-08-20 09:31:59 +00:00
2026-09-22 13:33:39 +00:00
2026-08-20 09:31:59 +00:00
2026-10-02 23:25:04 +02:00
2026-09-22 13:33:39 +00:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:10:56 +02:00
2026-10-02 23:40:38 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:59:10 +00:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:27:43 +02:00
2026-10-02 23:04:05 +02:00
2026-10-02 23:04:05 +02:00
2026-08-14 21:33:15 +00:00
2026-10-02 23:25:04 +02:00
2026-08-18 08:35:51 +00:00
2026-08-14 21:33:15 +00:00
2026-08-30 15:47:10 +02:00
2026-08-16 20:43:47 +00:00
2026-10-02 23:13:56 +02:00
2026-08-14 21:33:15 +00:00
2026-08-16 15:33:55 +00:00
2026-08-18 22:48:11 +02:00
2026-08-18 22:48:11 +02:00
2026-08-16 15:33:55 +00:00
2026-10-02 23:05:34 +02:00
2026-10-02 23:05:34 +02:00
2026-08-20 10:32:44 +00:00
2026-08-14 21:33:15 +00:00
2026-08-14 21:33:15 +00:00
2026-08-16 20:43:47 +00:00
2026-08-15 11:35:40 +00:00
2026-09-07 22:34:33 +02:00
2026-08-16 19:45:43 +00:00
2026-08-16 19:45:43 +00:00
2026-09-22 13:37:16 +00:00
2026-10-02 23:08:46 +02:00
2026-10-02 23:21:18 +02:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:33 +02:00
2026-09-22 13:33:39 +00:00
2026-09-07 22:34:33 +02:00
2026-09-07 22:34:57 +02:00
2026-09-07 22:34:57 +02:00
2026-09-22 13:19:37 +00:00
2026-09-22 13:19:37 +00:00
2026-08-16 15:33:55 +00:00
2026-10-02 23:13:56 +02:00
2026-08-29 17:53:14 +02:00
2026-09-07 22:34:57 +02:00