Skip to content
Merged
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
8052e68
[AMD] server_atom: improve config print and cleanup
seungrokj Jun 19, 2026
84b978f
update perf-changelog for dsv4-fp4-mi355x-atom-disagg-mtp
seungrokj Jun 19, 2026
5ce4151
[AMD] fix DECODE_MTP_SIZE and BENCH_REQUEST_RATE propagation in atom-…
seungrokj Jun 19, 2026
1b64366
[AMD] server_atom: pass SPEC_ARGS to prefill server
seungrokj Jun 19, 2026
5988840
[AMD] amd-master: fix comment for 1P1D TP8+DPA+TBO+MTP1 config
seungrokj Jun 19, 2026
2cf2a05
[AMD] dsv4_atom-disagg: remove DECODE_MTP_SIZE from check_env_vars
seungrokj Jun 19, 2026
60d4d0f
[AMD] bench: use --dsv4 flag for DeepSeek-V4-Pro MTP benchmarks
seungrokj Jun 19, 2026
58b0908
[AMD] server_atom: export IS_MTP=true when SPEC_DECODING=mtp for benc…
seungrokj Jun 19, 2026
38cd2a8
[AMD] server_atom: fix hf-overrides JSON quoting
seungrokj Jun 19, 2026
67d19a7
fix: inline --hf-overrides to avoid eval word-splitting, remove OPT_ARGS
seungrokj Jun 19, 2026
e81a996
refactor: extract --hf-overrides into HF_OVERRIDES_ARG variable
seungrokj Jun 19, 2026
929f89f
fix: enable --hf-overrides only for DeepSeek-V4-Pro
seungrokj Jun 19, 2026
7c779fd
fix: add HF_OVERRIDES_ARG to INFO config print block
seungrokj Jun 19, 2026
279171b
fix: replace broken-quote array splice with ${ARRAY[*]} in CMD strings
seungrokj Jun 19, 2026
dce66c8
fix: remove ${CUDAGRAPH_OPT} from decode CMD
seungrokj Jun 19, 2026
94c2302
feat: add MiniMax-M3 ATOM disagg CI script and server_atom.sh support
seungrokj Jun 19, 2026
26655d0
feat: add minimaxm3-fp4-mi355x-atom-disagg recipe and AITER_QUICK_RED…
seungrokj Jun 19, 2026
e534d9d
feat: export AITER_QUICK_REDUCE_QUANTIZATION=INT4 for non-DSv4 models
seungrokj Jun 19, 2026
78833bc
fix: server_atom.sh and minimaxm3 disagg cleanup
seungrokj Jun 19, 2026
95f6ca4
fix: dsv4_fp4_mi355x_atom-disagg cleanup
seungrokj Jun 19, 2026
b0d8f56
fix: set BLOCK_SIZE=128 for MiniMax-M3 in minimaxm3_fp4_mi355x_atom-d…
seungrokj Jun 19, 2026
757ee4b
fix: use KV_CACHE_DTYPE=fp8 for MiniMax-M3 disagg (matches atom serve…
seungrokj Jun 19, 2026
4a03b6f
feat: update minimaxm3-fp4-mi355x-atom-disagg search space and disabl…
seungrokj Jun 19, 2026
086373f
feat: add MiniMax-M3-MXFP4/MXFP8 to models_atom.yaml; set KV_CACHE_DT…
seungrokj Jun 19, 2026
92252fc
fix: set mi355x-disagg runner and add dynamic cudagraph sizes for dec…
seungrokj Jun 19, 2026
e7bba6f
fix: gate ATOM_MOE_GU_ITLV and AITER_BF16_FP8_MOE_BOUND on DeepSeek-V…
seungrokj Jun 19, 2026
04327df
fix: preserve empty KV_CACHE_DTYPE to skip --kv-cache-dtype flag
seungrokj Jun 20, 2026
c79cf92
fix: use KV_CACHE_DTYPE=auto for minimaxm3 disagg to skip --kv-cache-…
seungrokj Jun 20, 2026
7c5eee1
fix: align minimaxm3 disagg settings with slurm reference script
seungrokj Jun 20, 2026
daf2666
fix: rename minimaxm3-fp4-mi355x-atom-disagg to minimaxm3-fp8 and rem…
seungrokj Jun 20, 2026
634edc8
feat: add minimaxm3_fp8_mi355x_atom-disagg multi-node benchmark script
seungrokj Jun 20, 2026
c7824d9
benchmarks: rename minimaxm3 to dsv4 atom-disagg script and generaliz…
seungrokj Jun 21, 2026
fa89765
fix: bump minimaxm3-fp8-mi355x-atom-disagg image and pin MAX_MODEL_LEN
seungrokj Jun 23, 2026
62c2cc2
chore: prepare PR 1865 ingest recovery
Oseltamivir Jun 25, 2026
9f819db
fix: recover PR 1865 ingest
Oseltamivir Jun 25, 2026
51a7034
chore: attach reusable sweep run 27996171132
Oseltamivir Jun 25, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4174,3 +4174,12 @@
- "Adds two asymmetric prefill/decode layouts at both 1k1k and 8k1k alongside the TP8+TP8 sweep: 1P TP4 + 1D TP8 (smaller prefill, full-node decode) at conc 1,2,4,8,16,32,64,128,256; and balanced 1P TP4 + 1D TP4 at conc 64,128,256,512,1024. Per-worker TP comes from the master-config prefill/decode tp (server_vllm.sh rewrites the models_vllm.yaml --tensor-parallel-size placeholder); no EP, dp-attn off, PREFILL_NODES=1/DECODE_NODES=1 (TP4 uses half an 8-GPU node)"
- "Adds a 2P TP4 + 1D TP8 layout at both 1k1k and 8k1k for high conc 256,512,768,1024: two TP4 prefill workers (num-worker 2, PREFILL_NODES=2, each TP4 on half an 8-GPU node) feeding one TP8 decode (DECODE_NODES=1); 3 nodes total"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1762

- config-keys:
- minimaxm3-fp8-mi355x-atom-disagg
description:
- "Add minimaxm3-fp8-mi355x-atom-disagg CI recipe: multi-node disaggregated PD on MI355X via ATOM for MiniMax-M3-MXFP8"
- "Settings aligned with slurm reference: MEM_FRAC_STATIC=0.8, MAX_NUM_SEQS=128, BLOCK_SIZE=128, MAX_MODEL_LEN=32768, KV_CACHE_DTYPE=auto"
- "server_atom.sh: fix _MAX_CONC assignment before cudagraph size check; gate ATOM_MOE_GU_ITLV/AITER_BF16_FP8_MOE_BOUND on DeepSeek-V4-Pro only"
- "Search space: ISL=8192 and ISL=1024, 1P1D TP4, conc 1-512"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1927