Skip to content

feat(constants): add llm-d-vllm framework label#524

Open
ezrasilvera wants to merge 1 commit into
SemiAnalysisAI:masterfrom
ezrasilvera:llm-d
Open

feat(constants): add llm-d-vllm framework label#524
ezrasilvera wants to merge 1 commit into
SemiAnalysisAI:masterfrom
ezrasilvera:llm-d

Conversation

@ezrasilvera

@ezrasilvera ezrasilvera commented Jul 4, 2026

Copy link
Copy Markdown

What

Registers a new framework llm-d-vllm in FW_REGISTRY (packages/constants) with the display label "llm-d vLLM".

Why

We are adding llm-d (vLLM) as a new benchmark framework in the InferenceX benchmark framework - GB200 DeepSeek-V4-Pro FP4 P/D-disaggregated recipes (mid-curve 1P1D at conc 256/512/1024 and high-tpt 2P1D at conc 4096). Once those
sweeps ingest, the result rows carry framework: llm-d-vllm.

Without this entry the dashboard would not treat it as a canonical framework (FRAMEWORK_KEYS is derived from FW_REGISTRY) and would render the series with the uppercased slug "LLM-D-VLLM" instead of "llm-d vLLM".

Change

  • packages/constants/src/framework-aliases.ts: add 'llm-d-vllm': { label: 'llm-d vLLM' } to FW_REGISTRY (placed
    alphabetically, after dynamo-vllm).
  • packages/constants/src/framework-aliases.test.ts: add a matching
    FRAMEWORK_LABELS assertion for the new label.

Note

Low Risk
Constants-only registry and test change with no auth, data, or runtime logic changes.

Overview
Registers llm-d-vllm in FW_REGISTRY with display label "llm-d vLLM", so upcoming benchmark rows using that framework key are treated as canonical and show the intended name in charts and tooltips instead of an uppercased slug.

Because FRAMEWORK_KEYS and FRAMEWORK_LABELS are derived from the registry, no other wiring is required. A FRAMEWORK_LABELS unit test covers the new entry.

Reviewed by Cursor Bugbot for commit c11f50c. Bugbot is set up for automated code reviews on this repo. Configure here.

Register the llm-d-vllm framework in FW_REGISTRY with display label
"llm-d vLLM" so the InferenceX GB200 DeepSeek-V4-Pro disaggregated
benchmark series is recognized as a canonical framework (FRAMEWORK_KEYS)
and rendered with a proper label instead of the uppercased slug.
Add a matching FRAMEWORK_LABELS assertion.

Signed-off-by: Ezra Silvera <ezra@il.ibm.com>
@ezrasilvera ezrasilvera requested a review from adibarra as a code owner July 4, 2026 09:57
@vercel

vercel Bot commented Jul 4, 2026

Copy link
Copy Markdown

@ezrasilvera is attempting to deploy a commit to the SemiAnalysisAI Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant