Skip to content

issue/296 - feat: add Worker and ModelRunner for PD disaggregation#304

Open
spike-zhu wants to merge 9 commits into
mainfrom
issue/296
Open

issue/296 - feat: add Worker and ModelRunner for PD disaggregation#304
spike-zhu wants to merge 9 commits into
mainfrom
issue/296

完善worker的返回值; prefill模拟数据+jiuge.py推理单测

0a7f899
Select commit
Loading
Failed to load commit list.

There are no checks for this commit