Skip to content

[WIP] feat: support MLA and refactor MHA#163

Open
Chamberlain0w0 wants to merge 4 commits into
masterfrom
feat/mla
Open

[WIP] feat: support MLA and refactor MHA#163
Chamberlain0w0 wants to merge 4 commits into
masterfrom
feat/mla

refactor: merge 2 MHA paths, rename attention_type to position_embedd…

937a71c
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar