Skip to content

why什么使用连续提前开辟好的KVcache? 这样本身就引入一个比huggingface实现快的因素？ #137

Open
Open
why什么使用连续提前开辟好的KVcache? 这样本身就引入一个比huggingface实现快的因素？#137
@wenhaoli-xmu

Description

@wenhaoli-xmu
wenhaoli-xmu
opened on Jun 19, 2025

谢谢

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions