Skip to content

feat(asr): surface sherpa streaming UI and docs#544

Open
weikeyi wants to merge 3 commits into
Open-Less:betafrom
weikeyi:pr/sherpa-streaming-ui-docs
Open

feat(asr): surface sherpa streaming UI and docs#544
weikeyi wants to merge 3 commits into
Open-Less:betafrom
weikeyi:pr/sherpa-streaming-ui-docs

Conversation

@weikeyi
Copy link
Copy Markdown
Contributor

@weikeyi weikeyi commented May 28, 2026

User description

概要

  • 胶囊监听 local-asr-token,在录音 / 转写 / 润色阶段显示 sherpa online streaming partial 文本。
  • Local ASR 页面新增 Batch / Streaming 模型标签、最近一次诊断信息,以及 Zipformer streaming 模型元数据。
  • 补齐 sherpa streaming 相关中英日韩繁体文案。
  • 新增 Windows-only sherpa_online_spike example,用于直接验证 Zipformer online 模型的 partial / final 输出和 RTF。
  • 更新 Windows sherpa-onnx ASR 实施计划,记录当前已完成状态和剩余验收项。

验证

  • npm run build
  • cargo check --manifest-path src-tauri/Cargo.toml --example sherpa_online_spike

PR Type

Enhancement, Tests, Documentation


Description

  • Surface sherpa streaming partials in capsule

  • Add local ASR model diagnostics

  • Extend sherpa model catalog metadata

  • Ship Windows streaming probe and plan updates


Diagram Walkthrough

flowchart LR
  A["Sherpa model catalog"] -- "mode metadata" --> B["Local ASR page"]
  B -- "state + diagnostics" --> C["Capsule UI"]
  D["local-asr-token events"] -- "partial text" --> C
  E["Windows spike example"] -- "validates streaming model" --> A
  F["Windows sherpa plan"] -- "documents current status" --> B
Loading

File Walkthrough

Relevant files
Tests
1 files
sherpa_online_spike.rs
Add Windows streaming probe example                                           
+241/-0 
Enhancement
3 files
Capsule.tsx
Show live streaming text in capsule                                           
+50/-4   
localAsr.ts
Add streaming model and status metadata                                   
+36/-0   
LocalAsr.tsx
Display sherpa modes and diagnostics                                         
+56/-2   
Documentation
6 files
en.ts
Add sherpa streaming and diagnostics copy                               
+9/-1     
ja.ts
Add sherpa streaming and diagnostics copy                               
+9/-1     
ko.ts
Add sherpa streaming and diagnostics copy                               
+9/-1     
zh-CN.ts
Add sherpa streaming and diagnostics copy                               
+9/-1     
zh-TW.ts
Add sherpa streaming and diagnostics copy                               
+9/-1     
windows-sherpa-onnx-asr-plan.md
Update sherpa rollout status and plan                                       
+524/-293

@github-actions
Copy link
Copy Markdown

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 3 🔵🔵🔵⚪⚪
🧪 No relevant tests
🔒 No security concerns identified
⚡ Recommended focus areas for review

Compile error

str::ends_with does not accept a predicate function, so this whitespace check will fail to compile. That means the new Windows spike example cannot be built until the spacing logic is rewritten with a valid check.

if !text.is_empty() && !text.ends_with(char::is_whitespace) {
    text.push(' ');

@appergb
Copy link
Copy Markdown
Collaborator

appergb commented May 28, 2026

我需要看到你具体的表现形式,具体的表现形式就是我需要具体的表现和具体的显示形式。

@weikeyi
Copy link
Copy Markdown
Contributor Author

weikeyi commented May 28, 2026

看不懂你的意思

@H-Chris233
Copy link
Copy Markdown
Collaborator

看不懂你的意思

意思是请给出演示图片和视频(对于任何 UI 相关改动

@weikeyi
Copy link
Copy Markdown
Contributor Author

weikeyi commented May 30, 2026

本次涉及的主要前端改动为胶囊里的实时文字显示。
QQ20260530-213342-HD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants