Summary
CLI telemetry (WinMLCLIAction) currently records action_name, device, ep, duration_ms, and success, but not which model each command ran against. We want visibility into which models people run — especially public HuggingFace models — without leaking PII.
Problem
The -m/--model value can be a HuggingFace ID (microsoft/resnet-50), a local .onnx file path, or a build output directory. Local paths may embed a username, so recording the raw value would reintroduce exactly the path/username leakage the existing exception-scrubbing pipeline exists to prevent.
Proposal
Add a model_id attribute to WinMLCLIAction:
- Clean HF ids (
org/name, not present on disk) → recorded as-is.
- Local paths / directories / bare names → anonymized to
<local:.onnx> / <local:dir> (no path fragment ever emitted).
- Commands exposing
--model-id (eval/quantize) record that clean HF id directly.
Summary
CLI telemetry (
WinMLCLIAction) currently recordsaction_name,device,ep,duration_ms, andsuccess, but not which model each command ran against. We want visibility into which models people run — especially public HuggingFace models — without leaking PII.Problem
The
-m/--modelvalue can be a HuggingFace ID (microsoft/resnet-50), a local.onnxfile path, or a build output directory. Local paths may embed a username, so recording the raw value would reintroduce exactly the path/username leakage the existing exception-scrubbing pipeline exists to prevent.Proposal
Add a
model_idattribute toWinMLCLIAction:org/name, not present on disk) → recorded as-is.<local:.onnx>/<local:dir>(no path fragment ever emitted).--model-id(eval/quantize) record that clean HF id directly.