Search results

compliance: scope edge-agentic checker (rename to edge_agentic.py, required ruleset/model args)

Status: Open.

#397 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL/edge: make single-stream a first-class HTTPClientConfig option (drop accuracy-only override)

Status: Open.

#395 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL/openai: harden msgspec adapter tests + hoist imports + gc docstring for tool_choice

Status: Open.

#396 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL test coverage: BFCLv4MultiTurnScorer.score() and bfcl_v4 generate() selection logic

Status: Open.

#394 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL scoring/reporting & robustness cleanup (live_relevance, no-metric PASS, drain cap, plot guard, dead code)

Status: Open.

#393 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL multi-turn execution robustness: malformed 200 body + uncleaned bfcl-eval instance cache

Status: Open.

#392 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

BFCL multi-turn: endpoint-controlled tool-call names reach bfcl-eval eval() (RCE on evaluator host)

Status: Open.

#391 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

Move bfcl-eval to an out-of-process uv subproject (remove parent-env pip caveats)

Status: Open.

#390 In mlcommons/endpoints;

· Palanivelg opened on Jul 6, 2026

Schema-aware adapter selection (drop hard-required 'prompt' column / ColumnFilter skip)

Status: Open.

#388 In mlcommons/endpoints;

· Palanivelg opened on Jul 1, 2026

Unify accuracy scoring path for perf+accuracy and accuracy-only runs

Status: Open.

#387 In mlcommons/endpoints;

· Palanivelg opened on Jul 1, 2026

Refactor commands/benchmark/execute.py — split the benchmark God-module

Status: Open.

#384 In mlcommons/endpoints;

· viraatc opened on Jun 30, 2026

BFCL-v4 multi-turn runner: reuse HttpClientSampleIssuer instead of bespoke HTTP client

Status: Open.

#382 In mlcommons/endpoints;

· Palanivelg opened on Jun 30, 2026