Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion docs/ci/runtime_intelligence_gitlab_artifacts.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,7 @@ to remain present in EdgeEnv/AIGuard handoff context. It also requires AIGuard
`edgeenv_orchestrator_task_event_rollup`,
`edgeenv_orchestrator_operation_timeline_summary`,
`edgeenv_orchestrator_scheduler_fairness_summary`,
`edgeenv_orchestrator_policy_pressure_summary`,
`runtime_history_seed_run_config_traceability`, and
`remote_execution_recovered_by_fallback` evidence so the smoke remains a
cross-repo handoff fixture rather than a Lab-only report sample. When an
Expand All @@ -185,6 +186,7 @@ packaging runs. That marker set preserves `Runtime Intelligence Risk Summary`,
`AIGuard operation risk rollup evidence`,
`AIGuard operation timeline evidence`,
`AIGuard scheduler fairness evidence`,
`AIGuard policy pressure evidence`,
`AIGuard runtime operation anomalies`,
`AIGuard remote dispatch event summary`,
`AIGuard remote event summary consistency`,
Expand All @@ -207,7 +209,7 @@ timeline summary run IDs against the preserved EdgeEnv regression context, so
compact AIGuard operation evidence remains traceable to producer-side
Orchestrator context.

The artifact gate is implemented by `scripts/check_runtime_intelligence_artifact_bundle.py`. It checks the generated Markdown / HTML report for the required Runtime Intelligence rows, including the short `Review Path` section, the `Review path` note, the `Reviewer Focus` quick-scan table, Lab ownership, EdgeEnv comparability, `EdgeEnv fixture matrix coverage`, telemetry coverage-gap markers, Runtime replay duration scope with `source=entrypoint_requested_frames` traceability, Orchestrator operation feed context, the Lab-owned `Reviewer operation quick scan` row, compact queue/deadline/fallback operation markers with `max_total_queue_depth`, AIGuard max queue raw-context traceability, Orchestrator task event rollup, Lab EdgeEnv preservation context, Jetson/device-local preservation identity and detail labels, Orchestrator `operation_risk_summary` navigation context, AIGuard runtime operation anomalies, AIGuard `edgeenv_orchestrator_operation_risk_summary` evidence, AIGuard `edgeenv_orchestrator_operation_risk_rollup` evidence, AIGuard `edgeenv_orchestrator_task_event_rollup` evidence, AIGuard `edgeenv_orchestrator_operation_timeline_summary` evidence, AIGuard `edgeenv_orchestrator_scheduler_fairness_summary` evidence, remote dispatch starter event summary, `Remote fallback starter evidence`, `edgeenv_orchestrator_producer_lineage`, `runtime_history_seed_run_config_traceability`, `remote_execution_recovered_by_fallback`, and triggered deployment review rules.
The artifact gate is implemented by `scripts/check_runtime_intelligence_artifact_bundle.py`. It checks the generated Markdown / HTML report for the required Runtime Intelligence rows, including the short `Review Path` section, the `Review path` note, the `Reviewer Focus` quick-scan table, Lab ownership, EdgeEnv comparability, `EdgeEnv fixture matrix coverage`, telemetry coverage-gap markers, Runtime replay duration scope with `source=entrypoint_requested_frames` traceability, Orchestrator operation feed context, the Lab-owned `Reviewer operation quick scan` row, compact queue/deadline/fallback operation markers with `max_total_queue_depth`, AIGuard max queue raw-context traceability, Orchestrator task event rollup, Lab EdgeEnv preservation context, Jetson/device-local preservation identity and detail labels, Orchestrator `operation_risk_summary` navigation context, AIGuard runtime operation anomalies, AIGuard `edgeenv_orchestrator_operation_risk_summary` evidence, AIGuard `edgeenv_orchestrator_operation_risk_rollup` evidence, AIGuard `edgeenv_orchestrator_task_event_rollup` evidence, AIGuard `edgeenv_orchestrator_operation_timeline_summary` evidence, AIGuard `edgeenv_orchestrator_scheduler_fairness_summary` evidence, AIGuard `edgeenv_orchestrator_policy_pressure_summary` evidence, remote dispatch starter event summary, `Remote fallback starter evidence`, `edgeenv_orchestrator_producer_lineage`, `runtime_history_seed_run_config_traceability`, `remote_execution_recovered_by_fallback`, and triggered deployment review rules.

The bundle manifest gate also checks the external AIGuard artifact before the
rendered report stage. In particular, `runtime_queue_overload` must preserve
Expand Down
2 changes: 1 addition & 1 deletion docs/portfolio/edgeenv_runtime_regression_lab_handoff.md
Original file line number Diff line number Diff line change
Expand Up @@ -192,7 +192,7 @@ Expected Lab behavior:
- The same gate requires EdgeEnv-preserved Orchestrator producer markers to carry `source_repository=InferEdgeOrchestrator`, `artifact_role=orchestrator-supplemental-operation-context`, and `producer_contract=inferedge-orchestrator-edgeenv-runtime-telemetry-feed-v1`.
- When EdgeEnv preservation context is present, Lab renders `Lab EdgeEnv preservation context` with `lab_report_preservation_context_present=True`, `lab_preservation=present`, and `lab_context=present` so the Runtime Intelligence report gate and entrypoint evidence index use the same Lab-owned marker vocabulary.
- When an EdgeEnv handoff manifest is provided, the bundle gate requires EdgeEnv-produced file keys, external AIGuard file keys, source repository mapping, artifact roles, producer contracts, and boundary flags to match Lab's Runtime Intelligence bundle contract.
- The same manifest gate requires `expected_report_markers` to preserve these exact Lab-owned report markers: `Runtime Intelligence Risk Summary`, `Runtime replay duration scope`, `Orchestrator operation feed context`, `EdgeEnv fixture matrix coverage`, `Reviewer operation quick scan`, `Orchestrator task event rollup`, `Lab EdgeEnv preservation context`, `AIGuard operation risk rollup evidence`, `AIGuard task event rollup evidence`, `AIGuard operation timeline evidence`, `AIGuard scheduler fairness evidence`, `AIGuard runtime operation anomalies`, `AIGuard remote dispatch event summary`, `AIGuard remote event summary consistency`, `Remote fallback starter evidence`, `lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback`, `AIGuard producer-lineage guard alignment`, and `Lab remains the final deployment decision owner.`.
- The same manifest gate requires `expected_report_markers` to preserve these exact Lab-owned report markers: `Runtime Intelligence Risk Summary`, `Runtime replay duration scope`, `Orchestrator operation feed context`, `EdgeEnv fixture matrix coverage`, `Reviewer operation quick scan`, `Orchestrator task event rollup`, `Lab EdgeEnv preservation context`, `AIGuard operation risk rollup evidence`, `AIGuard task event rollup evidence`, `AIGuard operation timeline evidence`, `AIGuard scheduler fairness evidence`, `AIGuard policy pressure evidence`, `AIGuard runtime operation anomalies`, `AIGuard remote dispatch event summary`, `AIGuard remote event summary consistency`, `Remote fallback starter evidence`, `lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback`, `AIGuard producer-lineage guard alignment`, and `Lab remains the final deployment decision owner.`.
- Reviewer navigation can trace Orchestrator curated samples through AIGuard evidence into Lab report rows: `agent_scheduler_delay_sample.json` -> `scheduler_delay_pattern` -> `Reviewer operation quick scan` / `Orchestrator queue/deadline/fallback markers`, and `remote_fallback_recovery_sample.json` -> `remote_execution_recovered_by_fallback` -> `Remote fallback starter evidence`. Lab does not treat those curated samples as benchmark outputs, production retry proof, or deployment policy inputs.
- The external AIGuard artifact gate also requires `runtime_queue_overload`
raw context to preserve
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
"required_evidence_type_count": 10,
"optional_evidence_type_count": 2,
"guard_evidence_type_count": 11,
"lab_expected_report_marker_count": 18,
"lab_expected_report_marker_count": 19,
"lab_expected_report_markers": [
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
Expand All @@ -22,6 +22,7 @@
"AIGuard task event rollup evidence",
"AIGuard operation timeline evidence",
"AIGuard scheduler fairness evidence",
"AIGuard policy pressure evidence",
"AIGuard runtime operation anomalies",
"AIGuard remote dispatch event summary",
"AIGuard remote event summary consistency",
Expand All @@ -46,6 +47,7 @@
"edgeenv_orchestrator_task_event_rollup",
"edgeenv_orchestrator_operation_timeline_summary",
"edgeenv_orchestrator_scheduler_fairness_summary",
"edgeenv_orchestrator_policy_pressure_summary",
"runtime_history_seed_run_config_traceability",
"runtime_queue_overload",
"runtime_thermal_instability",
Expand All @@ -63,6 +65,7 @@
"edgeenv_orchestrator_task_event_rollup",
"edgeenv_orchestrator_operation_timeline_summary",
"edgeenv_orchestrator_scheduler_fairness_summary",
"edgeenv_orchestrator_policy_pressure_summary",
"runtime_history_seed_run_config_traceability",
"runtime_thermal_instability",
"runtime_queue_overload",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,14 +23,14 @@

| Field | Values |
| --- | --- |
| required_evidence_types | runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, runtime_history_seed_run_config_traceability, runtime_queue_overload, runtime_thermal_instability, remote_execution_recovered_by_fallback |
| required_evidence_types | runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, edgeenv_orchestrator_policy_pressure_summary, runtime_history_seed_run_config_traceability, runtime_queue_overload, runtime_thermal_instability, remote_execution_recovered_by_fallback |
| optional_aiguard_evidence_types | stale_frame_risk, edgeenv_orchestrator_stale_drop_summary |
| guard_analysis_evidence_types | runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_summary, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, runtime_history_seed_run_config_traceability, runtime_thermal_instability, runtime_queue_overload, remote_execution_recovered_by_fallback |
| guard_analysis_evidence_types | runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_summary, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, edgeenv_orchestrator_policy_pressure_summary, runtime_history_seed_run_config_traceability, runtime_thermal_instability, runtime_queue_overload, remote_execution_recovered_by_fallback |
| missing_required_evidence_types | [] |
| optional_guard_evidence_types_present | [] |
| missing_optional_evidence_types | edgeenv_orchestrator_stale_drop_summary, stale_frame_risk |
| supplemental_guard_evidence_types | edgeenv_orchestrator_operation_risk_summary |
| lab_expected_report_markers | Runtime Intelligence Risk Summary, Runtime replay duration scope, Orchestrator operation feed context, EdgeEnv fixture matrix coverage, Reviewer operation quick scan, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard operation risk rollup evidence, AIGuard task event rollup evidence, AIGuard operation timeline evidence, AIGuard scheduler fairness evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner. |
| lab_expected_report_markers | Runtime Intelligence Risk Summary, Runtime replay duration scope, Orchestrator operation feed context, EdgeEnv fixture matrix coverage, Reviewer operation quick scan, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard operation risk rollup evidence, AIGuard task event rollup evidence, AIGuard operation timeline evidence, AIGuard scheduler fairness evidence, AIGuard policy pressure evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner. |
| handoff_duration_sources | [] |
| handoff_duration_scope_labels | [] |
| errors | [] |
Expand All @@ -43,16 +43,16 @@ InferEdgeAIGuard EdgeEnv handoff alignment summary
- recommendation: alignment_satisfied
- decision_owner: lab
- diagnosis_owner: aiguard
- lab_expected_report_markers: [Runtime Intelligence Risk Summary, Runtime replay duration scope, Orchestrator operation feed context, EdgeEnv fixture matrix coverage, Reviewer operation quick scan, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard operation risk rollup evidence, AIGuard task event rollup evidence, AIGuard operation timeline evidence, AIGuard scheduler fairness evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner.]
- lab_expected_report_markers: [Runtime Intelligence Risk Summary, Runtime replay duration scope, Orchestrator operation feed context, EdgeEnv fixture matrix coverage, Reviewer operation quick scan, Orchestrator task event rollup, Lab EdgeEnv preservation context, AIGuard operation risk rollup evidence, AIGuard task event rollup evidence, AIGuard operation timeline evidence, AIGuard scheduler fairness evidence, AIGuard policy pressure evidence, AIGuard runtime operation anomalies, AIGuard remote dispatch event summary, AIGuard remote event summary consistency, Remote fallback starter evidence, lab=Remote fallback starter evidence; evidence=remote_execution_recovered_by_fallback, AIGuard producer-lineage guard alignment, Lab remains the final deployment decision owner.]
- report_marker_context_role: lab_report_contract_context
- aiguard_validates_expected_report_markers: False
- optional_evidence_context_role: read_only_optional_guard_context
- aiguard_validates_optional_evidence_as_required: False
- handoff_duration_sources: []
- handoff_duration_scope_labels: []
- required_evidence_types: [runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, runtime_history_seed_run_config_traceability, runtime_queue_overload, runtime_thermal_instability, remote_execution_recovered_by_fallback]
- required_evidence_types: [runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, edgeenv_orchestrator_policy_pressure_summary, runtime_history_seed_run_config_traceability, runtime_queue_overload, runtime_thermal_instability, remote_execution_recovered_by_fallback]
- optional_aiguard_evidence_types: [stale_frame_risk, edgeenv_orchestrator_stale_drop_summary]
- guard_analysis_evidence_types: [runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_summary, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, runtime_history_seed_run_config_traceability, runtime_thermal_instability, runtime_queue_overload, remote_execution_recovered_by_fallback]
- guard_analysis_evidence_types: [runtime_telemetry_context_coverage, edgeenv_orchestrator_producer_lineage, edgeenv_orchestrator_operation_risk_summary, edgeenv_orchestrator_operation_risk_rollup, edgeenv_orchestrator_task_event_rollup, edgeenv_orchestrator_operation_timeline_summary, edgeenv_orchestrator_scheduler_fairness_summary, edgeenv_orchestrator_policy_pressure_summary, runtime_history_seed_run_config_traceability, runtime_thermal_instability, runtime_queue_overload, remote_execution_recovered_by_fallback]
- missing_required_evidence_types: []
- optional_guard_evidence_types_present: []
- missing_optional_evidence_types: [edgeenv_orchestrator_stale_drop_summary, stale_frame_risk]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
"required_evidence_type_count": 10,
"optional_evidence_type_count": 2,
"guard_evidence_type_count": 13,
"lab_expected_report_marker_count": 18,
"lab_expected_report_marker_count": 19,
"lab_expected_report_markers": [
"Runtime Intelligence Risk Summary",
"Runtime replay duration scope",
Expand All @@ -22,6 +22,7 @@
"AIGuard task event rollup evidence",
"AIGuard operation timeline evidence",
"AIGuard scheduler fairness evidence",
"AIGuard policy pressure evidence",
"AIGuard runtime operation anomalies",
"AIGuard remote dispatch event summary",
"AIGuard remote event summary consistency",
Expand All @@ -46,6 +47,7 @@
"edgeenv_orchestrator_task_event_rollup",
"edgeenv_orchestrator_operation_timeline_summary",
"edgeenv_orchestrator_scheduler_fairness_summary",
"edgeenv_orchestrator_policy_pressure_summary",
"runtime_history_seed_run_config_traceability",
"runtime_queue_overload",
"runtime_thermal_instability",
Expand All @@ -63,6 +65,7 @@
"edgeenv_orchestrator_task_event_rollup",
"edgeenv_orchestrator_operation_timeline_summary",
"edgeenv_orchestrator_scheduler_fairness_summary",
"edgeenv_orchestrator_policy_pressure_summary",
"runtime_history_seed_run_config_traceability",
"runtime_thermal_instability",
"runtime_queue_overload",
Expand Down
Loading
Loading