metric_surface_validation Namespace Reference

Functions
def	build_metric_surface_bundle
def	build_metric_surface_cases ()
def	main

Variables
tuple	ARTIFACT_CORE_FIELDS
string	ARTIFACT_FILENAME = "metric_surface_bundle.json"
	DEFAULT_OUTPUT_DIR = performance_evidence_output_dir("metric_surface")
	REPO_ROOT = Path(__file__).resolve().parents[3]
string	SUITE_NAME = "performance_evidence_metric_surface"

Detailed Description

Comparable metric surface validation for performance evidence.

Verifies that counted and diagnosis-only benchmark cases share one comparable
metric vocabulary, including auditable repeated-timing fields for the
representative review set.

Run with:
python benchmarks/density_matrix/performance_evidence/metric_surface_validation.py

Function Documentation

build_metric_surface_bundle()

def metric_surface_validation.build_metric_surface_bundle

(

cases

)

Definition at line 53 of file metric_surface_validation.py.

Here is the call graph for this function:

Here is the caller graph for this function:

build_metric_surface_cases()

def metric_surface_validation.build_metric_surface_cases	(		list,
			dict
	)

Definition at line 49 of file metric_surface_validation.py.

Here is the call graph for this function:

Here is the caller graph for this function:

main()

def metric_surface_validation.main

(

argv

)

Definition at line 86 of file metric_surface_validation.py.

Here is the call graph for this function:

Variable Documentation

ARTIFACT_CORE_FIELDS

tuple metric_surface_validation.ARTIFACT_CORE_FIELDS

Initial value:

=  (
    "suite_name",
    "status",
    "record_schema_version",
    "software",
    "selected_candidate",
    "summary",
    "cases",
)

Definition at line 38 of file metric_surface_validation.py.

ARTIFACT_FILENAME

string metric_surface_validation.ARTIFACT_FILENAME = "metric_surface_bundle.json"

Definition at line 36 of file metric_surface_validation.py.

DEFAULT_OUTPUT_DIR

metric_surface_validation.DEFAULT_OUTPUT_DIR = performance_evidence_output_dir("metric_surface")

Definition at line 37 of file metric_surface_validation.py.

REPO_ROOT

metric_surface_validation.REPO_ROOT = Path(__file__).resolve().parents[3]

Definition at line 17 of file metric_surface_validation.py.

SUITE_NAME

string metric_surface_validation.SUITE_NAME = "performance_evidence_metric_surface"

Definition at line 35 of file metric_surface_validation.py.