aquin.benchmark_check Namespace Reference

Functions
dict[str, Any]	_normalize_benchmark_result (dict[str, Any] result)
bool	has_benchmark_payload (dict[str, Any] result)
tuple[Path, Path]	write_benchmark_check (dict[str, Any] result, *, str|None tool_name, str|Path cwd)
str	_score_color (float val)
None	_plot_benchmark_check (dict[str, Any] result, Path png_path)
None	_plot_metric_panel (Any ax, dict[str, Any] result)
None	_plot_activation_panel (Any ax, dict[str, Any] result)
None	_plot_examples_panel (Any ax, list[dict[str, Any]] examples)
str	_trunc (str text, int limit)

Variables
str	_JSON_NAME = "benchmark-check.json"
str	_PNG_NAME = "benchmark-check.png"
tuple	_METRICS

Function Documentation

_normalize_benchmark_result()

dict[str, Any] _normalize_benchmark_result ( dict[str, Any] result )

protected

Definition at line 25 of file benchmark_check.py.

Referenced by has_benchmark_payload(), and write_benchmark_check().

_plot_activation_panel()

None _plot_activation_panel ( Any ax, dict[str, Any] result )

protected

Definition at line 146 of file benchmark_check.py.

References _plot_examples_panel().

Referenced by _plot_benchmark_check().

_plot_benchmark_check()

None _plot_benchmark_check ( dict[str, Any] result, Path png_path )

protected

Definition at line 76 of file benchmark_check.py.

References _plot_activation_panel(), and _plot_metric_panel().

Referenced by write_benchmark_check().

_plot_examples_panel()

None _plot_examples_panel ( Any ax, list[dict[str, Any]] examples )

protected

Definition at line 178 of file benchmark_check.py.

References _trunc().

Referenced by _plot_activation_panel().

_plot_metric_panel()

None _plot_metric_panel ( Any ax, dict[str, Any] result )

protected

Definition at line 117 of file benchmark_check.py.

References _score_color().

Referenced by _plot_benchmark_check().

_score_color()

str _score_color ( float val )

protected

Definition at line 68 of file benchmark_check.py.

Referenced by _plot_metric_panel().

_trunc()

str _trunc ( str text, int limit )

protected

Definition at line 194 of file benchmark_check.py.

Referenced by _plot_examples_panel().

has_benchmark_payload()

bool has_benchmark_payload

(

dict[str, Any]

result

)

Definition at line 40 of file benchmark_check.py.

References _normalize_benchmark_result().

write_benchmark_check()

tuple[Path, Path] write_benchmark_check	(	dict[str, Any]	result,
		*	,
		str | None	tool_name,
		str | Path	cwd )

Definition at line 47 of file benchmark_check.py.

References _normalize_benchmark_result(), and _plot_benchmark_check().

Variable Documentation

_JSON_NAME

str aquin.benchmark_check._JSON_NAME = "benchmark-check.json"

protected

Definition at line 15 of file benchmark_check.py.

_METRICS

tuple aquin.benchmark_check._METRICS

protected

Initial value:

=  (
    ("InterpScore", "score"),
    ("Purity", "purity_score"),
    ("MUI", "mui_score"),
)

Definition at line 18 of file benchmark_check.py.

_PNG_NAME

str aquin.benchmark_check._PNG_NAME = "benchmark-check.png"

protected

Definition at line 16 of file benchmark_check.py.