aquin.compute.model_diff Namespace Reference

Functions
dict	_run_model_diff_tl (base_model, ft_model, list[str] prompts, int n_prompts=5)
dict	_run_model_diff (str base_model_id, str ft_ckpt_path, list[str] prompts, int n_prompts=5)

Function Documentation

_run_model_diff()

dict _run_model_diff ( str base_model_id, str ft_ckpt_path, list[str] prompts, int n_prompts = 5 )

protected

Definition at line 141 of file model_diff.py.

References _run_model_diff_tl().

_run_model_diff_tl()

dict _run_model_diff_tl ( base_model, ft_model, list[str] prompts, int n_prompts = 5 )

protected

Compare base vs fine-tuned HookedTransformer models (already loaded).

Definition at line 24 of file model_diff.py.

Referenced by _run_model_diff().