calibration.py File Reference

Go to the source code of this file.

Namespaces
namespace	aquin
namespace	aquin.compute
namespace	aquin.compute.calibration

Functions
float	aquin.compute.calibration.ece_proxy (list[float] confs)
list[float]	aquin.compute.calibration.mean_token_confidence (Any model, Any tokenizer, str device, list[str] prompts)
dict	aquin.compute.calibration.run_calibration_for_models (*, Any base_model, Any ft_model, Any tokenizer, str device, list[str] eval_prompts, list[str]|None eval_categories=None, list[str]|None ft_outputs=None, float threshold=0.40)