aquin.compute.steer Namespace Reference

Functions
Generator[dict, None, None]	run_steer_stream (str prompt, int feature_idx, float strength=20.0, str model_id="llama-3.2-1b", int max_new_tokens=200, float temperature=0.7)

Variables
	DEVICE = resolve_compute_device()

Function Documentation

run_steer_stream()

Generator[dict, None, None] run_steer_stream	(	str	prompt,
		int	feature_idx,
		float	strength = 20.0,
		str	model_id = "llama-3.2-1b",
		int	max_new_tokens = 200,
		float	temperature = 0.7 )

Definition at line 25 of file steer.py.

Variable Documentation

DEVICE

aquin.compute.steer.DEVICE = resolve_compute_device()

Definition at line 22 of file steer.py.