aquin.sdk.session Namespace Reference

Functions
str	load_model (str model_id, *, bool as_json=False)
None	unload (*, bool stop_daemon=False)
str|None	active_model ()
dict[str, Any]|None	status (*, bool as_dict=True)
None	prompt (str text, *str extra)

Function Documentation

active_model()

str | None active_model

(

)

Return the currently loaded model id, if any.

Definition at line 34 of file session.py.

load_model()

str load_model	(	str	model_id,
		*	,
		bool	as_json = False )

Load a HuggingFace / family model into VRAM (daemon if available).

Definition at line 17 of file session.py.

prompt()

None prompt	(	str	text,
		*str	extra )

Quick generation against the loaded model (prints like the CLI).

Definition at line 55 of file session.py.

status()

dict[str, Any] | None status	(	*	,
		bool	as_dict = True )

Local engine / model status snapshot.

Definition at line 42 of file session.py.

unload()

None unload	(	*	,
		bool	stop_daemon = False )

Free the resident model from VRAM.

Definition at line 24 of file session.py.