AQIT 0.1.0
Loading...
Searching...
No Matches
aquin.compute.tab_queue.TabQueue Class Reference
Collaboration diagram for aquin.compute.tab_queue.TabQueue:

Public Member Functions

 __init__ (self)
 inference_request (self, fn, float timeout=30.0)
 training_request (self, fn)
dict status (self)

Public Attributes

 inference = asyncio.Semaphore(self._inference_slots)
 training = asyncio.Semaphore(int(os.getenv("TRAINING_SLOTS", "1")))

Static Public Attributes

TabQueue tab_queue = None

Protected Member Functions

int _calculate_inference_slots (self)

Protected Attributes

int _inference_slots = self._calculate_inference_slots()
int _inference_waiters = 0
int _training_waiters = 0
bool _training_active = False

Detailed Description

Definition at line 20 of file tab_queue.py.

Constructor & Destructor Documentation

◆ __init__()

aquin.compute.tab_queue.TabQueue.__init__ ( self)

Definition at line 21 of file tab_queue.py.

Member Function Documentation

◆ _calculate_inference_slots()

int aquin.compute.tab_queue.TabQueue._calculate_inference_slots ( self)
protected

Definition at line 29 of file tab_queue.py.

◆ inference_request()

aquin.compute.tab_queue.TabQueue.inference_request ( self,
fn,
float timeout = 30.0 )

Definition at line 35 of file tab_queue.py.

References _inference_waiters, _training_active, and inference.

◆ status()

dict aquin.compute.tab_queue.TabQueue.status ( self)

◆ training_request()

aquin.compute.tab_queue.TabQueue.training_request ( self,
fn )

Definition at line 50 of file tab_queue.py.

References _training_active, _training_waiters, inference, and training.

Member Data Documentation

◆ _inference_slots

aquin.compute.tab_queue.TabQueue._inference_slots = self._calculate_inference_slots()
protected

Definition at line 22 of file tab_queue.py.

Referenced by status().

◆ _inference_waiters

aquin.compute.tab_queue.TabQueue._inference_waiters = 0
protected

Definition at line 25 of file tab_queue.py.

Referenced by inference_request(), and status().

◆ _training_active

aquin.compute.tab_queue.TabQueue._training_active = False
protected

Definition at line 27 of file tab_queue.py.

Referenced by inference_request(), status(), and training_request().

◆ _training_waiters

aquin.compute.tab_queue.TabQueue._training_waiters = 0
protected

Definition at line 26 of file tab_queue.py.

Referenced by status(), and training_request().

◆ inference

aquin.compute.tab_queue.TabQueue.inference = asyncio.Semaphore(self._inference_slots)

Definition at line 23 of file tab_queue.py.

Referenced by inference_request(), status(), and training_request().

◆ tab_queue

TabQueue aquin.compute.tab_queue.TabQueue.tab_queue = None
static

Definition at line 76 of file tab_queue.py.

◆ training

aquin.compute.tab_queue.TabQueue.training = asyncio.Semaphore(int(os.getenv("TRAINING_SLOTS", "1")))

Definition at line 24 of file tab_queue.py.

Referenced by training_request().


The documentation for this class was generated from the following file: