Module npsgd_queue
[hide private]
[frames] | no frames]

Module npsgd_queue

source code

Queue server for npsgd modelling tasks.

The queue server is the data backend for NPSGD. It listens to both workers and the web interface. The web interface populates it with requests while the workers poll for requests and pull them off the queue. Additionally, the queue is responsible for sending out confirmation code e-mail messages.

Classes [hide private]
  ClientConfirm
HTTP handler for clients confirming a model request.
  ClientModelCreate
HTTP handler for clients creating a model request (before confirmation).
  ClientQueueHasWorkers
Request handler for the web daemon to check if workers are available.
  ExpireWorkerTaskThread
Task Expiration Thread
  QueueGlobals
Queue state objects along with disk serialization mechanisms for them.
  QueueRequestHandler
Superclass to all queue request methods.
  WorkerFailedTask
HTTP handler for workers reporting failure to complete a job.
  WorkerHasTask
HTTP handler for workers ensuring that a job still exists.
  WorkerInfo
HTTP handler for workers checking into the queue.
  WorkerSucceededTask
HTTP handler for workers telling the queue that they have succeeded processing.
  WorkerTaskKeepAlive
HTTP handler for workers pinging the queue while working on a task.
  WorkerTaskRequest
HTTP handler for workers grabbings tasks off the queue.
Functions [hide private]
 
main() source code
Variables [hide private]
  __package__ = None
  config = Config()
  glb = None
  modelManager = ModelManager()
  previouslyConfirmed = set([])