mphelpers - MPHelpers - Parallel processing routines

class vdrp.mphelpers.MPPool(jobnum, num_proc)

Pool of threads consuming tasks from a queue

add_task(func, *args, **kargs)

Add a task to the queue

wait_completion()

Wait for completion of all the tasks in the queue

class vdrp.mphelpers.MPWorker(name, tasks)

Bases: multiprocessing.process.Process

Thread executing tasks from a given tasks queue

run()

Method to be run in sub-process; can be overridden in sub-class

class vdrp.mphelpers.ThreadPool(num_threads)

Pool of threads consuming tasks from a queue

add_task(func, *args, **kargs)

Add a task to the queue

wait_completion()

Wait for completion of all the tasks in the queue

class vdrp.mphelpers.ThreadShutDownException

class vdrp.mphelpers.ThreadWorker(name, tasks)

Bases: threading.Thread

Thread executing tasks from a given tasks queue

run()

Method representing the thread’s activity.

You may override this method in a subclass. The standard run() method invokes the callable object passed to the object’s constructor as the target argument, if any, with sequential and keyword arguments taken from the args and kwargs arguments, respectively.

vdrp.mphelpers.mp_run(func, args, rargv, parser)

vdrp.mphelpers.shutdownThread()