Little process-based workers to do your bidding.
Project description
Little process-based workers to do your bidding.
Deliberately minimalist, you provide the number of workers to use & a list of commands (to be executed at the shell) & littleworkers will eat through the list as fast as it can.
Why littleworkers?
littleworkers shines when you just want to parallelize something without a lot of fuss & when you care more about the data/commands to be run.
Tiny source
Easy to queue a set of actions
Works with any runnable commands
Uses processes
Non-blocking
Seriously, it’s not a replacement for threading or multiprocessing if your application needs to share a ton of data with the children.
Usage
Usage is trivial:
from littleworkers import Pool # Define your commands. commands = [ 'ls -al', 'cd /tmp && mkdir foo', 'date', 'echo "Hello There."', 'sleep 2 && echo "Done."' ] # Setup a pool. Since I have two cores, I'll use two workers. lil = Pool(workers=2) # Run! lil.run(commands)
For more advanced uses, please see the API documentation.
Requirements
Python 2.6+
- author:
Daniel Lindsley
- updated:
2011/11/10
- version:
0.3.1
- license:
BSD
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for littleworkers-0.3.2-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 701c6bee15a9ac8cc52758ad604fef4a034291f6951ab89aaf1469abdb1e9838 |
|
MD5 | ff12e1b41f13361a184bf6621d666d22 |
|
BLAKE2b-256 | 40f88b4870e0073edf572e042822eaae208f635ad384f22ffefbc714d25ae6c2 |