streamparse lets you run Python code against real-time streams of data. Integrates with Apache Storm.
Project description
Streamparse lets you run Python code against real-time streams of data via Apache Storm. With streamparse you can create Storm bolts and spouts in Python without having to write a single line of Java. It also provides handy CLI utilities for managing Storm clusters and projects.
The Storm/streamparse combo can be viewed as a more robust alternative to Python worker-and-queue systems, as might be built atop frameworks like Celery and RQ. It offers a way to do “real-time map/reduce style computation” against live streams of data. It can also be a powerful way to scale long-running, highly parallel Python processes in production.
Documentation
User Group
Follow the project’s progress, get involved, submit ideas and ask for help via our Google Group, streamparse@googlegroups.com.
Contributors
Alphabetical, by last name:
Dan Blanchard (@dsblanch)
Keith Bourgoin (@kbourgoin)
Arturo Filastò (@hellais)
Jeffrey Godwyll (@rey12rey)
Daniel Hodges (@hodgesds)
Wieland Hoffmann (@mineo)
Tim Hopper (@tdhopper)
Omer Katz (@thedrow)
Aiyesha Ma (@Aiyesha)
Andrew Montalenti (@amontalenti)
Rohit Sankaran (@roadhead)
Viktor Shlapakov (@vshlapakov)
Mike Sukmanowsky (@msukmanowsky)
Cody Wilbourn (@codywilbourn)
Curtis Vogt (@omus)
Changelog
See the releases page on GitHub.
Roadmap
See the Roadmap.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distributions
Hashes for streamparse-3.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9bb21a812bc276af85a04b01b7144ebd70ea644ccad755f9c9f40a64141741c |
|
MD5 | 7867642c1a7f55fb2a164187fd97de4c |
|
BLAKE2b-256 | f82ed9832dd4a522d0ef90eb90da04cdade8f649e4b439fca43851e88fe8962f |
Hashes for streamparse-3.2.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a7032e213cbf89886b7167f86415018bdf425c620b76bcbb7deeda5e834dbf8 |
|
MD5 | 3076f3d542f175d849da64bef2254065 |
|
BLAKE2b-256 | 75ffae1a584bb1dc94d646df97b5e770f8fc92471c6b8872165d84281b2e7c67 |