process data-trees with reconfigurable-paths
Project description
pandalone: process data-trees with reconfigurable-paths
- Release:
0.1.0
- Documentation:
- Source:
- PyPI repo:
- Keywords:
calculation, data, dependencies, engineering, excel, library, numpy, pandas, processing, python, resolution, scientific, simulink, tree, utility
- Copyright:
2015 European Commission (JRC-IET)
- License:
pandalone is an open source Python 2/3 library for building component-functions to process hierarchical-data using reconfigurable-paths.
Our goal is to facilitate the composition of engineering-models from loosely-coupled components. Initially envisioned as an indirection-framework around pandas coupled with a dependency-resolver, every such model should auto-adapt and process only values available, and allow remapping of the paths accessing them, to run on renamed/relocated value-trees without component-code modifications.
It is written for python-3.4 but tested under both python-2.7 and python-3.3+, for Windows and Linux.
Introduction
Overview
At the most fundamental level, an “execution” or a “run” of a processing can be thought like that
.--------------. _____________ .-------------. ; DataTree ; | | ; DataTree ; ;--------------; ==> | <cfunc_1> | ==> ;--------------; ; /some/data ; | <cfunc_2> | ; /some/data ; ; /some/other ; | ... | ; /some/other ; ; /foo/bar ; |_____________| ; /foo/bar ; '--------------' '--------------.
The data-tree might come from json, hdf5, excel-workbooks, or plain dictionaries and lists. Its values are strings and numbers, numpy-lists, pandas or xray-datasets, etc.
The component-functions must abide to the following simple signature:
cfunc_do_something(pandelone, datatree)
and must not return any value, just read and write into the data-tree.
Here is a simple component-function:
def cfunc_standardize(pandelone, datatree): pin, pon = pandelone.paths(), df = datatree.get(pin.A) df[pon.A.B_std] = df[pin.A.B] / df[pin.A.B].std()
Notice the use of the reconfigurable-paths marked specifically as input or output.
TODO: continue rough example in tutorial…
Quick-start
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for pandalone-0.1.0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4b3f3e9024afde968e4d7f39d9858ed193ab4915bfd56f92a522a8f3430ada1f |
|
MD5 | a0441dcb8a06d82d39e212001bb54a9e |
|
BLAKE2b-256 | ff6fe220de40c27dd976c8652d165a40417e7ae8ce36c7723db55ab89caac4f2 |