Code that is used by the DKIST Science Data Processing Airflow pipelines to process VBI data.
Project description
Overview
The dkist-processing-vbi library contains the implementation of the vbi pipelines as a collection of the dkist-processing-core framework and dkist-processing-common Tasks.
The recommended project structure is to separate tasks and workflows into seperate packages. Having the workflows in their own package facilitates using the build_utils to test the integrity of those workflows in the unit test. example
Build
Artifacts are built through bitbucket pipelines
The pipeline can be used in other repos with a modification of the package and artifact locations to use the names relevant to the target repo.
e.g. dkist-processing-test -> dkist-processing-vbi and dkist_processing_test -> dkist_processing_vbi
Deployment
Deployment is done with turtlebot and follows the process detailed in dkist-processing-core
Environment Variables
Only those specified by dkist-processing-core and dkist-processing-common.
Development
git clone git@bitbucket.org:dkistdc/dkist-processing-vbi.git
cd dkist-processing-vbi
pre-commit install
pip install -e .[test]
pytest -v --cov dkist_processing_vbi
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for dkist_processing_vbi-0.4.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | ba15716732118c8dafaa67172360aeeb5fecf070ace8ab5657ab3dd43a35634d |
|
MD5 | 7b19f343467d07a68de0d0c90b5fa64e |
|
BLAKE2b-256 | 0c7660abb16e826011930cb12ad0c2bf732035ed0b1fcef4cbe7e064fd35f48e |