Python client for Hadoop® YARN API
Project description
Python client for Apache Hadoop® YARN API
Package documentation: python-client-for-hadoop-yarn-api.readthedocs.org
REST API documentation: hadoop.apache.org
Installation
From PyPI
pip install yarn-api-client
From Anaconda (conda forge)
conda install -c conda-forge yarn-api-client
From source code
git clone https://github.com/toidi/hadoop-yarn-api-python-client.git pushd hadoop-yarn-api-python-client python setup.py install popd
Enabling support for Kerberos/SPNEGO Security
To avoid deployment issues on a non Kerberized environment, the requests_kerberos dependency is optional and needs to be explicit installed in order to enable access to YARN console protected by Kerberos/SPNEGO.
pip install requests_kerberos
Usage
CLI interface
bin/yarn_client --help
alternative
python -m yarn_api_client --help
Programmatic interface
from yarn_api_client import ApplicationMaster, HistoryServer, NodeManager, ResourceManager
Changelog
- 0.3.6 Release
Extend ResourceManager to allow applications to better determine resource availability prior to submission.
- 0.3.5 Release
Hotfix release to fix internal signature mismatch
- 0.3.4 Release
More flexible support for discovering Hadoop configuration including multiple Resource Managers when HA is configured
Properly support YARN post response codes
- 0.3.3 Release
Properly set Content-Type in PUT requests
Check for HADOOP_CONF_DIR env variable
- 0.3.2 Release
Make Kerberos/SPNEGO dependency optional
- 0.3.1 Release
Fix cluster_application_kill API
- 0.3.0 Release
Add support for YARN endpoints protected by Kerberos/SPNEGO
Moved to requests package for REST API invocation
Remove http_con property, as connections are now managed by requests package
- 0.2.5 Release
Fixed History REST API
- 0.2.4 Release
Added compatibility with HA enabled Resource Manager
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for yarn-api-client-0.3.7.dev0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 9cebdb085feb58a87ba999447a8a6f57fb34175e6d2eb0daaba1e4ba94797633 |
|
MD5 | f2874ceda28c1f82dec1d5bb8136cc16 |
|
BLAKE2b-256 | 28311fcad105847abe2da6831e328ab14bec26411ee113098c0ae8a12006a6fd |
Hashes for yarn_api_client-0.3.7.dev0-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b795b1962d7af4cb397f921b9ef09163f27cec5d81e7b929c85bb0882aded8ed |
|
MD5 | 6958917f10653109719c2f9dd2bfb2fa |
|
BLAKE2b-256 | b52e2828bdc293a96f2ea76176eaa346feaef5189407625ca50236ec9c7e5337 |