Python client for Hadoop® YARN API
Project description
Python client for Apache Hadoop® YARN API
Package documentation: python-client-for-hadoop-yarn-api.readthedocs.org
REST API documentation: hadoop.apache.org
Installation
From PyPI
pip install yarn-api-client
From Anaconda (conda forge)
conda install -c conda-forge yarn-api-client
From source code
git clone https://github.com/toidi/hadoop-yarn-api-python-client.git pushd hadoop-yarn-api-python-client python setup.py install popd
Enabling support for Kerberos/SPNEGO Security
To avoid deployment issues on a non Kerberized environment, the requests_kerberos dependency is optional and needs to be explicit installed in order to enable access to YARN console protected by Kerberos/SPNEGO.
pip install requests_kerberos
Usage
CLI interface
bin/yarn_client --help
alternative
python -m yarn_api_client --help
Programmatic interface
from yarn_api_client import ApplicationMaster, HistoryServer, NodeManager, ResourceManager
Changelog
- 0.3.6 Release
Extend ResourceManager to allow applications to better determine resource availability prior to submission.
- 0.3.5 Release
Hotfix release to fix internal signature mismatch
- 0.3.4 Release
More flexible support for discovering Hadoop configuration including multiple Resource Managers when HA is configured
Properly support YARN post response codes
- 0.3.3 Release
Properly set Content-Type in PUT requests
Check for HADOOP_CONF_DIR env variable
- 0.3.2 Release
Make Kerberos/SPNEGO dependency optional
- 0.3.1 Release
Fix cluster_application_kill API
- 0.3.0 Release
Add support for YARN endpoints protected by Kerberos/SPNEGO
Moved to requests package for REST API invocation
Remove http_con property, as connections are now managed by requests package
- 0.2.5 Release
Fixed History REST API
- 0.2.4 Release
Added compatibility with HA enabled Resource Manager
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for yarn_api_client-0.3.7-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 18ac2dd1652e71f2bccd269651441a9890b62b467e8d6cc114f0394a51634865 |
|
MD5 | 875e1296898f3462ac9cdda69c70d230 |
|
BLAKE2b-256 | 3206c9b2c0551e69cd6e1a8307213795b98a28b10fb21f132685b9c25c016430 |