A serverless application framework for large-scale data management and AI model serving.
Project description
Hypha
Hypha is an application framework for large-scale data management and AI model serving, it allows creating computational platforms consists of computational and user interface components.
Hypha server act as a hub for connecting different components through hypya-rpc.
Change log
0.20.12
- New Feature: In order to support large language models' function calling feature, hypha support built-in type annotation. With
hypha-rpc>=0.20.12
, we also support type annotation for the service functions in JSON Schema format. In Python, you can usePydantic
or simple python type hint, or directly write the json schema for Javascript service functions. This allows you to specify the inputs spec for functions. - Add type support for the
hypha
module. It allows you to register a type in the workspace usingregister_service_type
,get_service_type
,list_service_types
. When registering a new service, you can specify the type and enable type check for the service. The type check will be performed when calling the service function. The type check is only available in Python. - Fix reconnecton issue in the client.
- Support case conversion, which allows converting the service functions to snake_case or camelCase in
get_service
(Python) orgetService
(JavaScript). - Breaking Changes: In Python, all the function names uses snake case, and in JavaScript, all the function names uses camel case. For example, you should call
server.getService
instead ofserver.get_service
in JavaScript, andserver.get_service
instead ofserver.getService
in Python. - Breaking Changes: The new version of Hypha (0.20.0+) improves the RPC connection to make it more stable and secure, most importantly it supports automatic reconnection when the connection is lost. This also means breaking changes to the previous version. In the new version you will need a new library called
hypha-rpc
(instead of the hypha submodule in theimjoy-rpc
module) to connect to the server.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
hypha-0.20.12.tar.gz
(98.0 kB
view hashes)
Built Distribution
hypha-0.20.12-py3-none-any.whl
(120.5 kB
view hashes)