A Pyodide python http client library and utilities for communicating with Triton Inference Server (based on tritonclient from NVIDIA)

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for oeway from gravatar.com oeway

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: BSD License (BSD)
  • Author: Wei OUYANG
  • Tags http , triton , tensorrt , inference , server , service , client , nvidia
Classifiers
Report project as malware

Project description

This is a simplified implemetation of the triton client from NVIDIA, it is mainly made for running in the web browser with pyodide.It only implement the http client, and most of the API remains the same but changed into async.For example, instead of doing client.infer(...), you need to do await client.infer(...).See download-using-python-package-installer-pip for package details.

The client examples demonstrate how to use the package to issue request to triton inference server.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page