@huggingface/inference

项目介绍

A Typescript powered wrapper that provides a unified interface to run inference across multiple services for models hosted on the Hugging Face Hub:

❗Important note: Always pass an access token. Join Hugging Face and then visit access tokens to generate your access token for free.

Your access token should be kept private. If you need to protect it in front-end applications, we suggest setting up a proxy server that stores the access token.

You can send inference requests to third-party providers with the inference client.

To send requests to a third-party provider, you have to pass the provider parameter to the inference function. The default value of the provider parameter is "auto",…