Providers | liteLLM

📄️ Huggingface

LiteLLM supports Huggingface Inference Endpoints that uses the text-generation-inference format.

LiteLLM supports OpenAI Chat + Text completion and embedding calls.

LiteLLM supports Azure Chat + Embedding calls.

LiteLLM supports chat-bison, chat-bison@001, text-bison, text-bison@001

LiteLLM supports Claude-1, 1.2 and Claude-2.

LiteLLM supports all models on VLLM.

LiteLLM supports j2-light, j2-mid and j2-ultra from AI21.

LiteLLM supports all models on Replicate

LiteLLM supports 'command', 'command-light', 'command-medium', 'command-medium-beta', 'command-xlarge-beta', 'command-nightly' models from Cohere.

LiteLLM supports all models on Together AI.

LiteLLM supports Llama2 on Sagemaker

LiteLLM supports all models from Aleph Alpha.

LiteLLM supports any Text-Gen-Interface models on Baseten.

LiteLLM supports all the text models from OpenRouter

LiteLLM supports all models from Ollama

LiteLLM supports Custom deploy api endpoints

LiteLLM allows you to call your OpenAI ChatCompletion proxy server