Available LLM integrations

We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more.

• AI21
• Anthropic
• AnyScale
• Azure OpenAI
• Bedrock
• Clarifai
• Cohere
• Dashscope
• Dashscope Multi-Modal
• EverlyAI
• Fireworks
• Friendli
• Gradient
• Gradient Model Adapter
• Groq
• HuggingFace Camel-7B
• HuggingFace StableLM
• HuggingFace Llama2
• Konko
• LangChain
• LiteLLM
• Llama API
• Llama CPP
• LocalAI
• MariTalk
• MistralAI
• Modelscope
• MonsterAPI
• MyMagic
• NeutrinoAI
• Nvidia TensorRT-LLM
• Nvidia Triton
• Ollama
• OpenAI
• OpenLLM
• OpenRouter
• PaLM
• Perplexity
• Pipeshift
• PremAI
• Portkey
• Predibase
• Replicate Llama2
• Replicate Vicuna
• Replicate Vector Index Llama2
• RunGPT
• SageMaker
• SambaNova Systems
• Solar
• Together.ai
• Unify AI
• Upstage
• Vertex
• vLLM
• Xorbits Inference
• Yi