Available LLM integrations# We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more. AI21# AI21 Anthropic# Anthropic Anthropic Haiku Cookbook AnyScale# Anyscale Bedrock# Bedrock Connect to Bedrock with Access Keys Clarifai# Clarifai LLM Cohere# Cohere Dashscope# DashScope LLMS Multi-Modal LLM using DashScope qwen-vl model for image reasoning EverlyAI# EverlyAI Fireworks# Fireworks Friendli# Friendli Gradient# Gradient Base Model Gradient Model Adapter Groq# Groq Hugging Face# HuggingFace LLM - Camel-5b HuggingFace LLM - StableLM Local Llama2 + VectorStoreIndex Konko# Konko LangChain# LangChain LLM LiteLLM# LiteLLM Llama API# Llama API Llama CPP# LlamaCPP LocalAI# LocalAI MariTalk# Maritalk MistralAI# MistralAI MistralAI Cookbook PremAI# PremAI LlamaIndex MonsterAPI# Monster API <> LLamaIndex MyMagic# MyMagic AI LLM NeutrinoAI# Neutrino AI Nvidia TensorRT-LLM# Nvidia TensorRT-LLM Nvidia Triton# Nvidia Triton Ollama# Ollama - Llama 2 7B OpenAI# OpenAI Azure OpenAI OpenLLM# OpenLLM OpenRouter# OpenRouter PaLM# PaLM Perplexity# Perplexity Portkey# Portkey Predibase# Predibase Replicate# Replicate - Llama 2 13B Replicate - Vicuna 13B Llama2 + VectorStoreIndex RunGPT# RunGPT Setup SageMaker# Interacting with LLM deployed in Amazon SageMaker Endpoint with LlamaIndex Solar# Solar LLM Together.ai# Together AI LLM Vertex# Vertex AI Basic auth example for service account Streaming Usage Chat Usage Async Chat Streaming Chat Gemini Models vLLM# Install Vllm Orca-7b Completion Example LLama-2-7b Completion Example mistral chat 7b Completion Example Api Response Xorbits Inference# Xorbits Inference ModelScope# ModelScope LLMS