Available LLM integrations# We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more. AI21# AI21 Anthropic# Anthropic AnyScale# Anyscale Bedrock# Bedrock Connect to Bedrock with Access Keys Clarifai# Clarifai LLM Cohere# Cohere EverlyAI# EverlyAI Gradient# Gradient Base Model Gradient Model Adapter Hugging Face# HuggingFace LLM - Camel-5b HuggingFace LLM - StableLM Local Llama2 + VectorStoreIndex Konko# Konko LangChain# LangChain LLM LiteLLM# LiteLLM Llama API# Llama API Llama CPP# LlamaCPP LocalAI# LocalAI MistralAI# MistralAI MonsterAPI# Monster API <> LLamaIndex NeutrinoAI# Neutrino AI Nvidia TensorRT-LLM# Nvidia TensorRT-LLM Nvidia Triton# Nvidia Triton Ollama# Ollama - Llama 2 7B OpenAI# OpenAI Azure OpenAI OpenLLM# OpenLLM OpenRouter# OpenRouter PaLM# PaLM Perplexity# Perplexity Portkey# Portkey Predibase# Predibase Replicate# Replicate - Llama 2 13B Replicate - Vicuna 13B Llama2 + VectorStoreIndex RunGPT# RunGPT Setup SageMaker# Interacting with LLM deployed in Amazon SageMaker Endpoint with LlamaIndex Together.ai# Together AI LLM Vertex# Getting Started Basic auth example for service account Streaming Usage Chat Usage Async Chat Streaming Chat Gemini Models vLLM# Install Vllm Orca-7b Completion Example LLama-2-7b Completion Example mistral chat 7b Completion Example Api Response Xorbits Inference# Xorbits Inference