Available LLM integrationsο We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more. AI21ο AI21 Anthropicο Anthropic AnyScaleο Anyscale Bedrockο Bedrock Connect to Bedrock with Access Keys Clarifaiο Clarifai LLM EverlyAIο EverlyAI Gradientο Gradient Base Model Gradient Model Adapter Hugging Faceο HuggingFace LLM - Camel-5b HuggingFace LLM - StableLM Local Llama2 + VectorStoreIndex Konkoο LangChainο LangChain LLM LiteLLMο LiteLLM Llama APIο Llama API Llama CPPο LlamaCPP LocalAIο LocalAI MonsterAPIο Monster API LLM Integration into LLamaIndex Ollamaο Ollama - Llama 2 7B OpenAIο OpenAI Azure OpenAI OpenLLMο OpenLLM PaLMο PaLM Perplexityο Perplexity Portkeyο Portkey Predibaseο Predibase Replicateο Replicate - Llama 2 13B Replicate - Vicuna 13B Llama2 + VectorStoreIndex RunGPTο RunGPT Setup Vertexο Getting Started Streaming Usage Chat Usage Async Chat Streaming Chat Xorbits Inferenceο Xorbits Inference