Contents Menu Expand Light mode Dark mode Auto light/dark mode
LlamaIndex 🦙 0.9.9
LlamaIndex 🦙 0.9.9

Getting Started

  • Installation and Setup
  • How to read these docs
  • Starter Tutorial
  • High-Level Concepts
  • Customization Tutorial
  • Discover LlamaIndex Video Series

Use Cases

  • Q&A
  • Chatbots
  • Agents
  • Structured Data Extraction
  • Multi-modal
    • Advanced Multi-Modal Retrieval using GPT4V and Multi-Modal Index/Retriever
    • Multi-modal retrieval with CLIP
    • Image to Image Retrieval
    • Retrieval-Augmented Image Captioning
    • Multi-Modal LLM using Replicate LlaVa, Fuyu 8B, MiniGPT4 models for image reasoning
    • GPT4-V:
    • OpenAI Multi-Modal GPT4V Pydantic Program
    • GPT4-V Experiments with General, Specific questions and Chain Of Thought (COT) Prompting Technique.
    • Evaluating Multi-Modal RAG
    • Chroma Multi-Modal Demo with LlamaIndex

Understanding

  • Building an LLM application
  • Using LLMs
    • Privacy and Security
  • Loading
    • LlamaHub
  • Indexing
  • Storing
  • Querying
  • Putting It All Together
    • Q&A patterns
      • A Guide to Extracting Terms and Definitions
      • A Guide to Creating a Unified Query Framework over your Indexes
      • Knowledge Graphs
      • Structured Data
      • A Guide to LlamaIndex + Structured Data
      • Airbyte SQL Index Guide
    • Full-Stack Web Application
      • A Guide to Building a Full-Stack Web App with LLamaIndex
      • A Guide to Building a Full-Stack LlamaIndex Web App with Delphic
    • How to Build a Chatbot
    • Agents
    • Full-Stack Projects
      • create-llama Blog
      • create-llama Repo
      • create-llama Additional Templates
      • SEC Insights App
      • SEC Insights Repo
      • Chat LlamaIndex App
      • Chat LlamaIndex Repo
      • RAGs Repo
  • Tracing and Debugging
  • Evaluating
    • Cost Analysis
      • Usage Pattern

Optimizing

  • Basic Strategies
    • Accessing/Customizing Prompts within Higher-Level Modules
    • Advanced Prompt Techniques (Variable Mappings, Functions)
    • Advanced Prompt Techniques (Variable Mappings, Functions)
    • Prompt Engineering for RAG
    • BM25 Retriever
    • Reciprocal Rerank Fusion Retriever
    • Weaviate Vector Store - Hybrid Search
    • Pinecone Vector Store - Hybrid Search
    • Vector Store Index
    • Defining and Customizing Documents
    • Defining and Customizing Nodes
    • Metadata Extraction Usage Pattern
      • Extracting Metadata for Better Document Indexing and Understanding
      • Automated Metadata Extraction for Better Retrieval + Synthesis
      • Entity Metadata Extraction
      • Metadata Extraction and Augmentation w/ Marvin
      • Pydantic Extractor
  • Advanced Retrieval Strategies
    • Query Transformations
      • HyDE Query Transform
      • Multi-Step Query Engine
    • Pydantic Program
      • OpenAI Pydantic Program
      • Guidance Pydantic Program
      • Guidance for Sub-Question Query Engine
      • DataFrame Structured Data Extraction
      • Evaporate Demo
    • Query Engines + Pydantic Outputs
      • Query Engine with Pydantic Outputs
      • Pydantic Tree Summarize
      • Download Data
    • Structured Outputs
      • Pydantic Program
        • OpenAI Pydantic Program
        • Guidance Pydantic Program
        • Guidance for Sub-Question Query Engine
        • DataFrame Structured Data Extraction
        • Evaporate Demo
      • Query Engines + Pydantic Outputs
        • Query Engine with Pydantic Outputs
        • Pydantic Tree Summarize
        • Download Data
    • DeepMemory (Activeloop)
  • Agentic strategies
    • Build your own OpenAI Agent
    • OpenAI Agent with Query Engine Tools
    • Retrieval-Augmented OpenAI Agent
    • OpenAI Agent + Query Engine Experimental Cookbook
    • OpenAI Agent Query Planning
    • Context-Augmented OpenAI Agent
  • Evaluation
    • End-to-End Evaluation
      • QuestionGeneration
      • BatchEvalRunner - Running Multiple Evaluations
      • Correctness Evaluator
      • Faithfulness Evaluator
      • Guideline Evaluator
      • Pairwise Evaluator
      • Relevancy Evaluator
      • Embedding Similarity Evaluator
    • Component Wise Evaluation
      • BEIR Out of Domain Benchmark
      • HotpotQADistractor Demo
    • Evaluating
      • Usage Pattern (Response Evaluation)
      • Usage Pattern (Retrieval)
      • Modules
        • Faithfulness Evaluator
        • Relevancy Evaluator
        • Guideline Evaluator
        • Correctness Evaluator
        • Embedding Similarity Evaluator
        • LlamaIndex + DeepEval Integration
        • QuestionGeneration
        • BatchEvalRunner - Running Multiple Evaluations
        • Evaluating Multi-Modal RAG
        • Retrieval Evaluation
    • Component Wise Evaluation
      • BEIR Out of Domain Benchmark
      • HotpotQADistractor Demo
    • End-to-End Evaluation
      • QuestionGeneration
      • BatchEvalRunner - Running Multiple Evaluations
      • Correctness Evaluator
      • Faithfulness Evaluator
      • Guideline Evaluator
      • Pairwise Evaluator
      • Relevancy Evaluator
      • Embedding Similarity Evaluator
  • Fine-tuning
    • Fine-tuning an Adapter
    • Embedding Fine-tuning Guide
    • Router Fine-tuning
    • Embedding Fine-tuning Repo
    • Embedding Fine-tuning Blog
    • GPT-3.5 Fine-tuning Notebook (Colab)
    • GPT-3.5 Fine-tuning Notebook (Notebook link)
    • Fine-tuning a gpt-3.5 ReAct Agent on Better Chain of Thought
    • [WIP] Function Calling Fine-tuning
    • GPT-3.5 Fine-tuning Notebook (Colab)
    • GPT-3.5 Fine-tuning Notebook (in Repo)
    • Fine-tuning with Retrieval Augmentation
    • OpenAI Function Calling Fine-tuning
    • Llama2 Structured Output Fine-tuning
    • Fine-tuning to Memorize Knowledge
    • Llama 2 Text-to-SQL Fine-tuning (w/ Gradient.AI)
    • Llama 2 Text-to-SQL Fine-tuning (w/ Modal, Repo)
    • Llama 2 Text-to-SQL Fine-tuning (w/ Modal, Notebook)
    • Knowledge Distillation For Fine-Tuning A GPT-3.5 Judge (Correctness)
    • Knowledge Distillation For Fine-Tuning A GPT-3.5 Judge (Pairwise)
    • Cross-Encoder Finetuning
    • Finetuning Llama 2 for Text-to-SQL
    • Finetuning GPT-3.5 to Distill GPT-4
    • Cohere Custom Reranker
  • Building Performant RAG Applications for Production
    • Recursive Retriever + Query Engine Demo
    • Document Summary Index
    • Metadata Replacement + Node Sentence Window
    • Auto-Retrieval from a Vector Database
    • Document Summary Index
    • Recursive Retriever + Document Agents
    • Comparing Methods for Structured Retrieval (Auto-Retrieval vs. Recursive Retrieval)
    • Sub Question Query Engine
    • Joint QA Summary Query Engine
    • Recursive Retriever + Document Agents
    • Router Query Engine
    • OpenAI Agent + Query Engine Experimental Cookbook
    • OpenAI Agent Query Planning
    • Embedding Fine-tuning Guide
  • Building RAG from Scratch (Lower-Level)
    • Building Data Ingestion from Scratch
    • Pinecone
    • OpenAI
    • Building Retrieval from Scratch
    • Building RAG from Scratch (Open-source only!)
    • Building a (Very Simple) Vector Store from Scratch
    • Building Response Synthesis from Scratch
    • Building Evaluation from Scratch
    • Building a Router from Scratch
    • Building an Advanced Fusion Retriever from Scratch

Module Guides

  • Models
    • Using LLMs
      • Using LLMs as standalone modules
      • Customizing LLMs within LlamaIndex Abstractions
      • Available LLM integrations
        • AI21
        • Anthropic
        • Anyscale
        • Bedrock
        • Connect to Bedrock with Access Keys
        • Clarifai LLM
        • EverlyAI
        • Gradient Base Model
        • Gradient Model Adapter
        • HuggingFace LLM - Camel-5b
        • HuggingFace LLM - StableLM
        • Local Llama2 + VectorStoreIndex
        • LangChain LLM
        • LiteLLM
        • Llama API
        • LlamaCPP
        • LocalAI
        • Monster API LLM Integration into LLamaIndex
        • Ollama - Llama 2 7B
        • OpenAI
        • Azure OpenAI
        • OpenLLM
        • PaLM
        • Perplexity
        • Portkey
        • Predibase
        • Replicate - Llama 2 13B
        • Replicate - Vicuna 13B
        • Llama2 + VectorStoreIndex
        • RunGPT
        • Setup
        • Getting Started
        • Streaming Usage
        • Chat Usage
        • Async Chat
        • Streaming Chat
        • Xorbits Inference
      • Embeddings
        • OpenAI Embeddings
        • Langchain Embeddings
        • CohereAI Embeddings
        • Qdrant FastEmbed Embeddings
        • Gradient Embeddings
        • Azure OpenAI
        • Custom Embeddings
        • Local Embeddings with HuggingFace
        • Elasticsearch Embeddings
        • Embeddings with Clarifai
        • LLMRails Embeddings
        • Text Embedding Inference
        • Google PaLM Embeddings
        • Jina Embeddings
        • Voyage Embeddings
      • Prompts
        • Usage Pattern
        • Completion prompts
        • Chat prompts
        • Accessing/Customizing Prompts within Higher-Level Modules
        • Advanced Prompt Techniques (Variable Mappings, Functions)
        • Prompt Engineering for RAG
        • “Optimization by Prompting” for RAG
        • EmotionPrompt in RAG
      • Using local models
      • Run Llama2 locally
    • Embeddings
      • OpenAI Embeddings
      • Langchain Embeddings
      • CohereAI Embeddings
      • Qdrant FastEmbed Embeddings
      • Gradient Embeddings
      • Azure OpenAI
      • Custom Embeddings
      • Local Embeddings with HuggingFace
      • Elasticsearch Embeddings
      • Embeddings with Clarifai
      • LLMRails Embeddings
      • Text Embedding Inference
      • Google PaLM Embeddings
      • Jina Embeddings
      • Voyage Embeddings
    • [Beta] Multi-modal models
      • Multi-Modal LLM using OpenAI GPT-4V model for image reasoning
      • Multi-Modal LLM using Replicate LlaVa, Fuyu 8B, MiniGPT4 models for image reasoning
      • Multi-Modal Retrieval using GPT text embedding and CLIP image embedding for Wikipedia Articles
      • Retrieval-Augmented Image Captioning
      • Image to Image Retrieval using CLIP embedding and image correlation reasoning using GPT4V
      • Advanced Multi-Modal Retrieval using GPT4V and Multi-Modal Index/Retriever
      • GPT4-V Experiments with General, Specific questions and Chain Of Thought (COT) Prompting Technique.
      • Chroma Multi-Modal Demo with LlamaIndex
      • Evaluating Multi-Modal RAG
  • Prompts
    • Usage Pattern
    • Completion prompts
    • Chat prompts
    • Accessing/Customizing Prompts within Higher-Level Modules
    • Advanced Prompt Techniques (Variable Mappings, Functions)
    • Prompt Engineering for RAG
    • “Optimization by Prompting” for RAG
    • EmotionPrompt in RAG
  • Loading
    • Data Connectors (LlamaHub)
      • Usage Pattern
      • Module Guides
        • Simple Directory Reader
        • Psychic Reader
        • DeepLake Reader
        • Qdrant Reader
        • Discord Reader
        • MongoDB Reader
        • Chroma Reader
        • MyScale Reader
        • Faiss Reader
        • Obsidian Reader
        • Slack Reader
        • Web Page Reader
        • Pinecone Reader
        • Mbox Reader
        • MilvusReader
        • Notion Reader
        • Github Repo Reader
        • Google Docs Reader
        • Database Reader
        • Twitter Reader
        • Weaviate Reader
        • Make Reader
        • Deplot Reader Demo
    • Documents / Nodes
      • Defining and Customizing Documents
      • Defining and Customizing Nodes
    • Node Parser Usage Pattern
      • Node Parser Modules
    • Ingestion Pipeline
      • Transformations
      • Advanced Ingestion Pipeline
      • Async Ingestion Pipeline + Metadata Extraction
  • Indexing
    • How Each Index Works
    • Usage Pattern
      • Metadata Extraction
        • Extracting Metadata for Better Document Indexing and Understanding
        • Automated Metadata Extraction for Better Retrieval + Synthesis
        • Entity Metadata Extraction
        • Metadata Extraction and Augmentation w/ Marvin
        • Pydantic Extractor
      • Document Management
    • Module Guides
      • Vector Store Index
      • Summary Index
      • Tree Index
      • Keyword Table Index
      • Knowledge Graph Index
      • Custom Retriever combining KG Index and VectorStore Index
      • Knowledge Graph Query Engine
      • Knowledge Graph RAG Query Engine
      • REBEL + Knowledge Graph Index
      • REBEL + Wikipedia Filtering
      • SQL Index
      • SQL Query Engine with LlamaIndex + DuckDB
      • Document Summary Index
      • The ObjectIndex Class
    • Composability
      • Composable Graph Basic
      • Composable Graph with Weaviate
      • Composable Graph
  • Storing
    • Customizing Storage
    • Persisting & Loading Data
    • Vector Stores
      • Astra DB
      • Simple Vector Store - Async Index Creation
      • Azure CosmosDB MongoDB Vector Store
      • Cassandra Vector Store
      • Chroma
      • Azure Cognitive Search
      • Basic Example
      • Create Index (if it does not exist)
      • Use Existing Index
      • Adding a document to existing index
      • Filtering
      • DashVector Vector Store
      • DeepLake Vector Store
      • DocArray Hnsw Vector Store
      • DocArray InMemory Vector Store
      • Epsilla Vector Store
      • LanceDB Vector Store
      • Metal Vector Store
      • Milvus Vector Store
      • MyScale Vector Store
      • Elasticsearch Vector Store
      • Faiss Vector Store
      • MongoDB Atlas
      • Neo4j vector store
      • Opensearch Vector Store
      • Pinecone Vector Store
      • Pinecone Vector Store - Hybrid Search
      • pgvecto.rs
      • Postgres Vector Store
      • Redis Vector Store
      • Query the data
      • Working with Metadata
      • Qdrant Vector Store
      • Rockset Vector Store
      • Simple Vector Store
      • Supabase Vector Store
      • Tair Vector Store
      • Tencent Cloud VectorDB
      • Timescale Vector Store (PostgreSQL)
      • Weaviate Vector Store
      • Weaviate Vector Store - Hybrid Search
      • Zep Vector Store
      • Create a Zep Vector Store and Index
      • Querying with Metadata filters
    • Document Stores
    • Index Stores
    • Key-Value Stores
    • Using Graph Stores
      • Neo4j Graph Store
      • Nebula Graph Store
      • Knowledge Graph Query Engine
      • Kuzu Graph Store
      • FalkorDB Graph Store
  • Querying
    • Query Engine
      • Usage Pattern
        • Response Modes
        • Streaming
      • Module Guides
        • Custom Query Engine
        • Retriever Query Engine
        • Text-to-SQL Guide (Query Engine + Retriever)
        • JSON Query Engine
        • Pandas Query Engine
        • Knowledge Graph Query Engine
        • Knowledge Graph RAG Query Engine
        • Router Query Engine
        • Retriever Router Query Engine
        • Joint QA Summary Query Engine
        • Sub Question Query Engine
        • Multi-Step Query Engine
        • SQL Router Query Engine
        • SQL Auto Vector Query Engine
        • SQL Join Query Engine
        • [Beta] Text-to-SQL with PGVector
        • SQL Query Engine with LlamaIndex + DuckDB
        • Retry Query Engine
        • CitationQueryEngine
        • Recursive Retriever + Query Engine Demo
        • Joint Tabular/Semantic QA over Tesla 10K
        • Recursive Retriever + Document Agents
        • Ensemble Query Engine Guide
        • Sub Question Query Engine
        • Recursive Retriever + Document Agents
        • Multi-Document Agents
        • Multi-Document Agents (V1)
        • FLARE Query Engine
      • Supporting Modules
        • Query Transformations
          • HyDE Query Transform
          • Multi-Step Query Engine
    • Chat Engine
      • Usage Pattern
      • Module Guides
        • ReAct Chat Engine
        • OpenAI Chat Engine
        • Condense Question Chat Engine
        • Context Chat Engine
        • Context Plus Condense Chat Engine
        • Simple Chat Engine
    • Data Agents
      • Usage Pattern
      • Module Guides
        • Build your own OpenAI Agent
        • OpenAI Agent with Query Engine Tools
        • Retrieval-Augmented OpenAI Agent
        • OpenAI Agent + Query Engine Experimental Cookbook
        • OpenAI Agent Query Planning
        • Context-Augmented OpenAI Agent
        • Recursive Retriever + Document Agents
        • Multi-Document Agents
        • GPT Builder Demo
        • Single-Turn Multi-Function Calling OpenAI Agents
        • OpenAI Assistant Agent
        • Benchmarking OpenAI Retrieval API (through Assistant Agent)
        • OpenAI Assistant Advanced Retrieval Cookbook
        • ReAct Agent with Query Engine Tools
      • Tools
        • Usage Pattern
        • LlamaHub Tools Guide
    • Retriever
      • Retriever Modes
      • Retriever Modules
        • Define Custom Retriever
        • BM25 Hybrid Retriever
        • Simple Fusion Retriever
        • Reciprocal Rerank Fusion Retriever
        • Custom Retriever (KG Index and Vector Store Index)
        • Knowledge Graph RAG Retriever
        • Simple Fusion Retriever
        • Reciprocal Rerank Fusion Retriever
        • Auto-Retrieval (with Chroma)
        • Auto-Retrieval (with BagelDB)
        • Recursive Retriever + Query Engine Demo
        • Router Retriever
        • Ensemble Retrieval Guide
        • Auto Merging Retriever
        • Recursive Retriever + Node References
        • Recursive Retriever + Node References + Braintrust
        • Metadata Replacement + Node Sentence Window
        • Text-to-SQL Guide (Query Engine + Retriever)
        • DeepMemory (Activeloop)
    • Response Synthesizer
      • Response Synthesis Modules
        • Refine
        • Refine with Structured Answer Filtering
        • Tree Summarize
        • Pydantic Tree Summarize
    • Routers
      • Router Query Engine
      • Retriever Router Query Engine
      • SQL Router Query Engine
      • Router Retriever
    • Node Postprocessor
      • Node Postprocessor Modules
        • Sentence Embedding Optimizer
        • Cohere Rerank
        • LLM Reranker Demonstration (2021 Lyft 10-k)
        • LLM Reranker Demonstration (Great Gatsby)
        • Recency Filtering
        • Time-Weighted Rerank
        • PII Masking
        • Forward/Backward Augmentation
        • Metadata Replacement + Node Sentence Window
        • LongContextReorder
    • Output Parsing Modules
      • Guardrails Output Parsing
      • Langchain Output Parsing
      • Guidance Pydantic Program
      • Guidance for Sub-Question Query Engine
      • OpenAI Pydantic Program
  • Observability
    • Wandb Callback Handler
    • Arize Phoenix Tracing Tutorial
    • OpenInference Callback Handler + Arize Phoenix
    • Evaluating Search and Retrieval with Arize Phoenix
    • Evaluating and Tracking with TruLens
    • Quickstart Guide with LlamaIndex + TruLens
    • Colab
    • HoneyHive LlamaIndex Tracer
    • PromptLayer Handler
    • Callbacks
      • Token Counting Handler
      • Llama Debug Handler
      • Wandb Callback Handler
      • Aim Callback
      • OpenInference Callback Handler + Arize Phoenix
      • Token Counting - Migration Guide
  • Evaluating
    • Usage Pattern (Response Evaluation)
    • Usage Pattern (Retrieval)
    • Modules
      • Faithfulness Evaluator
      • Relevancy Evaluator
      • Guideline Evaluator
      • Correctness Evaluator
      • Embedding Similarity Evaluator
      • LlamaIndex + DeepEval Integration
      • QuestionGeneration
      • BatchEvalRunner - Running Multiple Evaluations
      • Evaluating Multi-Modal RAG
      • Retrieval Evaluation
  • Supporting Modules
    • ServiceContext

API Reference

  • API Reference
    • Callbacks
    • Composability
    • Evaluation
    • Example Notebooks
    • Finetuning
    • Indices
      • Summary Index
      • Table Index
      • Tree Index
      • Vector Store Index
      • Structured Store Index
      • Knowledge Graph Index
      • Empty Index
    • LLM Predictors
    • LLMs
      • Anthropic
      • Azure OpenAI
      • HuggingFaceLLM
      • LangChainLLM
      • Gradient Base Model
      • Gradient Model Adapter
      • LiteLLM
      • LlamaCPP
      • OpenAI
      • OpenAILike
      • OpenLLM
      • PaLM
      • Predibase
      • Replicate
      • XOrbits Xinference
    • Memory
    • Node Postprocessor
    • Node
      • BaseComponent
      • BaseNode
      • Document
      • ImageDocument
      • ImageNode
      • IndexNode
      • MetadataMode
      • Node
      • NodeRelationship
      • NodeWithScore
      • ObjectType
      • QueryBundle
      • RelatedNodeInfo
      • TextNode
      • TransformComponent
    • Playground
    • Prompt Templates
    • Querying an Index
      • Retrievers
        • Empty Index Retriever
        • Knowledge Graph Retriever
        • List Retriever
        • Keyword Table Retrievers
        • Tree Retrievers
        • Vector Store Retrievers
        • Transform Retriever
      • Response Synthesizer
      • Query Engines
        • Graph Query Engine
        • Multistep Query Engine
        • Retriever Query Engine
        • Transform Query Engine
        • Router Query Engine
        • Retriever Router Query Engine
        • Sub Question Query Engine
        • SQL Join Query Engine
        • Flare Query Engine
        • Citation Query Engine
        • Knowledge Graph Query Engine
        • SQL Query Engine
        • Pandas Query Engine
      • Chat Engines
        • Simple Chat Engine
        • Condense Question Chat Engine
        • Condense Plus Context Chat Engine
      • Query Bundle
      • Query Transform
    • Data Connectors
      • download_loader
      • WikipediaReader
      • YoutubeTranscriptReader
      • SimpleDirectoryReader
      • JSONReader
      • SimpleMongoReader
      • NotionPageReader
      • GoogleDocsReader
      • MetalReader
      • DiscordReader
      • SlackReader
      • WeaviateReader
      • PineconeReader
      • PsychicReader
      • QdrantReader
      • MilvusReader
      • ChromaReader
      • DeepLakeReader
      • FaissReader
      • MyScaleReader
      • StringIterableReader
      • SimpleWebPageReader
      • BeautifulSoupWebReader
      • TrafilaturaWebReader
      • RssReader
      • MakeWrapper
      • TwitterTweetReader
      • ObsidianReader
      • GithubRepositoryReader
      • MboxReader
      • ElasticsearchReader
      • SteamshipFileReader
      • ChatGPTRetrievalPluginReader
      • BagelReader
      • HTMLTagReader
      • ReaderConfig
      • PDFReader
      • DashVectorReader
    • Response
    • Service Context
      • Embeddings
      • OpenAIEmbedding
      • HuggingFaceEmbedding
      • OptimumEmbedding
      • InstructorEmbedding
      • LangchainEmbedding
      • GoogleUnivSentEncoderEmbedding
      • Node Parser
        • get_leaf_nodes
        • get_root_nodes
        • TokenTextSplitter
        • SentenceSplitter
        • CodeSplitter
        • SimpleFileNodeParser
        • HTMLNodeParser
        • MarkdownNodeParser
        • JSONNodeParser
        • SentenceWindowNodeParser
        • NodeParser
        • HierarchicalNodeParser
        • TextSplitter
        • MetadataAwareTextSplitter
        • LangchainNodeParser
        • UnstructuredElementNodeParser
        • SimpleNodeParser
      • PromptHelper
      • LLMs
        • Anthropic
        • Azure OpenAI
        • HuggingFaceLLM
        • LangChainLLM
        • Gradient Base Model
        • Gradient Model Adapter
        • LiteLLM
        • LlamaCPP
        • OpenAI
        • OpenAILike
        • OpenLLM
        • PaLM
        • Predibase
        • Replicate
        • XOrbits Xinference
    • Embeddings
    • OpenAIEmbedding
    • HuggingFaceEmbedding
    • OptimumEmbedding
    • InstructorEmbedding
    • LangchainEmbedding
    • GoogleUnivSentEncoderEmbedding
    • Storage Context
      • Document Store
      • Index Store
      • Vector Store
        • ElasticsearchStore
        • SimpleVectorStore
        • RedisVectorStore
        • RocksetVectorStore
        • FaissVectorStore
        • PineconeVectorStore
        • WeaviateVectorStore
        • QdrantVectorStore
        • CassandraVectorStore
        • ChromaVectorStore
        • MetalVectorStore
        • OpensearchVectorStore
        • OpensearchVectorClient
        • ChatGPTRetrievalPluginClient
        • MilvusVectorStore
        • DeepLakeVectorStore
        • MyScaleVectorStore
        • LanceDBVectorStore
        • TairVectorStore
        • DocArrayInMemoryVectorStore
        • DocArrayHnswVectorStore
        • SupabaseVectorStore
        • PGVectorStore
        • PGVectoRsStore
        • TimescaleVectorStore
        • ZepVectorStore
        • AwaDBVectorStore
        • BagelVectorStore
        • Neo4jVectorStore
        • CognitiveSearchVectorStore
        • EpsillaVectorStore
        • SingleStoreVectorStore
        • VectorStoreQuery
        • VectorStoreQueryResult
        • MetadataFilters
        • MetadataFilter
        • ExactMatchFilter
        • FilterCondition
        • FilterOperator
        • DashVectorStore
        • TencentVectorDB
        • AstraDBVectorStore
        • AzureCosmosDBMongoDBVectorSearch
        • LanternVectorStore
      • KV Storage
      • Loading Indices
    • Structured Index Configuration

Community

  • Integrations
    • Llama Packs 🦙📦
      • Llama Packs Example
      • Llama Pack - Resume Screener 📄
    • Observability
      • Wandb Callback Handler
      • Arize Phoenix Tracing Tutorial
      • OpenInference Callback Handler + Arize Phoenix
      • Evaluating Search and Retrieval with Arize Phoenix
      • Evaluating and Tracking with TruLens
      • Quickstart Guide with LlamaIndex + TruLens
      • Colab
      • HoneyHive LlamaIndex Tracer
      • PromptLayer Handler
      • Callbacks
        • Token Counting Handler
        • Llama Debug Handler
        • Wandb Callback Handler
        • Aim Callback
        • OpenInference Callback Handler + Arize Phoenix
        • Token Counting - Migration Guide
    • Tracing with Graphsignal
    • Evaluating and Tracking with TruLens
    • Unit Testing LLMs With DeepEval
    • Guidance
    • LM Format Enforcer
    • Guardrails
    • OpenAI Function Calling
    • Using Vector Stores
      • Astra DB
      • Simple Vector Store - Async Index Creation
      • Azure CosmosDB MongoDB Vector Store
      • Cassandra Vector Store
      • Chroma
      • Azure Cognitive Search
      • Basic Example
      • Create Index (if it does not exist)
      • Use Existing Index
      • Adding a document to existing index
      • Filtering
      • DashVector Vector Store
      • DeepLake Vector Store
      • DocArray Hnsw Vector Store
      • DocArray InMemory Vector Store
      • Epsilla Vector Store
      • LanceDB Vector Store
      • Metal Vector Store
      • Milvus Vector Store
      • MyScale Vector Store
      • Elasticsearch Vector Store
      • Faiss Vector Store
      • MongoDB Atlas
      • Neo4j vector store
      • Opensearch Vector Store
      • Pinecone Vector Store
      • Pinecone Vector Store - Hybrid Search
      • pgvecto.rs
      • Postgres Vector Store
      • Redis Vector Store
      • Query the data
      • Working with Metadata
      • Qdrant Vector Store
      • Rockset Vector Store
      • Simple Vector Store
      • Supabase Vector Store
      • Tair Vector Store
      • Tencent Cloud VectorDB
      • Timescale Vector Store (PostgreSQL)
      • Weaviate Vector Store
      • Weaviate Vector Store - Hybrid Search
      • Zep Vector Store
      • Create a Zep Vector Store and Index
      • Querying with Metadata filters
    • Using Graph Stores
      • Neo4j Graph Store
      • Nebula Graph Store
      • Knowledge Graph Query Engine
      • Kuzu Graph Store
      • FalkorDB Graph Store
    • Using Managed Indices
      • Vectara Managed Index
    • Using with Langchain 🦜🔗
    • Streamlit
    • Chainlit
    • LlamaIndex + Ray
    • ChatGPT Plugin Integrations
    • Poe
    • Airbyte
    • Fleet Context Embeddings - Building a Hybrid Search Engine for the Llamaindex Library
  • Frequently Asked Questions (FAQ)
    • Large Language Models
    • Embeddings
    • Vector Database
    • Query Engines
    • Chat Engines
    • Documents and Nodes
  • Full-Stack Projects
    • create-llama Blog
    • create-llama Repo
    • create-llama Additional Templates
    • SEC Insights App
    • SEC Insights Repo
    • Chat LlamaIndex App
    • Chat LlamaIndex Repo
    • RAGs Repo

Contributing

  • Contributing to LlamaIndex
  • Documentation Guide

Changes

  • ChangeLog
  • Deprecated Terms
Back to top

Modules

Notebooks with usage of these components can be found below.

Response Evaluation

  • Faithfulness Evaluator
  • Relevancy Evaluator
  • Guideline Evaluator
  • Correctness Evaluator
  • Embedding Similarity Evaluator
  • LlamaIndex + DeepEval Integration
  • QuestionGeneration
  • BatchEvalRunner - Running Multiple Evaluations
  • Evaluating Multi-Modal RAG

Retrieval Evaluation

  • Retrieval Evaluation
Next
LlamaIndex + DeepEval Integration
Previous
Usage Pattern (Retrieval)
Copyright © 2022, Jerry Liu
Made with Sphinx and @pradyunsg's Furo
On this page
  • Modules
    • Response Evaluation
    • Retrieval Evaluation