Skip to content

LlamaIndex

Response

Home
Learn
Use Cases
Examples
Component Guides
Advanced Topics
API Reference
Open-Source Community
LlamaCloud

LlamaIndex

Home
Home
- High-Level Concepts
- Installation and Setup
- How to read these docs
- Starter Examples
  Starter Examples
  - Starter Tutorial (OpenAI)
  - Starter Tutorial (Local Models)
- Discover LlamaIndex Video Series
- Frequently Asked Questions (FAQ)
- Starter Tools
  Starter Tools
  - RAG CLI
Learn
Learn
- Using LLMs
- Building a RAG pipeline
  Building a RAG pipeline
  - Loading & Ingestion
    Loading & Ingestion
    
    Loading Data (Ingestion)
    
    LlamaHub
    
    Loading from LlamaCloud
  - Indexing & Embedding
  - Storing
  - Querying
- Building an agent
  Building an agent
- Building Workflows
  Building Workflows
- Structured Data Extraction
  Structured Data Extraction
- Tracing and Debugging
- Evaluating
  Evaluating
  - Evaluating
  - Cost Analysis
    
    Cost Analysis
    
    Usage Pattern
- Putting it all Together
  Putting it all Together
  - Full-stack web application
    
    Full-stack web application
    
    A Guide to Building a Full-Stack Web App with LLamaIndex
    
    A Guide to Building a Full-Stack LlamaIndex Web App with Delphic
  - Q&A Patterns
    
    Q&A Patterns
    
    A Guide to Extracting Terms and Definitions
  - Chatbots
    Chatbots
    
    How to Build a Chatbot
  - Structured data
    
    Structured data
  - Agents
Use Cases
Use Cases
Examples
Examples
Component Guides
Component Guides
- Models
  Models
  - LLMs
    LLMs
    
    Using LLMs
    
    Standalone Usage
    
    Customizing LLMs
    
    Available LLM Integrations
  - Embeddings
  - Multi Modal
- Prompts
  Prompts
  - Usage pattern
- Loading
  Loading
  - Documents and Nodes
    
    Documents and Nodes
    
    Using Documents
    
    Using Nodes
    
    Metadata Extraction
  - SimpleDirectoryReader
  - Data Connectors
    
    Data Connectors
    
    Usage Pattern
    
    LlamaParse
    
    Module Guides
  - Node Parsers / Text Splitters
    
    Node Parsers / Text Splitters
    
    Node Parser Modules
  - Ingestion Pipeline
    
    Ingestion Pipeline
    
    Transformations
- Indexing
  Indexing
- Storing
  Storing
- Querying
  Querying
  - Query Engines
    
    Query Engines
    
    Usage Pattern
    
    Response Modes
    
    Streaming
    
    Module Guides
    
    Supporting Modules
  - Chat Engines
    
    Chat Engines
    
    Usage Pattern
    
    Module Guides
  - Retrieval
    
    Retrieval
    
    Retriever Modules
    
    Retriever Modes
  - Node Postprocessors
    
    Node Postprocessors
    
    Node Postprocessor Modules
  - Response Synthesis
    
    Response Synthesis
    
    Response Synthesis Modules
  - Routing
  - Workflows
  - Query Pipelines (Deprecated)
    
    Query Pipelines (Deprecated)
    
    Usage Pattern
    
    Module Guides
    
    Module Usage
  - Structured Outputs
    
    Structured Outputs
    
    Output Parsing Modules
    
    (Deprecated) Query Engines + Pydantic Outputs
    
    Pydantic Programs
- Agents
  Agents
- Workflows
  Workflows
- Evaluation
  Evaluation
  - Usage Pattern (Response Evaluation)
  - Usage Pattern (Retrieval)
  - Modules
  - LlamaDatasets
    LlamaDatasets
    
    Contributing A LabelledRagDataset
    
    Evaluating With LabelledRagDataset's
    
    Evaluating Evaluators with LabelledEvaluatorDataset's
- Observability
  Observability
  - Instrumentation
- Settings
- Llama Deploy
  Llama Deploy
Advanced Topics
Advanced Topics
- Building Performant RAG Applications for Production
- Basic Strategies
- Agentic strategies
- Retrieval
  Retrieval
  - Advanced Retrieval Strategies
  - Query Transformations
- Evaluation
  Evaluation
- Fine-Tuning
- Writing Custom Modules
- Building RAG from Scratch (Lower-Level)
API Reference
API Reference
- Agents
  Agents
  - Coa
  - Dashscope
  - Introspective
  - Lats
  - Llm compiler
  - Openai
  - Openai legacy
  - React
- Callbacks
  Callbacks
  - Agentops
  - Aim
  - Argilla
  - Arize phoenix
  - Deepeval
  - Honeyhive
  - Langfuse
  - Literalai
  - Llama debug
  - Openinference
  - Opik
  - Promptlayer
  - Token counter
  - Uptrain
  - Wandb
- Chat Engines
  Chat Engines
- Embeddings
  Embeddings
  - Adapter
  - Alephalpha
  - Alibabacloud aisearch
  - Anyscale
  - Azure inference
  - Azure openai
  - Bedrock
  - Clarifai
  - Clip
  - Cloudflare workersai
  - Cohere
  - Dashscope
  - Databricks
  - Deepinfra
  - Elasticsearch
  - Fastembed
  - Fireworks
  - Gaudi
  - Gemini
  - Gigachat
  - Google
  - None
  - Huggingface
  - Huggingface api
  - Huggingface itrex
  - Huggingface openvino
  - Huggingface optimum
  - Huggingface optimum intel
  - Ibm
  - Instructor
  - Ipex llm
  - Jinaai
  - Langchain
  - Litellm
  - Llamafile
  - Llm rails
  - Mistralai
  - Mixedbreadai
  - Modelscope
  - Nomic
  - Nvidia
  - Oci genai
  - Octoai
  - Ollama
  - Openai
  - Oracleai
  - Premai
  - Sagemaker endpoint
  - Siliconflow
  - Text embeddings inference
  - Textembed
  - Together
  - Upstage
  - Vertex
  - Vertex endpoint
  - Voyageai
  - Xinference
  - Yandexgpt
  - Zhipuai
- Evaluation
  Evaluation
  - Answer relevancy
  - Context relevancy
  - Correctness
  - Dataset generation
  - Faithfullness
  - Guideline
  - Metrics
  - Multi modal
  - Pairwise comparison
  - Query response
  - Response Response
    Table of contents
    
    ResponseEvaluator
  - Retrieval
  - Semantic similarity
  - Tonic validate
- Indexes
  Indexes
  - Bge m3
  - Colbert
  - Dashscope
  - Document summary
  - Google
  - Keyword
  - Knowledge graph
  - Llama cloud
  - Postgresml
  - Property graph
  - Summary
  - Tree
  - Vectara
  - Vector
  - Vertexai
  - Zilliz
- Ingestion
  Ingestion
- Instrumentation
  Instrumentation
- LLMs
  LLMs
  - None
  - Ai21
  - Alephalpha
  - Alibabacloud aisearch
  - Anthropic
  - Anyscale
  - Azure inference
  - Azure openai
  - Bedrock
  - Bedrock converse
  - Cerebras
  - Clarifai
  - Cleanlab
  - Cohere
  - Custom llm
  - Dashscope
  - Databricks
  - Deepinfra
  - Everlyai
  - Fireworks
  - Friendli
  - Gaudi
  - Gemini
  - Gigachat
  - None
  - Groq
  - Huggingface
  - Huggingface api
  - Ibm
  - Ipex llm
  - Konko
  - Langchain
  - Litellm
  - Llama api
  - Llama cpp
  - Llamafile
  - Lmstudio
  - Localai
  - Maritalk
  - Mistral rs
  - Mistralai
  - Mlx
  - Modelscope
  - Monsterapi
  - Mymagic
  - Neutrino
  - Nvidia
  - Nvidia tensorrt
  - Nvidia triton
  - Oci genai
  - Octoai
  - Ollama
  - Openai
  - Openai like
  - Openllm
  - Openrouter
  - Openvino
  - Optimum intel
  - Paieas
  - Palm
  - Perplexity
  - Pipeshift
  - Portkey
  - Predibase
  - Premai
  - Qianfan
  - Reka
  - Replicate
  - Rungpt
  - Sagemaker endpoint
  - Sambanovacloud
  - Siliconflow
  - Solar
  - Text generation inference
  - Together
  - Unify
  - Upstage
  - Vertex
  - Vllm
  - Xinference
  - Yi
  - You
  - Zhipuai
- Llama Datasets
  Llama Datasets
- Llama Deploy
  Llama Deploy
  - apiserver
  - control_plane
  - deploy
  - message_consumers
  - message_publishers
  - messages
  - orchestrators
  - Python SDK
  - services
  - types
  - message_queues
    
    message_queues
    
    apache_kafka
    
    rabbitmq
    
    redis
    
    simple
- Llama Packs
  Llama Packs
- Memory
  Memory
- Metadata Extractors
  Metadata Extractors
  - Entity
  - Keyword
  - None
  - Marvin
  - Pydantic
  - Question
  - Relik
  - Summary
  - Title
- Multi-Modal LLMs
  Multi-Modal LLMs
  - Anthropic
  - Azure openai
  - Dashscope
  - Gemini
  - Huggingface
  - Mistralai
  - Ollama
  - Openai
  - Openvino
  - Reka
  - Replicate
  - Zhipuai
- Node Parsers & Text Splitters
  Node Parsers & Text Splitters
- Node Postprocessors
  Node Postprocessors
- Object Stores
  Object Stores
- Output Parsers
  Output Parsers
- Programs
  Programs
- Prompts
  Prompts
- Query Engines
  Query Engines
- Query Pipeline
  Query Pipeline
  - Agent
  - Arg pack
  - Custom
  - Function
  - Input
  - Llm
  - Multi modal
  - Object
  - Output parser
  - Postprocessor
  - Prompt
  - Query engine
  - Query transform
  - Retriever
  - Router
  - Synthesizer
  - Tool runner
- Question Generators
  Question Generators
- Readers
  Readers
  - Agent search
  - Airbyte cdk
  - Airbyte gong
  - Airbyte hubspot
  - Airbyte salesforce
  - Airbyte shopify
  - Airbyte stripe
  - Airbyte typeform
  - Airbyte zendesk support
  - Airtable
  - Alibabacloud aisearch
  - Apify
  - Arango db
  - Arxiv
  - Asana
  - Assemblyai
  - Astra db
  - Athena
  - Awadb
  - Azcognitive search
  - Azstorage blob
  - Azure devops
  - Bagel
  - Bilibili
  - Bitbucket
  - Boarddocs
  - Box
  - Chatgpt plugin
  - Chroma
  - Clickhouse
  - Confluence
  - Couchbase
  - Couchdb
  - Dad jokes
  - Dashscope
  - Dashvector
  - Database
  - Deeplake
  - Discord
  - Docling
  - Docstring walker
  - Docugami
  - Document360
  - Earnings call transcript
  - Elasticsearch
  - Faiss
  - Feedly rss
  - Feishu docs
  - Feishu wiki
  - File
  - Firebase realtimedb
  - Firestore
  - Gcs
  - Genius
  - Gitbook
  - Github
  - Gitlab
  - Google
  - Gpt repo
  - Graphdb cypher
  - Graphql
  - Guru
  - Hatena blog
  - Hive
  - Hubspot
  - Huggingface fs
  - Hwp
  - Iceberg
  - Imdb review
  - Intercom
  - Jaguar
  - Jira
  - Joplin
  - Json
  - Kaltura esearch
  - Kibela
  - Lilac
  - Linear
  - Llama parse
  - Macrometa gdn
  - Make com
  - Mangadex
  - Mangoapps guides
  - Maps
  - Mbox
  - Memos
  - Metal
  - Microsoft onedrive
  - Microsoft outlook
  - Microsoft sharepoint
  - Milvus
  - Minio
  - Mondaydotcom
  - Mongodb
  - Myscale
  - Notion
  - Nougat ocr
  - Obsidian
  - Openalex
  - Openapi
  - Opendal
  - Opensearch
  - Oracleai
  - Pandas ai
  - Papers
  - Patentsview
  - Pathway
  - Pdb
  - Pdf marker
  - Pdf table
  - Pebblo
  - None
  - Preprocess
  - Psychic
  - Qdrant
  - Quip
  - Rayyan
  - Readme
  - Readwise
  - Reddit
  - Remote
  - Remote depth
  - S3
  - Sec filings
  - Semanticscholar
  - Simple directory reader
  - Singlestore
  - Slack
  - Smart pdf loader
  - Snowflake
  - Snscrape twitter
  - Spotify
  - Stackoverflow
  - Steamship
  - String iterable
  - Stripe docs
  - Structured data
  - Telegram
  - Toggl
  - Trello
  - Twitter
  - Txtai
  - Upstage
  - Weather
  - Weaviate
  - Web
  - Whatsapp
  - Wikipedia
  - Wordlift
  - Wordpress
  - Youtube metadata
  - Youtube transcript
  - Zendesk
  - Zep
  - Zulip
  - Zyte serp
- Response Synthesizers
  Response Synthesizers
- Retrievers
  Retrievers
  - Auto merging
  - Bedrock
  - Bm25
  - Duckdb retriever
  - Keyword
  - Knowledge graph
  - Mongodb atlas bm25 retriever
  - Pathway
  - Query fusion
  - Recursive
  - Router
  - Sql
  - Summary
  - Transform
  - Tree
  - Vector
  - Vertexai search
  - Videodb
  - You
- Schema
  Schema
- Selectors
  Selectors
  - Notdiamond
- Sparse Embeddings
  Sparse Embeddings
  - Fastembed
- Storage
  Storage
  - Chat Store
    
    Chat Store
    
    Azure
    
    Azurecosmosmongovcore
    
    Azurecosmosnosql
    
    Dynamodb
    
    Postgres
    
    Redis
    
    Simple
    
    Upstash
  - Docstore
    
    Docstore
    
    Azure
    
    Couchbase
    
    Dynamodb
    
    Elasticsearch
    
    Firestore
    
    Mongodb
    
    Postgres
    
    Redis
    
    Simple
  - Graph Stores
    
    Graph Stores
    
    Falkordb
    
    Kuzu
    
    Memgraph
    
    Nebula
    
    Neo4j
    
    Neptune
    
    Simple
    
    Tidb
  - Index Store
    
    Index Store
    
    Azure
    
    Azurecosmosnosql
    
    Couchbase
    
    Dynamodb
    
    Elasticsearch
    
    Firestore
    
    Mongodb
    
    Postgres
    
    Redis
    
    Simple
  - Kvstore
    
    Kvstore
    
    Azure
    
    Azurecosmosnosql
    
    Couchbase
    
    Dynamodb
    
    Elasticsearch
    
    Firestore
    
    Mongodb
    
    Postgres
    
    Redis
    
    S3
    
    Simple
  - Storage
    Storage
    
    Storage context
  - Vector Store
    
    Vector Store
    
    Alibabacloud opensearch
    
    Analyticdb
    
    Astra db
    
    Awadb
    
    Awsdocdb
    
    Azureaisearch
    
    Azurecosmosmongo
    
    Azurecosmosnosql
    
    Bagel
    
    Baiduvectordb
    
    Cassandra
    
    Chatgpt plugin
    
    Chroma
    
    Clickhouse
    
    Couchbase
    
    Dashvector
    
    Databricks
    
    Deeplake
    
    Docarray
    
    Duckdb
    
    Dynamodb
    
    Elasticsearch
    
    Epsilla
    
    Faiss
    
    Firestore
    
    Google
    
    Hologres
    
    Jaguar
    
    Kdbai
    
    Lancedb
    
    Lantern
    
    Lindorm
    
    Mariadb
    
    Metal
    
    Milvus
    
    Mongodb
    
    Myscale
    
    Neo4jvector
    
    Neptune
    
    Nile
    
    Objectbox
    
    Oceanbase
    
    Opensearch
    
    Oracledb
    
    Pgvecto rs
    
    Pinecone
    
    Postgres
    
    Qdrant
    
    Redis
    
    Relyt
    
    Rocksetdb
    
    Simple
    
    Singlestoredb
    
    Supabase
    
    Tablestore
    
    Tair
    
    Tencentvectordb
    
    Tidbvector
    
    Timescalevector
    
    Txtai
    
    Typesense
    
    Upstash
    
    Vearch
    
    Vertexaivectorsearch
    
    Vespa
    
    Weaviate
    
    Wordlift
    
    Zep
- Tools
  Tools
  - Arxiv
  - Azure code interpreter
  - Azure cv
  - Azure speech
  - Azure translate
  - Bing search
  - Box
  - Brave search
  - Cassandra
  - Chatgpt plugin
  - Code interpreter
  - Cogniswitch
  - Database
  - Duckduckgo
  - Exa
  - Finance
  - Function
  - Google
  - Graphql
  - Ionic shopping
  - Jina
  - Load and search
  - Metaphor
  - Multion
  - Neo4j
  - Notion
  - Ondemand loader
  - Openai
  - Openapi
  - None
  - Passio nutrition ai
  - Playgrounds
  - Python file
  - Query engine
  - Query plan
  - Requests
  - Retriever
  - Salesforce
  - Shopify
  - Slack
  - Tavily research
  - Text to image
  - Tool spec
  - Vectara query
  - Vector db
  - Waii
  - Weather
  - Wikipedia
  - Wolfram alpha
  - Yahoo finance
  - Yelp
  - Zapier
- Workflow
  Workflow
  - Decorators
  - Context
  - Events
  - Retry policy
  - Workflow
Open-Source Community
Open-Source Community
- Integrations
- Full Stack Projects
- Community FAQ
  Community FAQ
- Contributing
  Contributing
  - Code
  - Docs
- Changelog
- Presentations
- Upgrading to v0.10.x
- Deprecated Terms
LlamaCloud
LlamaCloud
- LlamaParse

Table of contents

ResponseEvaluator

Response

Evaluation modules.

ResponseEvaluator `module-attribute` #

ResponseEvaluator = FaithfulnessEvaluator