Loading

The key to data ingestion in LlamaIndex is the Loaders. Once you have data, you may further refine your Documents and Nodes.

Once you have learned about the basics of loading data in our Understanding section, you can read on to learn more about:

• SimpleDirectoryReader, our built-in loader for loading all sorts of file types from a local directory

• LlamaHub, our registry of hundreds of data loading libraries to ingest data from any source

• Document and Node objects and how to customize them for more advanced use cases

• Node parsers, our set of helper classes to generate nodes from raw text and files

• The ingestion pipeline which allows you to set up a repeatable, cache-optimized process for loading data.