Chunking
Splitting documents into smaller segments for embedding and retrieval in a RAG pipeline.
What is Chunking?
Chunking is the preprocessing step that determines RAG quality. Too large and the embedding is diluted; too small and you lose context. Strategies include fixed-size, sentence-boundary, semantic, and hierarchical chunking. The right choice depends on document type, embedding model, and downstream task. See RAG Technology Best Practices.
Related terms
Putting Chunking to work?
VDF AI runs governed AI agents on your own infrastructure — on-premises, sovereign cloud, or air-gapped. Book a working session to map the architecture.
Talk to VDF AI