#
Manage Data Chunks
#
Manage data chunks
After your data has been ingested and processed, you can review and refine the resulting data chunks using the Chunk Viewer tab within your Enterprise Knowledge Garden (EKG). This interface provides powerful tools to ensure the quality and accuracy of the data before it is used by AI agents or other applications.
#
Chunk Viewer Interface
The main view of the Chunk Viewer displays all the chunks generated from your source documents.
Chunk Overview: At the top, you can see the total number of chunks, the currently applied Chunk strategy (e.g., Block), and an option to Refresh for new Chunks.
Document Grouping: Chunks are grouped by their source document (e.g., Invoice test.pdf), with a total count of chunks for each file.
Chunk Cards: Each individual chunk is presented on a card, showing a preview of its text content, its "Embedded" status, and icons for management actions.
#
Chunk Search: Chunk search relies on keyword matching to find information within predetermined text segments.
#
#
Editing and Managing Individual Chunks
You have granular control over each chunk:
Edit a Chunk: Click the edit icon on a chunk card to modify its text content directly.
Add Metadata and Tags: Use the more options (three-dot) menu to add specific metadata or tags to a chunk, enhancing its searchability and providing additional context.
#
Verifying Chunk Source
To ensure full traceability and understand the context of a chunk, you can view its exact origin within the source document.
Click on any chunk card in the Chunk Viewer.
A detailed split-screen view will open.
This view displays the full source document on the left and the content of the selected chunk on the right.
A highlighted box is overlaid on the source document, visually pinpointing the precise section from which the chunk was extracted. This allows you to easily verify the context and accuracy of every chunk.
Note: The "Open" icon allows you to check a chunk's source and apply edits across the complete document, while the "Edit" icon limits it to that specific chunk.
