mirror of
https://github.com/getcompanion-ai/co-mono.git
synced 2026-04-17 08:00:59 +00:00
Add LLM context diagram to compaction docs
This commit is contained in:
parent
ea3ab718ea
commit
51aa1339ef
1 changed files with 11 additions and 0 deletions
|
|
@ -211,6 +211,17 @@ After compaction (new entry appended):
|
||||||
|
|
||||||
The session file is append-only. When loading, the session loader finds the latest compaction entry, uses its summary, then loads messages starting from `firstKeptEntryIndex`.
|
The session file is append-only. When loading, the session loader finds the latest compaction entry, uses its summary, then loads messages starting from `firstKeptEntryIndex`.
|
||||||
|
|
||||||
|
```
|
||||||
|
What gets sent to the LLM as context:
|
||||||
|
|
||||||
|
┌─────────────────────────────────────────────────────────────┐
|
||||||
|
│ [system prompt] [summary msg] [msg idx 5] [msg idx 6] [msg idx 7] │
|
||||||
|
└─────────────────────────────────────────────────────────────┘
|
||||||
|
↑ └───────────┬───────────┘
|
||||||
|
from NEW compact's messages from
|
||||||
|
summary firstKeptEntryIndex onwards
|
||||||
|
```
|
||||||
|
|
||||||
**Event fields:**
|
**Event fields:**
|
||||||
|
|
||||||
| Field | Description |
|
| Field | Description |
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue