# Honcho Run301 Retrieval Baseline

Run: `run-2026-06-05-honcho-run301-c10-retrieval-baseline`

## Scope

- Source baseline: `run-2026-06-04-mcp-run301-llm-scale10x-v4-pro-prose-natural-followup-800tok`
- Dataset: 1440 generated memory records, 10 companies, 30 stakeholders, 120 simulated days.
- Questions: 12 from the existing run301 artifact.
- Metric: retrieval contained the expected facts, before any LLM answer generation.
- Honcho mode: `sdk`.

## Summary

| Metric | Value |
|---|---:|
| Sibyl retrieval passed | 11 / 12 |
| Honcho retrieval passed | 11 / 12 |
| Avg Sibyl context tokens | 320.08 |
| Avg Honcho context tokens | 1339.08 |

## Questions

| Question | Sibyl retrieval | Honcho retrieval | Sibyl ctx tokens | Honcho ctx tokens |
|---|---:|---:|---:|---:|
| status_company_001 | True | True | 94 | 1197 |
| status_company_007 | True | True | 94 | 1196 |
| milestone_company_001_day_001 | True | True | 964 | 1485 |
| milestone_company_002_day_030 | True | True | 121 | 1528 |
| milestone_company_003_day_060 | True | True | 121 | 1522 |
| milestone_company_004_day_090 | True | True | 121 | 1372 |
| milestone_company_005_day_120 | True | True | 122 | 1530 |
| segment_company_001 | False | False | 943 | 1330 |
| segment_company_010 | True | True | 805 | 1331 |
| role_company_001_1 | True | True | 276 | 1141 |
| role_company_008_2 | True | True | 179 | 1241 |
| negative_meridian_labs | True | True | 1 | 1196 |

## Honcho Failures

```json
[
  {
    "expected_contains": [
      "Chrono Company 001",
      "logistics"
    ],
    "honcho_context_sample": [
      {
        "content": "{\"body\": {\"category\": \"company\", \"display_name\": \"Chrono Company 009\", \"segment\": \"education\", \"timeline_days\": 120, \"timeline_start\": \"2026-01-05\"}, \"id\": \"run278-scale10-chrono-company-009\", \"tier\": \"entity\"}",
        "id": "3eC-toL01SBIZ_b008mzL",
        "metadata": {
          "record_id": "run278-scale10-chrono-company-009",
          "source_run": "run301",
          "tier": "entity"
        },
        "repr": "Message(id='3eC-toL01SBIZ_b008mzL', peer_id='sibyl-run301-source-c10', content='{\"body\": {\"category\": \"company\", \"display_name\": \"...')"
      },
      {
        "content": "{\"body\": {\"category\": \"timeline_milestone\", \"company\": \"run278-scale10-chrono-company-001\", \"company_display\": \"Chrono Company 001\", \"date\": \"2026-01-05\", \"day_index\": 1, \"decision\": \"Chrono Company 001 checkpoint day 001 accepted for contract review.\", \"marker\": \"scale10chronoscale10chronocompany001day001\", \"topic\": \"contract review\"}, \"id\": \"run278-scale10-chrono-company-001-day-001-milestone\", \"tier\": \"entity\"}",
        "id": "hRHV1l9690cGZDglmt6w_",
        "metadata": {
          "record_id": "run278-scale10-chrono-company-001-day-001-milestone",
          "source_run": "run301",
          "tier": "entity"
        },
        "repr": "Message(id='hRHV1l9690cGZDglmt6w_', peer_id='sibyl-run301-source-c10', content='{\"body\": {\"category\": \"timeline_milestone\", \"compa...')"
      }
    ],
    "id": "segment_company_001",
    "retrieval_query": "Chrono Company 001"
  }
]
```