# Codette Runtime Benchmark

*Generated: 2026-04-02T14:02:37.106059Z*

*Base URL: http://localhost:7860 | Cases: 6 | Passed: 6*

## 1. Overall Summary

- Mean score: **1.000**
- Pass rate: **100.0%**
- Mean latency: **69593.1 ms**

## 2. Category Summary

| Category | Count | Mean Score | Pass Rate | Mean Latency (ms) |
|----------|-------|------------|-----------|-------------------|
| continuity_retention | 1 | 1.000 | 100.0% | 89535.4 |
| governance_stability | 1 | 1.000 | 100.0% | 38248.8 |
| grounded_correctness | 1 | 1.000 | 100.0% | 61108.4 |
| valuation_reasoning | 2 | 1.000 | 100.0% | 2899.2 |
| web_grounding | 1 | 1.000 | 100.0% | 222867.4 |

## 3. Case Results

| Case | Category | Score | Target | Status | Latency (ms) |
|------|----------|-------|--------|--------|--------------|
| grounded_tricky_math | grounded_correctness | 1.000 | 0.85 | PASS | 61108.4 |
| continuity_anchor_recall | continuity_retention | 1.000 | 0.80 | PASS | 89535.4 |
| governance_loop_resistance | governance_stability | 1.000 | 0.80 | PASS | 38248.8 |
| risk_frontier_analysis | valuation_reasoning | 1.000 | 0.90 | PASS | 2187.2 |
| valuation_aware_synthesis | valuation_reasoning | 1.000 | 0.80 | PASS | 3611.2 |
| web_research_memory_reuse | web_grounding | 1.000 | 0.80 | PASS | 222867.4 |

## 4. Detailed Checks

### grounded_tricky_math

Answer a classic bias-prone prompt correctly without fluent drift.

- `OK` correct_value: Expected the ball cost to be 5 cents.
- `OK` avoids_intuitive_wrong_answer: The classic wrong answer is 10 cents.
- `OK` response_confidence_present: Runtime should surface confidence metadata for the answer.

### continuity_anchor_recall

Carry a user-defined anchor and constraint across turns using continuity summary and landmarks.

- `OK` anchor_recalled: The follow-up answer should preserve the user anchor phrase.
- `OK` constraint_retained: Expected 15 words or fewer, got 14.
- `OK` continuity_summary_used: Continuity summary should be active on the follow-up turn.
- `OK` decision_landmark_or_session_marker_used: Expected decision landmarks or session markers to help continuity.

### governance_loop_resistance

Avoid falling back into self-diagnostic mode after an explicit diagnostic turn.

- `OK` explicit_diagnostic_still_available: The explicit diagnostic turn should still be reachable.
- `OK` followup_not_self_diagnostic: Expected normal chat adapter, got davinci.
- `OK` followup_not_report_loop_text: The follow-up should not look like a recycled system report.
- `OK` followup_answers_normally: Normal follow-up should produce a non-empty conversational answer.

### risk_frontier_analysis

Rank futures correctly with singularity-aware event-embedded valuation.

- `OK` risk_frontier_mode: Expected maximize_value mode, got 'maximize_value'.
- `OK` best_scenario_ranked: Expected gentle_future as best scenario, got gentle_future.
- `OK` worst_scenario_ranked: Expected catastrophic_future as worst scenario, got catastrophic_future.
- `OK` scenario_count: Expected 2 scenarios in the frontier, got 2.

### valuation_aware_synthesis

Inject valuation context into cocoon synthesis so risk comparisons become part of reasoning.

- `OK` readable_output_present: Synthesis should return a readable summary.
- `OK` valuation_analysis_embedded: Valuation context should be included in the synthesis result.
- `OK` best_future_referenced: Expected the best scenario to be visible in synthesis output.
- `OK` worst_future_referenced: Expected the worst scenario to be visible in synthesis output.

### web_research_memory_reuse

Use cited web research and then reuse it from cocoon-backed recall on a similar follow-up.

- `OK` initial_web_lookup_used: The first turn should use cited web lookup.
- `OK` cached_web_research_reused: The follow-up should reuse stored web research memory.
- `OK` web_sources_present_on_followup: Follow-up answer should still surface source links.
- `OK` web_cited_trust_tag_present: Trust tags should make sourced research visible.

## 5. What This Measures

- `grounded_correctness`: tricky-answer fidelity and confidence metadata
- `continuity_retention`: active continuity summary, landmarks, and cross-turn constraint retention
- `governance_stability`: resistance to accidental diagnostic loops
- `valuation_reasoning`: risk-frontier ranking and valuation-aware synthesis
- `web_grounding`: cited current-facts lookup plus cocoon-backed research reuse
