Skip to content
Hozu
Menu
All trials

Trial 0007 — Build and change after ADR 0022 (a smaller authoring surface)

Question: with optional absent values, one declarations record, change-only contracts, a 10 KB skill and the model.ts + views.ts layout, what does a fresh agent pay to build and to change the task board, against the same-model Nuxt run of trial 0006?

Targets stated in ADR 0022 before the run:

Setup

Results

Tenon build Nuxt build Tenon change Nuxt change
Hidden acceptance 12 / 12 12 / 12 6 / 6, regression 12 / 12 6 / 6, regression 12 / 12
Assistant turns 11 (0006: 8) 6 7 (0006: 8) 8
Shell commands 9 (6) 5 5 (6) 7
Tool output read (chars) 32,322 (30,670) 7,790 20,417 (26,836) 14,629
Output tokens 9,471 (10,861) 6,003 4,553 (7,215) 4,728
Fresh input tokens 66,866 (69,165) 46,946 40,777 (47,112) 32,340
Cached input read 0.57 M (0.39 M) 0.21 M 0.31 M (0.39 M) 0.32 M
Wall time 82 s (90 s) 61 s 52 s (66 s) 57 s
Weighted tokens 172 k (163 k) 98 k 94 k (122 k) 88 k
App source 14.2 KB (17.4 KB) 6.9 KB 17.2 KB (21.1 KB) 9.2 KB
Files touched by the change 3 (8) 6

Against the targets:

Target Trial 0006 Trial 0007 Met?
Change ≤ 1.1× 1.39× 1.07× yes
Build ≤ 1.2× 1.67× 1.75× no
Source after the change ≤ 1.6× 2.30× 1.86× no

Reading the result

Conclusion