Skip to content
Hozu
Menu
All trials

Trial 0019 — 0.7 (ADR 0041) on the widget task and the notes task

Question: ADR 0041 set targets before the runs. Does 0.7 meet them?

Setup

Results

Correctness: every run passes everything.

Cost (weighted tokens):

Run 1 Run 2 Mean Before vs Nuxt Target
Widget build 240.8 k 214.5 k 227.7 k 279.9 k (0018) 1.75× (was 2.15×) ≤ 1.8× — met
Widget change 111.9 k 116.4 k 114.1 k 195.0 k (0018) 2.03× (was 3.46×) ≤ 2.5× — met
Notes build 79.1 k 91.5 k 85.3 k 103.4 k (0016) 1.14× (was 1.38×) no worse — met
Notes change 108.2 k 97.1 k 102.7 k 88.8 k (0016) 1.68× (was 1.45×) no worse — not met

Reading the result

The widget apps used every new form without being asked.

The notes change got worse, and the cause is E.

Re-run of the notes change with the fix

Conclusion

Nuxt ratio before 0.7 0.7
Widget build 2.15× 1.75×
Widget change 3.46× 2.03×
Notes build 1.38× 1.14×
Notes change 1.45× 1.38×