Blog

Notes on building

Infrastructure, AI, tools, and the decisions behind them.

Split dark panel. Left, under 'What I had written down': 65 of 176 groups identical, 111 groups deviate, the run log only reported STREUT, three seeds were meant to catch it. Right, under 'What the data actually held': 0 groups in which all three outputs differ, in 111 of 111 cases the odd one out is seed 42, seeds 43 and 44 never part, the outlier is always the first pass. A strip below covers the two-machine checks: five different seeds on six models yield the same text every time, 108 cell pairs across two machines show not one difference, token counts 503, 508, 508, 508, 508. Tags: temperature 0, Ollama 0.32.5, RTX 3090 on two machines, 528 cells, 11 models, byte-wise comparison.

The Seed Does Nothing. The First Run Does

Every measurement in this series runs at temperature 0 with three seeds. The reasoning was simple: if the model does drift, three passes will catch it.…

Grouped bars compare points per task before and after the stop token was added, in percent: rechnung falls from 88 to 75, extrakt rises from 0 to 100, raetsel from 30 to 39. A side panel carries the totals across all 48 cells: 117 of 336 points before against 215 of 336 after, cells at the token ceiling 48 of 48 against 3 of 48, format compliance 31 against 83 percent, 192,000 against 45,775 generated tokens, 1594 against 326 seconds of compute time, and the plan task unchanged at 88 percent.

The model that couldn’t stop

One model sits at the bottom of the table with 35 percent. The number was measured honestly — and is still wrong, in both directions at…