Random legal vs Two-ply search
IQ match point 0.0. Separate Blitz match point 0.0.
Models select placements from shared one-step board outcomes. CR compares play with gravity paused. Blitz separately measures what each adapter can do within 100 ms.
The original results are withdrawn. They mixed network latency with decision quality, used an order-dependent rating and gave adapters unequal board information. Jev chose the first listed option in all 57 accepted IQ decisions. Read the correction and archived recordings →
Both hosted adapters now pass mirrored-board and reversed-option sanity checks. These check basic behaviour, not playing strength. Diagnostic record →
Provisional quick suite, 3 seeds. CR is relative to this field. This small sample cannot establish a winner or a significant difference. These are reproducibility seeds, not a held-out test of general intelligence.
| Brain | Mean IQ score | Mean IQ lines | Completed-call p50 / p95 | $ / IQ game |
|---|---|---|---|---|
| Dellacherie-styleLocal baseline | 4989 | 17.0 | 200.96 µs / 287.29 µs | $0 |
| Greedy heuristicLocal baseline | 5285 | 17.3 | 180.62 µs / 270.25 µs | $0 |
| Jevtypesafe/jev-1.13 | 1939 | 7.0 | 364.8 ms / 474.7 ms | $0.00816 |
| LLM classifieropenai/gpt-4o-mini | 2285 | 8.0 | 1.26 s / 2.07 s | $0.02362 |
| Random legalLocal baseline | 453 | 0.0 | 161.58 µs / 368.13 µs | $0 |
| Two-ply searchLocal baseline | 5251 | 18.3 | 3.9 ms / 4.8 ms | $0 |
CR and rating intervals are withheld until a full 30-seed suite is available. These are raw validation results, listed alphabetically. Rating details →
Completed-call latency excludes censored timeouts and input preparation. A small latency number alone does not show reliability. Blitz is a systems stress test and does not contribute to CR.
| Brain / mode | Completed calls | Timed-out calls | Deadline-miss ticks | Invalid / stale / errors | Completed-call p50 / p95 |
|---|---|---|---|---|---|
| Dellacherie-styleIQ | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 200.96 µs / 287.29 µs |
| Dellacherie-styleBlitz | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 215.25 µs / 326.54 µs |
| Greedy heuristicIQ | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 180.62 µs / 270.25 µs |
| Greedy heuristicBlitz | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 211.87 µs / 356.75 µs |
| JevIQ | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 364.8 ms / 474.7 ms |
| JevBlitz | 0 / 297 (0.0%) | 297 (100.0%) | 600 / 600 (100.0%) | 0 / 0 / 0 | Not measured / Not measured |
| LLM classifierIQ | 163 / 163 (100.0%) | 0 (0.0%) | 0 / 163 (0.0%) | 0 / 0 / 0 | 1.26 s / 2.07 s |
| LLM classifierBlitz | 0 / 292 (0.0%) | 292 (100.0%) | 600 / 600 (100.0%) | 0 / 0 / 0 | Not measured / Not measured |
| Random legalIQ | 70 / 70 (100.0%) | 0 (0.0%) | 0 / 70 (0.0%) | 0 / 0 / 0 | 161.58 µs / 368.13 µs |
| Random legalBlitz | 70 / 70 (100.0%) | 0 (0.0%) | 0 / 70 (0.0%) | 0 / 0 / 0 | 234.00 µs / 450.67 µs |
| Two-ply searchIQ | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 3.9 ms / 4.8 ms |
| Two-ply searchBlitz | 150 / 150 (100.0%) | 0 (0.0%) | 0 / 150 (0.0%) | 0 / 0 / 0 | 3.8 ms / 4.4 ms |
IQ match point 0.0. Separate Blitz match point 0.0.
IQ match point 0.0. Separate Blitz match point 0.0.
IQ match point 0.0. Separate Blitz match point 0.0.
IQ match point 0.0. Separate Blitz match point 0.0.
IQ match point 0.0. Separate Blitz match point 0.0.
IQ match point 0.0. Separate Blitz match point 0.0.