Skip to content

perf(engine): a small model builds faster, on the in-memory engine - #1863

Closed
FBumann wants to merge 5 commits into
claude/friendly-dirac-t7g8rdfrom
perf/engine-by-size
Closed

perf(engine): a small model builds faster, on the in-memory engine#1863
FBumann wants to merge 5 commits into
claude/friendly-dirac-t7g8rdfrom
perf/engine-by-size

Merge remote-tracking branch 'origin/claude/friendly-dirac-t7g8rd' in…

54c7907
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis completed Oct 6, 2026 in 0s

37 benchmarks regressed

⚡ 76 improved benchmarks
❌ 37 regressed benchmarks
✅ 155 untouched benchmarks
⏩ 106 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Memory test_window[sector-s-specsolve-highs-shape] 4.1 MB 6.1 MB -32.71%
❌ Memory test_window[sector-s-specsolve-highs-coefficient] 4.1 MB 6.1 MB -32.56%
❌ Memory test_window[sector-s-specsolve-highs-cold] 4.1 MB 6.1 MB -32.49%
❌ Memory test_emit[sector-s-specsolve-highs] 4.2 MB 6.1 MB -31.91%
❌ Memory test_window[sector-s-specsolve-highs-one] 4.2 MB 6.1 MB -31.68%
❌ Memory test_window[sector-s-specsolve-highs-values] 4.2 MB 6.1 MB -31.58%
❌ WallTime test_read[commitment-m-specsolve-frames] 5.4 ms 7.4 ms -26.14%
❌ Memory test_emit[sector-s-specsolve-lp] 4.7 MB 6.2 MB -24.52%
❌ WallTime test_emit[sector-m-specsolve-highs] 163.8 ms 212.3 ms -22.83%
❌ WallTime test_read[nodal-l-specsolve-frames] 24.2 ms 31.1 ms -22.29%
❌ WallTime test_read[commitment-l-specsolve-frames] 8.6 ms 10.7 ms -20.17%
❌ WallTime test_read[dispatch-m-specsolve-frames] 5.4 ms 6.7 ms -18.5%
❌ WallTime test_read[sector-l-specsolve-frames] 19.3 ms 23.3 ms -17.33%
❌ WallTime test_window[nodal-m-specsolve-highs-cold] 177.6 ms 213.6 ms -16.86%
❌ WallTime test_window[sector-m-specsolve-highs-one] 235.9 ms 280.4 ms -15.85%
❌ WallTime test_window[sector-m-specsolve-highs-coefficient] 186.6 ms 219.8 ms -15.08%
❌ WallTime test_read[transport-l-specsolve-frames] 39.2 ms 45.6 ms -13.95%
❌ WallTime test_emit[nodal-m-specsolve-lp] 275.2 ms 316.3 ms -12.97%
❌ WallTime test_window[nodal-m-specsolve-highs-one] 328.5 ms 376.8 ms -12.81%
❌ WallTime test_window[sector-m-specsolve-highs-values] 241.4 ms 276.6 ms -12.73%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing perf/engine-by-size (54c7907) with claude/friendly-dirac-t7g8rd (94340ef)

Open in CodSpeed

Footnotes

  1. 106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

View more details on CodSpeed