Skip to content

test(benchmarks): add reproduction test suite under benchmarks/paper - #611

Merged
zoowii merged 1 commit into
DTVMStack:mainfrom
zoowii:feature/shaoding/add_paper_tests
Sep 17, 2026
Merged

zoowii merged 1 commit into
DTVMStack:mainfrom
zoowii:feature/shaoding/add_paper_tests

Conversation

@zoowii

@zoowii zoowii commented Sep 17, 2026

Copy link
Copy Markdown
Contributor

Archive the workloads, scripts, runtime build notes, and reference results needed to reproduce the Evaluation section of the DTVM paper: contract microbenchmarks (sources + hex artifacts + methodology), PolyBench/C 30 cases, WAPM 20 cases (plus fortune rerun substitute), fib/integer-overflow cases, TTFI reproduction guides, trimmed raw result tables, and plotting scripts. Large artifacts (.wasm/.expected/ .time) are tracked via Git LFS.

Generated with Devin

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

  • N
  • Y

2. What is the scope of this PR (e.g. component or file name):

3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

  • Affects user behaviors
  • Contains CI/CD configuration changes
  • Contains documentation changes
  • Contains experimental features
  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Other

4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

  • N
  • Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

  • Unit test
  • Integration test
  • Benchmark (add benchmark stats below)
  • Manual test (add detailed scripts or steps below)
  • Other

6. Release note

None

@github-actions

github-actions Bot commented Sep 17, 2026 •

Copy link
Copy Markdown

⚡ Performance Regression Check Results

✅ Performance Check Passed (interpreter)

Performance Benchmark Results (threshold: 25%)

Benchmark Baseline (us) Current (us) Change Status
total/main/blake2b_huff/8415nulls 2.48 2.48 +0.0% PASS
total/main/blake2b_huff/empty 0.04 0.04 +5.0% PASS
total/main/blake2b_shifts/8415nulls 14.11 14.05 -0.4% PASS
total/main/sha1_divs/5311 8.15 8.24 +1.1% PASS
total/main/sha1_divs/empty 0.10 0.10 +2.1% PASS
total/main/sha1_shifts/5311 5.54 5.67 +2.4% PASS
total/main/sha1_shifts/empty 0.04 0.04 +0.1% PASS
total/main/snailtracer/benchmark 90.40 92.24 +2.0% PASS
total/main/structarray_alloc/nfts_rank 1.13 1.13 -0.3% PASS
total/main/swap_math/insufficient_liquidity 0.00 0.00 -3.2% PASS
total/main/swap_math/received 0.01 0.01 +2.7% PASS
total/main/swap_math/spent 0.01 0.01 -0.9% PASS
total/main/weierstrudel/1 0.32 0.31 -4.5% PASS
total/main/weierstrudel/15 3.37 3.28 -2.6% PASS
total/micro/JUMPDEST_n0/empty 2.77 2.77 -0.1% PASS
total/micro/jump_around/empty 0.11 0.11 +3.5% PASS
total/micro/loop_with_many_jumpdests/empty 69.80 69.94 +0.2% PASS
total/micro/memory_grow_mload/by1 0.17 0.17 +0.8% PASS
total/micro/memory_grow_mload/by16 0.19 0.19 +0.9% PASS
total/micro/memory_grow_mload/by32 0.12 0.11 -0.9% PASS
total/micro/memory_grow_mload/nogrow 0.10 0.09 -3.1% PASS
total/micro/memory_grow_mstore/by1 0.19 0.19 -2.2% PASS
total/micro/memory_grow_mstore/by16 0.11 0.11 +0.6% PASS
total/micro/memory_grow_mstore/by32 0.22 0.23 +3.1% PASS
total/micro/memory_grow_mstore/nogrow 0.18 0.18 -1.0% PASS
total/micro/signextend/one 0.26 0.26 -1.4% PASS
total/micro/signextend/zero 0.49 0.46 -6.8% PASS
total/synth/ADD/b0 2.01 2.01 -0.0% PASS
total/synth/ADD/b1 2.71 2.72 +0.5% PASS
total/synth/ADDRESS/a0 6.61 6.64 +0.4% PASS
total/synth/ADDRESS/a1 5.31 5.07 -4.4% PASS
total/synth/AND/b0 2.14 2.14 -0.2% PASS
total/synth/AND/b1 2.24 2.36 +5.2% PASS
total/synth/BYTE/b0 6.14 6.14 -0.1% PASS
total/synth/BYTE/b1 8.58 8.21 -4.3% PASS
total/synth/CALLDATASIZE/a0 5.56 5.54 -0.3% PASS
total/synth/CALLDATASIZE/a1 3.52 3.35 -4.9% PASS
total/synth/CALLER/a0 6.20 6.07 -2.0% PASS
total/synth/CALLER/a1 6.46 6.60 +2.2% PASS
total/synth/CALLVALUE/a0 3.60 3.52 -2.2% PASS
total/synth/CALLVALUE/a1 6.41 6.63 +3.5% PASS
total/synth/CODESIZE/a0 6.54 6.59 +0.7% PASS
total/synth/CODESIZE/a1 6.46 6.67 +3.3% PASS
total/synth/DUP1/d0 5.88 2.00 -66.0% PASS
total/synth/DUP1/d1 2.11 2.03 -3.9% PASS
total/synth/DUP10/d0 2.02 2.12 +5.0% PASS
total/synth/DUP10/d1 2.14 2.07 -3.2% PASS
total/synth/DUP11/d0 1.72 3.44 +100.1% PASS
total/synth/DUP11/d1 2.10 2.10 +0.0% PASS
total/synth/DUP12/d0 5.73 2.11 -63.2% PASS
total/synth/DUP12/d1 1.40 1.40 -0.2% PASS
total/synth/DUP13/d0 2.06 2.11 +2.6% PASS
total/synth/DUP13/d1 2.28 2.11 -7.3% PASS
total/synth/DUP14/d0 3.45 3.45 -0.2% PASS
total/synth/DUP14/d1 2.33 2.21 -5.2% PASS
total/synth/DUP15/d0 2.59 5.57 +115.1% PASS
total/synth/DUP15/d1 1.40 1.28 -8.4% PASS
total/synth/DUP16/d0 2.22 2.07 -6.6% PASS
total/synth/DUP16/d1 2.13 2.01 -5.7% PASS
total/synth/DUP2/d0 1.41 2.50 +76.9% PASS
total/synth/DUP2/d1 2.14 2.28 +6.6% PASS
total/synth/DUP3/d0 2.12 4.25 +101.1% PASS
total/synth/DUP3/d1 1.40 1.24 -11.5% PASS
total/synth/DUP4/d0 3.01 2.05 -31.7% PASS
total/synth/DUP4/d1 2.14 2.11 -1.1% PASS
total/synth/DUP5/d0 1.39 3.44 +147.2% PASS
total/synth/DUP5/d1 2.06 2.08 +1.3% PASS
total/synth/DUP6/d0 2.02 2.11 +4.4% PASS
total/synth/DUP6/d1 1.40 1.35 -3.5% PASS
total/synth/DUP7/d0 2.13 2.08 -2.4% PASS
total/synth/DUP7/d1 2.14 2.19 +2.3% PASS
total/synth/DUP8/d0 1.44 4.19 +191.7% PASS
total/synth/DUP8/d1 2.05 2.12 +3.6% PASS
total/synth/DUP9/d0 2.50 5.45 +118.4% PASS
total/synth/DUP9/d1 1.40 1.37 -2.3% PASS
total/synth/EQ/b0 4.53 4.52 -0.1% PASS
total/synth/EQ/b1 4.89 4.95 +1.3% PASS
total/synth/GAS/a0 4.09 3.92 -4.1% PASS
total/synth/GAS/a1 7.23 7.16 -0.9% PASS
total/synth/GT/b0 4.80 4.82 +0.5% PASS
total/synth/GT/b1 4.96 4.93 -0.7% PASS
total/synth/ISZERO/u0 7.07 7.00 -1.0% PASS
total/synth/JUMPDEST/n0 2.81 2.78 -1.3% PASS
total/synth/LT/b0 4.79 4.82 +0.6% PASS
total/synth/LT/b1 4.33 4.33 +0.1% PASS
total/synth/MSIZE/a0 5.50 5.50 +0.1% PASS
total/synth/MSIZE/a1 5.69 5.91 +3.9% PASS
total/synth/MUL/b0 6.79 6.77 -0.2% PASS
total/synth/MUL/b1 5.30 5.26 -0.9% PASS
total/synth/NOT/u0 2.23 2.25 +0.6% PASS
total/synth/OR/b0 2.90 2.87 -1.0% PASS
total/synth/OR/b1 1.77 1.75 -1.3% PASS
total/synth/PC/a0 5.52 5.54 +0.2% PASS
total/synth/PC/a1 3.52 3.29 -6.6% PASS
total/synth/PUSH1/p0 1.91 1.93 +1.2% PASS
total/synth/PUSH1/p1 1.73 1.73 -0.1% PASS
total/synth/PUSH10/p0 1.93 1.97 +2.1% PASS
total/synth/PUSH10/p1 1.76 1.58 -10.6% PASS
total/synth/PUSH11/p0 1.90 2.07 +8.9% PASS
total/synth/PUSH11/p1 2.40 2.64 +10.2% PASS
total/synth/PUSH12/p0 1.32 1.32 +0.4% PASS
total/synth/PUSH12/p1 2.41 2.39 -0.8% PASS
total/synth/PUSH13/p0 2.01 2.11 +4.9% PASS
total/synth/PUSH13/p1 1.76 1.74 -1.1% PASS
total/synth/PUSH14/p0 2.06 2.02 -1.8% PASS
total/synth/PUSH14/p1 2.37 2.34 -1.1% PASS
total/synth/PUSH15/p0 1.31 1.32 +0.5% PASS
total/synth/PUSH15/p1 2.61 2.64 +1.0% PASS
total/synth/PUSH16/p0 1.90 2.04 +7.3% PASS
total/synth/PUSH16/p1 1.77 1.78 +0.5% PASS
total/synth/PUSH17/p0 2.00 2.04 +1.9% PASS
total/synth/PUSH17/p1 2.32 2.30 -0.9% PASS
total/synth/PUSH18/p0 1.32 1.32 -0.1% PASS
total/synth/PUSH18/p1 2.55 2.38 -6.5% PASS
total/synth/PUSH19/p0 1.93 1.90 -1.5% PASS
total/synth/PUSH19/p1 1.74 1.78 +1.9% PASS
total/synth/PUSH2/p0 2.05 2.01 -2.0% PASS
total/synth/PUSH2/p1 2.74 2.29 -16.5% PASS
total/synth/PUSH20/p0 2.07 1.97 -5.2% PASS
total/synth/PUSH20/p1 2.53 2.59 +2.4% PASS
total/synth/PUSH21/p0 1.32 1.32 -0.6% PASS
total/synth/PUSH21/p1 2.29 2.34 +2.2% PASS
total/synth/PUSH22/p0 2.02 2.29 +13.3% PASS
total/synth/PUSH22/p1 1.78 1.77 -0.9% PASS
total/synth/PUSH23/p0 1.95 1.96 +0.4% PASS
total/synth/PUSH23/p1 2.56 2.35 -8.0% PASS
total/synth/PUSH24/p0 1.32 1.31 -0.3% PASS
total/synth/PUSH24/p1 2.49 2.35 -5.6% PASS
total/synth/PUSH25/p0 1.92 2.03 +5.7% PASS
total/synth/PUSH25/p1 1.75 1.72 -1.7% PASS
total/synth/PUSH26/p0 2.04 1.96 -3.7% PASS
total/synth/PUSH26/p1 2.50 2.38 -4.5% PASS
total/synth/PUSH27/p0 1.32 1.29 -1.6% PASS
total/synth/PUSH27/p1 2.43 2.48 +2.1% PASS
total/synth/PUSH28/p0 1.92 2.02 +5.3% PASS
total/synth/PUSH28/p1 1.75 1.78 +1.8% PASS
total/synth/PUSH29/p0 2.00 2.03 +1.5% PASS
total/synth/PUSH29/p1 2.25 2.28 +1.2% PASS
total/synth/PUSH3/p0 1.37 1.32 -3.2% PASS
total/synth/PUSH3/p1 2.53 2.40 -5.1% PASS
total/synth/PUSH30/p0 1.35 1.33 -1.9% PASS
total/synth/PUSH30/p1 2.37 2.32 -2.3% PASS
total/synth/PUSH31/p0 1.93 2.05 +6.1% PASS
total/synth/PUSH31/p1 1.90 1.81 -4.9% PASS
total/synth/PUSH32/p0 2.00 2.00 +0.5% PASS
total/synth/PUSH32/p1 2.32 2.36 +1.7% PASS
total/synth/PUSH4/p0 1.92 1.93 +0.5% PASS
total/synth/PUSH4/p1 1.75 1.80 +2.8% PASS
total/synth/PUSH5/p0 2.03 2.05 +0.8% PASS
total/synth/PUSH5/p1 2.46 2.34 -4.9% PASS
total/synth/PUSH6/p0 1.33 1.29 -2.8% PASS
total/synth/PUSH6/p1 2.31 2.28 -1.2% PASS
total/synth/PUSH7/p0 2.03 1.98 -2.3% PASS
total/synth/PUSH7/p1 1.74 1.76 +0.8% PASS
total/synth/PUSH8/p0 1.96 2.03 +3.4% PASS
total/synth/PUSH8/p1 2.27 2.26 -0.5% PASS
total/synth/PUSH9/p0 1.32 1.31 -0.3% PASS
total/synth/PUSH9/p1 2.36 2.59 +9.8% PASS
total/synth/RETURNDATASIZE/a0 3.45 3.44 -0.1% PASS
total/synth/RETURNDATASIZE/a1 6.08 6.44 +5.9% PASS
total/synth/SAR/b0 3.94 3.94 -0.1% PASS
total/synth/SAR/b1 7.29 7.50 +3.0% PASS
total/synth/SGT/b0 3.62 3.63 +0.3% PASS
total/synth/SGT/b1 3.36 3.36 -0.1% PASS
total/synth/SHL/b0 3.62 3.55 -1.9% PASS
total/synth/SHL/b1 1.83 1.78 -2.7% PASS
total/synth/SHR/b0 3.75 3.75 +0.6% PASS
total/synth/SHR/b1 3.11 3.21 +3.1% PASS
total/synth/SIGNEXTEND/b0 3.52 3.45 -1.9% PASS
total/synth/SIGNEXTEND/b1 6.44 6.83 +6.1% PASS
total/synth/SLT/b0 3.42 3.42 -0.1% PASS
total/synth/SLT/b1 3.77 3.78 +0.3% PASS
total/synth/SUB/b0 2.63 2.61 -0.5% PASS
total/synth/SUB/b1 2.73 2.97 +8.7% PASS
total/synth/SWAP1/s0 1.98 1.97 -0.2% PASS
total/synth/SWAP10/s0 2.01 1.99 -1.1% PASS
total/synth/SWAP11/s0 3.86 3.89 +0.9% PASS
total/synth/SWAP12/s0 3.90 3.88 -0.6% PASS
total/synth/SWAP13/s0 2.00 1.99 -0.8% PASS
total/synth/SWAP14/s0 3.84 3.87 +0.9% PASS
total/synth/SWAP15/s0 3.87 3.84 -0.9% PASS
total/synth/SWAP16/s0 2.00 1.99 -0.3% PASS
total/synth/SWAP2/s0 3.85 3.85 +0.0% PASS
total/synth/SWAP3/s0 3.90 3.86 -0.9% PASS
total/synth/SWAP4/s0 1.98 2.00 +1.2% PASS
total/synth/SWAP5/s0 3.83 3.86 +0.8% PASS
total/synth/SWAP6/s0 3.82 3.83 +0.3% PASS
total/synth/SWAP7/s0 1.98 1.98 -0.3% PASS
total/synth/SWAP8/s0 3.87 3.85 -0.4% PASS
total/synth/SWAP9/s0 3.90 3.89 +0.0% PASS
total/synth/XOR/b0 1.99 1.99 -0.2% PASS
total/synth/XOR/b1 2.15 2.11 -2.0% PASS
total/synth/loop_v1 8.76 8.87 +1.2% PASS
total/synth/loop_v2 8.75 8.55 -2.3% PASS

Summary: 194 benchmarks, 0 regressions


✅ Performance Check Passed (multipass)

Performance Benchmark Results (threshold: 25%)

Benchmark Baseline (us) Current (us) Change Status
total/main/blake2b_huff/8415nulls 1.31 1.40 +6.7% PASS
total/main/blake2b_huff/empty 0.02 0.02 +3.8% PASS
total/main/blake2b_shifts/8415nulls 4.31 4.29 -0.4% PASS
total/main/sha1_divs/5311 0.89 0.88 -0.8% PASS
total/main/sha1_divs/empty 0.01 0.01 +0.2% PASS
total/main/sha1_shifts/5311 0.77 0.78 +0.9% PASS
total/main/sha1_shifts/empty 0.01 0.01 -0.9% PASS
total/main/snailtracer/benchmark 48.15 48.18 +0.1% PASS
total/main/structarray_alloc/nfts_rank 0.28 0.27 -1.2% PASS
total/main/swap_math/insufficient_liquidity 0.00 0.00 +2.6% PASS
total/main/swap_math/received 0.01 0.01 -3.1% PASS
total/main/swap_math/spent 0.00 0.00 -2.0% PASS
total/main/weierstrudel/1 0.34 0.34 -0.9% PASS
total/main/weierstrudel/15 3.66 3.72 +1.7% PASS
total/micro/JUMPDEST_n0/empty 0.00 0.00 -0.0% PASS
total/micro/jump_around/empty 0.07 0.08 +14.7% PASS
total/micro/loop_with_many_jumpdests/empty 0.01 0.01 -0.1% PASS
total/micro/memory_grow_mload/by1 0.02 0.02 +7.8% PASS
total/micro/memory_grow_mload/by16 0.02 0.02 -0.7% PASS
total/micro/memory_grow_mload/by32 0.01 0.01 +0.5% PASS
total/micro/memory_grow_mload/nogrow 0.01 0.01 -2.2% PASS
total/micro/memory_grow_mstore/by1 0.02 0.02 +9.3% PASS
total/micro/memory_grow_mstore/by16 0.01 0.01 -0.3% PASS
total/micro/memory_grow_mstore/by32 0.03 0.03 +2.0% PASS
total/micro/memory_grow_mstore/nogrow 0.02 0.02 +4.4% PASS
total/micro/signextend/one 0.08 0.08 +0.4% PASS
total/micro/signextend/zero 0.18 0.19 +3.7% PASS
total/synth/ADD/b0 0.00 0.00 +0.3% PASS
total/synth/ADD/b1 0.00 0.00 +0.6% PASS
total/synth/ADDRESS/a0 0.22 0.23 +0.7% PASS
total/synth/ADDRESS/a1 0.15 0.15 -0.1% PASS
total/synth/AND/b0 0.00 0.00 +0.1% PASS
total/synth/AND/b1 0.00 0.00 +0.3% PASS
total/synth/BYTE/b0 0.00 0.00 +0.5% PASS
total/synth/BYTE/b1 0.00 0.00 +0.3% PASS
total/synth/CALLDATASIZE/a0 0.12 0.12 +2.7% PASS
total/synth/CALLDATASIZE/a1 0.07 0.07 -0.3% PASS
total/synth/CALLER/a0 0.22 0.23 +3.4% PASS
total/synth/CALLER/a1 0.22 0.26 +14.8% PASS
total/synth/CALLVALUE/a0 0.19 0.19 +0.4% PASS
total/synth/CALLVALUE/a1 0.29 0.32 +9.9% PASS
total/synth/CODESIZE/a0 0.12 0.12 -0.3% PASS
total/synth/CODESIZE/a1 0.12 0.12 +0.8% PASS
total/synth/DUP1/d0 0.00 0.00 +1.0% PASS
total/synth/DUP1/d1 0.00 0.00 -0.6% PASS
total/synth/DUP10/d0 0.00 0.00 -7.7% PASS
total/synth/DUP10/d1 0.00 0.00 -0.5% PASS
total/synth/DUP11/d0 0.00 0.00 -0.2% PASS
total/synth/DUP11/d1 0.00 0.00 -0.1% PASS
total/synth/DUP12/d0 0.00 0.00 +0.8% PASS
total/synth/DUP12/d1 0.00 0.00 -0.1% PASS
total/synth/DUP13/d0 0.00 0.00 +0.2% PASS
total/synth/DUP13/d1 0.00 0.00 -0.6% PASS
total/synth/DUP14/d0 0.00 0.00 +0.1% PASS
total/synth/DUP14/d1 0.00 0.00 -1.1% PASS
total/synth/DUP15/d0 0.00 0.00 +0.4% PASS
total/synth/DUP15/d1 0.00 0.00 +0.7% PASS
total/synth/DUP16/d0 0.00 0.00 -0.2% PASS
total/synth/DUP16/d1 0.00 0.00 +0.6% PASS
total/synth/DUP2/d0 0.00 0.00 +0.1% PASS
total/synth/DUP2/d1 0.00 0.00 -2.2% PASS
total/synth/DUP3/d0 0.00 0.00 -0.1% PASS
total/synth/DUP3/d1 0.00 0.00 -0.2% PASS
total/synth/DUP4/d0 0.00 0.00 +1.0% PASS
total/synth/DUP4/d1 0.00 0.00 -0.1% PASS
total/synth/DUP5/d0 0.00 0.00 +0.1% PASS
total/synth/DUP5/d1 0.00 0.00 +0.2% PASS
total/synth/DUP6/d0 0.00 0.00 -0.0% PASS
total/synth/DUP6/d1 0.00 0.00 +0.4% PASS
total/synth/DUP7/d0 0.00 0.00 +0.1% PASS
total/synth/DUP7/d1 0.00 0.00 +0.8% PASS
total/synth/DUP8/d0 0.00 0.00 -0.1% PASS
total/synth/DUP8/d1 0.00 0.00 -0.1% PASS
total/synth/DUP9/d0 0.00 0.00 -3.6% PASS
total/synth/DUP9/d1 0.00 0.00 -0.0% PASS
total/synth/EQ/b0 0.00 0.00 -1.5% PASS
total/synth/EQ/b1 0.00 0.00 -0.1% PASS
total/synth/GAS/a0 0.76 0.76 -0.0% PASS
total/synth/GAS/a1 0.92 0.92 -0.0% PASS
total/synth/GT/b0 0.00 0.00 +0.8% PASS
total/synth/GT/b1 0.00 0.00 -0.3% PASS
total/synth/ISZERO/u0 0.00 0.00 -0.0% PASS
total/synth/JUMPDEST/n0 0.00 0.00 +0.2% PASS
total/synth/LT/b0 0.00 0.00 +0.7% PASS
total/synth/LT/b1 0.00 0.00 +0.1% PASS
total/synth/MSIZE/a0 0.00 0.00 +0.8% PASS
total/synth/MSIZE/a1 0.00 0.00 -1.8% PASS
total/synth/MUL/b0 0.00 0.00 +0.3% PASS
total/synth/MUL/b1 0.00 0.00 -0.2% PASS
total/synth/NOT/u0 0.00 0.00 -0.0% PASS
total/synth/OR/b0 0.00 0.00 -0.9% PASS
total/synth/OR/b1 0.00 0.00 +0.6% PASS
total/synth/PC/a0 0.00 0.00 +0.8% PASS
total/synth/PC/a1 0.00 0.00 +0.5% PASS
total/synth/PUSH1/p0 0.00 0.00 +0.1% PASS
total/synth/PUSH1/p1 0.00 0.00 +1.1% PASS
total/synth/PUSH10/p0 0.00 0.00 +1.1% PASS
total/synth/PUSH10/p1 0.00 0.00 +2.0% PASS
total/synth/PUSH11/p0 0.00 0.00 +0.1% PASS
total/synth/PUSH11/p1 0.00 0.00 -0.2% PASS
total/synth/PUSH12/p0 0.00 0.00 +1.0% PASS
total/synth/PUSH12/p1 0.00 0.00 -0.4% PASS
total/synth/PUSH13/p0 0.00 0.00 -1.5% PASS
total/synth/PUSH13/p1 0.00 0.00 +0.2% PASS
total/synth/PUSH14/p0 0.00 0.00 +1.1% PASS
total/synth/PUSH14/p1 0.00 0.00 +2.6% PASS
total/synth/PUSH15/p0 0.00 0.00 -0.2% PASS
total/synth/PUSH15/p1 0.00 0.00 +1.5% PASS
total/synth/PUSH16/p0 0.00 0.00 -2.8% PASS
total/synth/PUSH16/p1 0.00 0.00 -0.6% PASS
total/synth/PUSH17/p0 0.00 0.00 -0.2% PASS
total/synth/PUSH17/p1 0.00 0.00 -6.4% PASS
total/synth/PUSH18/p0 0.00 0.00 -1.6% PASS
total/synth/PUSH18/p1 0.00 0.00 +1.0% PASS
total/synth/PUSH19/p0 0.00 0.00 -2.8% PASS
total/synth/PUSH19/p1 0.00 0.00 +0.2% PASS
total/synth/PUSH2/p0 0.00 0.00 -0.2% PASS
total/synth/PUSH2/p1 0.00 0.00 -0.1% PASS
total/synth/PUSH20/p0 0.00 0.00 +1.4% PASS
total/synth/PUSH20/p1 0.00 0.00 +6.8% PASS
total/synth/PUSH21/p0 0.00 0.00 +1.3% PASS
total/synth/PUSH21/p1 0.00 0.00 -0.0% PASS
total/synth/PUSH22/p0 1.88 1.87 -0.7% PASS
total/synth/PUSH22/p1 1.75 1.79 +2.0% PASS
total/synth/PUSH23/p0 1.89 1.87 -1.2% PASS
total/synth/PUSH23/p1 2.20 2.25 +2.5% PASS
total/synth/PUSH24/p0 1.32 1.32 -0.1% PASS
total/synth/PUSH24/p1 2.19 2.19 +0.1% PASS
total/synth/PUSH25/p0 1.86 2.00 +7.1% PASS
total/synth/PUSH25/p1 1.75 1.75 +0.3% PASS
total/synth/PUSH26/p0 1.87 1.86 -0.2% PASS
total/synth/PUSH26/p1 2.19 2.19 +0.2% PASS
total/synth/PUSH27/p0 1.32 1.32 -0.1% PASS
total/synth/PUSH27/p1 2.20 2.27 +2.9% PASS
total/synth/PUSH28/p0 1.89 1.99 +5.6% PASS
total/synth/PUSH28/p1 1.77 1.75 -1.3% PASS
total/synth/PUSH29/p0 1.86 1.87 +0.5% PASS
total/synth/PUSH29/p1 2.21 2.24 +1.6% PASS
total/synth/PUSH3/p0 0.00 0.00 +0.2% PASS
total/synth/PUSH3/p1 0.00 0.00 -0.1% PASS
total/synth/PUSH30/p0 1.35 1.34 -0.9% PASS
total/synth/PUSH30/p1 2.25 2.29 +1.8% PASS
total/synth/PUSH31/p0 1.89 1.87 -1.0% PASS
total/synth/PUSH31/p1 1.84 1.81 -1.7% PASS
total/synth/PUSH32/p0 1.87 1.87 +0.4% PASS
total/synth/PUSH32/p1 2.20 2.24 +1.6% PASS
total/synth/PUSH4/p0 0.00 0.00 -2.0% PASS
total/synth/PUSH4/p1 0.00 0.00 -0.6% PASS
total/synth/PUSH5/p0 0.00 0.00 -3.2% PASS
total/synth/PUSH5/p1 0.00 0.00 +3.9% PASS
total/synth/PUSH6/p0 0.00 0.00 -0.0% PASS
total/synth/PUSH6/p1 0.00 0.00 +0.8% PASS
total/synth/PUSH7/p0 0.00 0.00 +1.3% PASS
total/synth/PUSH7/p1 0.00 0.00 -1.6% PASS
total/synth/PUSH8/p0 0.00 0.00 -1.0% PASS
total/synth/PUSH8/p1 0.00 0.00 -4.3% PASS
total/synth/PUSH9/p0 0.00 0.00 -0.9% PASS
total/synth/PUSH9/p1 0.00 0.00 -3.1% PASS
total/synth/RETURNDATASIZE/a0 0.03 0.03 -0.2% PASS
total/synth/RETURNDATASIZE/a1 0.06 0.06 -3.9% PASS
total/synth/SAR/b0 0.00 0.00 +0.2% PASS
total/synth/SAR/b1 0.00 0.00 +1.4% PASS
total/synth/SGT/b0 0.00 0.00 +1.4% PASS
total/synth/SGT/b1 0.00 0.00 +0.0% PASS
total/synth/SHL/b0 0.00 0.00 -1.1% PASS
total/synth/SHL/b1 0.00 0.00 -0.0% PASS
total/synth/SHR/b0 0.00 0.00 +0.0% PASS
total/synth/SHR/b1 0.00 0.00 -0.6% PASS
total/synth/SIGNEXTEND/b0 0.00 0.00 -0.2% PASS
total/synth/SIGNEXTEND/b1 0.00 0.00 -0.6% PASS
total/synth/SLT/b0 0.00 0.00 +0.3% PASS
total/synth/SLT/b1 0.00 0.00 +1.6% PASS
total/synth/SUB/b0 0.00 0.00 +0.6% PASS
total/synth/SUB/b1 0.00 0.00 +0.3% PASS
total/synth/SWAP1/s0 0.00 0.00 +0.3% PASS
total/synth/SWAP10/s0 0.00 0.00 +0.2% PASS
total/synth/SWAP11/s0 0.00 0.00 -0.7% PASS
total/synth/SWAP12/s0 0.00 0.00 -0.0% PASS
total/synth/SWAP13/s0 0.00 0.00 -0.0% PASS
total/synth/SWAP14/s0 0.00 0.00 -0.5% PASS
total/synth/SWAP15/s0 0.00 0.00 +0.0% PASS
total/synth/SWAP16/s0 0.00 0.00 -0.2% PASS
total/synth/SWAP2/s0 0.00 0.00 -1.5% PASS
total/synth/SWAP3/s0 0.00 0.00 +0.1% PASS
total/synth/SWAP4/s0 0.00 0.00 -0.5% PASS
total/synth/SWAP5/s0 0.00 0.00 -1.3% PASS
total/synth/SWAP6/s0 0.00 0.00 -1.1% PASS
total/synth/SWAP7/s0 0.00 0.00 -0.3% PASS
total/synth/SWAP8/s0 0.00 0.00 +0.1% PASS
total/synth/SWAP9/s0 0.00 0.00 +0.4% PASS
total/synth/XOR/b0 0.00 0.00 +0.2% PASS
total/synth/XOR/b1 0.00 0.00 -0.4% PASS
total/synth/loop_v1 8.52 8.62 +1.1% PASS
total/synth/loop_v2 8.70 8.64 -0.8% PASS

Summary: 194 benchmarks, 0 regressions


@zoowii
zoowii force-pushed the feature/shaoding/add_paper_tests branch 4 times, most recently from dd6fb62 to 438be04 Compare September 17, 2026 09:51
Archive the workloads, scripts, runtime build notes, and reference
results needed to reproduce the Evaluation section of the DTVM paper:
contract microbenchmarks (sources + hex artifacts + methodology),
PolyBench/C 30 cases, WAPM 20 cases (plus fortune rerun substitute),
fib/integer-overflow cases, TTFI reproduction guides, trimmed raw
result tables, and plotting scripts. Large artifacts (.wasm/.expected/
.time) are tracked via Git LFS.

Generated with [Devin](https://devin.ai)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
@zoowii
zoowii force-pushed the feature/shaoding/add_paper_tests branch from 438be04 to de18250 Compare September 17, 2026 10:02
@zoowii
zoowii merged commit 12943fb into DTVMStack:main Sep 17, 2026
17 checks passed
@zoowii
zoowii deleted the feature/shaoding/add_paper_tests branch September 17, 2026 10:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant