Upgrade Helidon to 27.0.0 - #1484
tomas-langer wants to merge 6 commits into
Conversation
976841f to
d38a6b4
Compare
|
/benchmark --save |
|
👋 Benchmark request received. A collaborator will review and approve the run. |
Benchmark ResultsFramework:
Full log |
|
/benchmark -f helidon-tuned --save |
|
👋 Benchmark request received. A collaborator will review and approve the run. |
Benchmark ResultsFramework:
Full log |
|
I have reverted the tuned static content change (as the tuned version is still much faster than our production impl). |
|
/benchmark-multiple --save |
|
👋 Benchmark request received. A collaborator will review and approve the run. |
|
|
|
/benchmark-multiple --save |
42e8fb1 to
137e5be
Compare
|
👋 Benchmark request received. A collaborator will review and approve the run. |
Benchmark ResultsFrameworks: 2 | Test: ✅
|
| Test | Conn | RPS | Rate | CPU/req | p99 | p99.9 | CPU | Mem | Δ RPS | Δ Mem |
|---|---|---|---|---|---|---|---|---|---|---|
| baseline | 4096 | 1,594,530 | — | — | — | — | 6091.7% | 13.4GiB | -1.6% | +103.0% |
| pipelined | 4096 | 9,440,985 | — | — | — | — | 5886.9% | 10.1GiB | +4.0% | +48.5% |
| limited-conn | 4096 | 604,708 | — | — | — | — | 4569.7% | 3.9GiB | -7.9% | +39.3% |
| json-comp | 4096 | 317,813 | — | — | — | — | 6389.8% | 13.5GiB | +162.1% | +365.5% |
| json-comp | 16384 | 316,503 | — | — | — | — | 6394.3% | 14.9GiB | +53.8% | +132.8% |
| json-tls | 4096 | 663,683 | — | — | — | — | 6264.1% | 12.9GiB | +166.1% | +168.8% |
| 8gbit | 512 | 49,280 | 0.9856 | 116.05us | 1237.0us | 5082.0us | 604.6% | 1.6GiB | ~0% | -27.3% |
| static-tls | 1024 | 99,741 | — | — | — | — | 5247.2% | 2.0GiB | +267.3% | +5.3% |
| async-db | 1024 | 231,575 | — | — | — | — | 4506.4% | 4.9GiB | +255.7% | +88.5% |
| baseline-h2 | 256 | 3,380,236 | — | — | — | — | 6252.3% | 12.5GiB | +31.5% | +11.6% |
| baseline-h2 | 1024 | 3,782,078 | — | — | — | — | 6245.7% | 18.1GiB | +40.0% | +18.3% |
| static-h2 | 256 | 89,465 | — | — | — | — | 5004.5% | 4.3GiB | +290.4% | +30.3% |
| static-h2 | 1024 | 87,519 | — | — | — | — | 4935.5% | 12.1GiB | +294.8% | +163.0% |
| baseline-h2c | 256 | 4,016,088 | — | — | — | — | 6262.8% | 9.5GiB | +19.7% | +3.3% |
| baseline-h2c | 1024 | 4,473,670 | — | — | — | — | 6305.2% | 18.8GiB | +25.2% | +23.7% |
| baseline-h2c | 4096 | 4,483,422 | — | — | — | — | 6045.5% | 27.4GiB | +31.0% | +19.7% |
| json-h2c | 1024 | 1,014,751 | — | — | — | — | 6303.0% | 11.9GiB | +42.8% | +45.1% |
| json-h2c | 4096 | 1,031,204 | — | — | — | — | 6254.6% | 19.4GiB | +47.7% | +79.6% |
| unary-grpc | 256 | 1,132,191 | — | — | — | — | 6081.2% | 13.0GiB | +3.4% | +2.4% |
| unary-grpc | 1024 | 1,150,597 | — | — | — | — | 6168.7% | 23.3GiB | +5.5% | +18.3% |
| unary-grpc-tls | 256 | 991,697 | — | — | — | — | 6133.0% | 13.8GiB | +0.6% | -4.2% |
| unary-grpc-tls | 1024 | 1,034,927 | — | — | — | — | 6154.0% | 23.9GiB | +3.2% | +19.5% |
| echo-ws | 512 | 2,566,082 | — | — | — | — | 6682.6% | 739MiB | +3.1% | -25.4% |
| echo-ws | 4096 | 2,075,378 | — | — | — | — | 6615.7% | 928MiB | -9.9% | -30.3% |
| echo-ws | 16384 | 2,165,248 | — | — | — | — | 6575.7% | 1.6GiB | -0.9% | -30.4% |
| echo-ws-pipeline | 512 | 15,881,765 | — | — | — | — | 6447.7% | 4.8GiB | +1.6% | +84.6% |
| echo-ws-pipeline | 4096 | 15,619,270 | — | — | — | — | 6196.4% | 4.2GiB | +2.6% | ~0% |
| echo-ws-pipeline | 16384 | 15,078,166 | — | — | — | — | 5983.0% | 5.0GiB | +0.8% | +56.2% |
| echo-ws-limited | 512 | 616,289 | — | — | — | — | 4367.3% | 1.5GiB | -3.4% | -16.7% |
| echo-ws-limited | 4096 | 637,767 | — | — | — | — | 4484.9% | 1.5GiB | -0.1% | -11.8% |
| latency-1m | 1024 | 997,751 | 0.9978 | 45.11us | 1440.0us | 6698.0us | 4841.9% | 1.4GiB | ~0% | -26.3% |
| latency-10k | 1024 | 9,981 | 0.9981 | 56.28us | 114.0us | 1746.0us | 53.4% | 358MiB | ~0% | -40.7% |
| latency-500k-8cpu | 1024 | 344,573 | 0.6891 |
23.16us | 4180992.0us | 4339712.0us | 786.3% | 5.0GiB | +3.6% | +233.3% |
| async | 32000 | 282,454 | — | — | — | — | 5254.4% | 1.7GiB | +1.3% | -22.7% |
✅ helidon-tuned
| Test | Conn | RPS | Rate | CPU/req | p99 | p99.9 | CPU | Mem | Δ RPS | Δ Mem |
|---|---|---|---|---|---|---|---|---|---|---|
| baseline | 4096 | 1,658,618 | — | — | — | — | 6145.7% | 12.3GiB | +5.8% | +92.2% |
| pipelined | 4096 | 10,480,015 | — | — | — | — | 6051.7% | 10.2GiB | -1.9% | +45.7% |
| limited-conn | 4096 | 610,563 | — | — | — | — | 4547.7% | 4.6GiB | -4.8% | +21.1% |
| json-comp | 4096 | 334,222 | — | — | — | — | 6310.1% | 12.7GiB | +11.1% | +44.3% |
| json-comp | 16384 | 323,611 | — | — | — | — | 6458.6% | 11.9GiB | +8.2% | -3.3% |
| json-tls | 4096 | 652,361 | — | — | — | — | 6243.6% | 11.9GiB | +2.5% | +36.8% |
| 8gbit | 512 | 49,380 | 0.9876 | 110.07us | 614.0us | 3621.0us | 476.5% | 1.9GiB | +0.2% | -36.7% |
| static-tls | 1024 | 343,265 | — | — | — | — | 5966.5% | 9.5GiB | +21.0% | +82.7% |
| async-db | 1024 | 224,348 | — | — | — | — | 4912.7% | 4.5GiB | +240.7% | +136.8% |
| baseline-h2 | 256 | 3,606,810 | — | — | — | — | 6236.1% | 11.6GiB | +35.7% | +2.7% |
| baseline-h2 | 1024 | 3,865,420 | — | — | — | — | 6210.5% | 20.5GiB | +33.9% | +32.3% |
| static-h2 | 256 | 269,486 | — | — | — | — | 5586.8% | 12.0GiB | +31.9% | +71.4% |
| static-h2 | 1024 | 241,430 | — | — | — | — | 5174.6% | 11.6GiB | -2.3% | +8.4% |
| baseline-h2c | 256 | 4,218,962 | — | — | — | — | 6263.9% | 10.5GiB | +18.8% | -0.9% |
| baseline-h2c | 1024 | 4,607,382 | — | — | — | — | 6265.6% | 18.1GiB | +22.9% | +14.6% |
| baseline-h2c | 4096 | 4,575,576 | — | — | — | — | 6074.0% | 28.0GiB | +25.9% | +14.3% |
| json-h2c | 1024 | 1,078,582 | — | — | — | — | 6352.5% | 11.8GiB | +20.7% | +5.4% |
| json-h2c | 4096 | 1,072,110 | — | — | — | — | 6174.5% | 19.6GiB | +22.1% | +25.6% |
| unary-grpc | 256 | 1,130,458 | — | — | — | — | 6089.2% | 13.4GiB | +3.4% | -0.7% |
| unary-grpc | 1024 | 1,151,536 | — | — | — | — | 6152.0% | 21.1GiB | +7.4% | +11.6% |
| unary-grpc-tls | 256 | 997,201 | — | — | — | — | 6226.7% | 17.8GiB | +1.3% | +22.8% |
| unary-grpc-tls | 1024 | 1,014,871 | — | — | — | — | 6218.3% | 23.5GiB | +3.6% | +11.4% |
| echo-ws | 512 | 2,402,059 | — | — | — | — | 6498.3% | 647MiB | +0.2% | -54.9% |
| echo-ws | 4096 | 2,143,173 | — | — | — | — | 6518.3% | 4.4GiB | +0.8% | +120.0% |
| echo-ws | 16384 | 1,999,536 | — | — | — | — | 6228.2% | 3.8GiB | -4.0% | +15.2% |
| echo-ws-pipeline | 512 | 15,805,802 | — | — | — | — | 6261.4% | 3.5GiB | -0.5% | +16.7% |
| echo-ws-pipeline | 4096 | 15,563,498 | — | — | — | — | 6133.9% | 3.8GiB | +1.4% | +5.6% |
| echo-ws-pipeline | 16384 | 15,358,539 | — | — | — | — | 6022.6% | 11.3GiB | +3.2% | +98.2% |
| echo-ws-limited | 512 | 615,038 | — | — | — | — | 4465.8% | 1.7GiB | -6.6% | -15.0% |
| echo-ws-limited | 4096 | 608,407 | — | — | — | — | 4333.7% | 1.7GiB | -9.9% | -10.5% |
| latency-1m | 1024 | 997,888 | 0.9979 | 43.56us | 1839.0us | 9932.0us | 4691.6% | 1.5GiB | ~0% | -46.4% |
| latency-10k | 1024 | 9,980 | 0.9980 | 55.54us | 116.0us | 2609.0us | 52.9% | 374MiB | ~0% | -73.9% |
| latency-500k-8cpu | 1024 | 362,717 | 0.7254 |
21.96us | 3548160.0us | 3664896.0us | 786.7% | 3.2GiB | -1.3% | +113.3% |
| async | 32000 | 309,467 | — | — | — | — | 5483.5% | 5.8GiB | NEW | NEW |
Upgrade Helidon to 27.0.0