Skip to content

feat: benchmark suites, dashboard worker and results - #1

Merged
fahimfaisaal merged 1 commit into
mainfrom
feat/site
Oct 24, 2026
Merged

fahimfaisaal merged 1 commit into
mainfrom
feat/site

Conversation

@fahimfaisaal

Copy link
Copy Markdown
Member

Fresh home for the benchmark suites, carried over from goptics/varmq-benchmarks#4 as one commit. Three Go modules, one dashboard, results included.

Layout

Path What
pool/ In-memory worker pool suite (9 pools, 5 workloads, 4 task types, 24/8/4 CPUs)
redis/ Redis queue suite: VarMQ persistent and distributed vs Asynq, rmq, taskq, gocraft/work; Redis pinned to one core
sqlite/ sqliteq v0.3.0 through a VarMQ worker: one queue, drain, priority, ten queues, two checkpoint sizes
worker/ Cloudflare Worker: static assets, /dataset catalog, /dataset/<id>, SPA fallback
Taskfile.yml Includes the three module Taskfiles; site:json, site:html, site:build, site:preview, site:dev, site:deploy, report
.github/workflows/site.yml task + vizb build on PRs; wrangler deploy on pushes to main

Results (2026-10-24, varmq main 415ad73 via replace, redisq v1.5.0, sqliteq v0.3.0)

  • Pool: VarMQ fastest in 40 / 36 / 20 of 55 rows at 24 / 8 / 4 CPUs; loses the one-worker rows to BufferedPool.
  • Redis, one instance: VarMQ first in every 100-producer row at W100 and W1000, second to GocraftWork with one producer; 1.1 to 3x ahead of Asynq and Taskq in every row.
  • Redis, four instances: VarMQDistributed first in every 100-producer row, 1.3 to 2.1x over the best rival.
  • Latency p50: Taskq 0.06 ms, GocraftWork 0.09, VarMQ 0.14, Rmq 102, Asynq 995.
  • SQLite: ckpt10000 1.4 to 3.3x faster than ckpt1000 at 10x the WAL; ten queues in separate files 4 to 6x faster than one file.

Details in each module's README.

Dashboard

Six datasets behind one vizb page in lazy-catalog mode: pool-24cpu, pool-8cpu, pool-4cpu, redis-persistent, redis-distributed, sqlite-persistent. Deep links /?id=<id>; /<id> opens one dataset.

Before merging

  • Add CLOUDFLARE_API_TOKEN (Workers Scripts: Edit; Zone DNS: Edit and Workers Routes: Edit on goptics.org) and CLOUDFLARE_ACCOUNT_ID as repository secrets; the first wrangler deploy runs on merge.
  • The three go.mod files point at ../../varmq until varmq v1.10.0 tags.

🤖 Generated with Claude Code

pool/, redis/ and sqlite/ modules, each with its own Taskfile, README and
committed bench/*.txt from the 2026-10-24 run on varmq 415ad73 (replace
directive), redisq v1.5.0 and sqliteq v0.3.0. One vizb lazy-catalog page
served by a Cloudflare Worker at benchmarks.goptics.org with /dataset and
/dataset/<id>; CI builds with task + vizb and deploys with wrangler from
main. Carried over from goptics/varmq-benchmarks#4 as one commit.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@fahimfaisaal
fahimfaisaal merged commit 766c35d into main Oct 24, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant