Benchmarks of Go worker pools and job queues: in-process worker pools, Redis-backed queues and SQLite-backed queues. Raw go test -bench output is committed under <suite>/bench/, and the charts at https://benchmarks.goptics.org are built from it.
| Suite | What runs | Libraries | Charts | Details |
|---|---|---|---|---|
| Worker pool | 9 subjects (7 libraries plus two channel baselines); 5 workload shapes, 4 tasks, 4 pool sizes, 1M tasks per op; recorded at GOMAXPROCS 24, 8 and 4 | ants, conc, errgroup (x/sync), gopool (bytedance/gopkg), pond, VarMQ, workerpool | pool-24cpu, pool-8cpu, pool-4cpu | pool/README.md |
| Message queue, Redis | 6 subjects from 5 libraries; 100,000 jobs per op through 1 or 4 library instances in one process, plus enqueue-only and enqueue-to-handler latency | Asynq, gocraft/work, rmq, taskq, VarMQ with redisq | redis | redis/README.md |
| Message queue, SQLite | 5 subjects from 4 libraries; 4 scenarios at WAL checkpoint 1000 and 10000 pages | backlite, goqite, River, VarMQ with sqliteq | sqlite | sqlite/README.md |
Intel Core i7-13700 (24 threads), linux/amd64, Go 1.26, SQLite databases on ext4 over NVMe.
The pool suite sets GOMAXPROCS to 24, 8 and 4 with no core pinning. The SQLite suite runs on all 24 threads. Redis 7.2 (Debian image) is pinned to CPU 14 and the Redis suite's client to CPUs 0-13 and 16-23 (22 threads), so Redis has a whole physical core.
| Library | Version | Suite |
|---|---|---|
| varmq | v1.10.0 | pool, redis, sqlite |
| ants | v2.12.1 | pool |
| workerpool | v1.2.2 | pool |
| conc | v0.3.0 | pool |
| x/sync (errgroup) | v0.24.0 | pool |
| bytedance/gopkg (gopool) | v0.1.4 | pool |
| pond | v2.7.2 | pool |
| redisq | v1.5.0 | redis |
| Asynq | v0.26.0 | redis |
| rmq | v5.2.0 | redis |
| taskq | v3.2.9 | redis |
| gocraft/work | v0.5.1 | redis |
| go-redis | v9.23.0 (taskq uses v8.11.5) | redis |
| redigo | v1.9.3 | redis |
| sqliteq | v0.3.0 | sqlite |
| goqite | v0.4.0 | sqlite |
| backlite | v0.8.0 | sqlite |
| River with its SQLite driver | v0.49.0 | sqlite |
| go-sqlite3 | v1.14.28 | sqlite |
Needs Go 1.26+, Task, Docker for the Redis suite, a C compiler for the SQLite suite, and vizb and jq for task site:preview.
varmq v1.10.0 is not tagged yet; each go.mod builds it from a checkout of goptics/varmq at ../../varmq through a replace directive.
task --list # every task
task pool:bench # one iteration of every pool benchmark
task redis:up redis:bench redis:down
task sqlite:bench
task pool:txt # full run into pool/bench/ (hours); also redis:txt, sqlite:txt
task report # every suite, then the local preview
task site:preview # all datasets in one local HTMLEach suite README shows how to run one slice with go test -bench. Pushes to main rebuild and deploy the charts; see worker/README.md.
MIT, see LICENSE. The pool harness started from alitto/pond-benchmarks.