Commit 1bdf927
committed
fix(v3): adopt v4 dequeue strategy to increase perf
We will now dequeue into a redis list as many messages as we possibly
can from actual queues, trying to dequeue up to 10 runs at a time for
each queue in an env, in separate queue consumers. Then the
SharedQueueConsumer can simply `lpop` off that list and process a run to
be dequeued very quickly. This should get runs through the platform side
dequeue system very quickly.1 parent 5b40c44 commit 1bdf927
5 files changed
Lines changed: 319 additions & 110 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
410 | 410 | | |
411 | 411 | | |
412 | 412 | | |
| 413 | + | |
| 414 | + | |
413 | 415 | | |
414 | 416 | | |
415 | 417 | | |
| |||
0 commit comments