By default, dask will use a multi-threaded scheduler and use all available CPUs on the local machine. This can be undesirable if running on a shared machine. If so, the number of workers can be configured, e.g.:
dask.config.set(num_workers=4)
Maybe worth documenting this somewhere.
More info here.
By default, dask will use a multi-threaded scheduler and use all available CPUs on the local machine. This can be undesirable if running on a shared machine. If so, the number of workers can be configured, e.g.:
Maybe worth documenting this somewhere.
More info here.