Sweeps

Best practices to organize hyperparameter searches

Set unique tags with wandb.init(tags=‘your_tag’). This allows efficient filtering of project runs by selecting the corre …

Can I rerun a grid search?

If a grid search completes but some W&B Runs need re-execution due to crashes, delete the specific W&B Runs to re-run. T …

Can I resume a run inside a sweep?

Run resumption is not supported inside a W&B sweep. If you pass a run_id or use wandb.init(resume=…) while a sweep age …

Can I use Sweeps and SageMaker?

To authenticate W&B, complete the following steps: create a requirements.txt file if using a built-in Amazon SageMaker e …

Can we flag boolean variables as hyperparameters?

Use the macro in the command section of the configuration to pass hyperparameters as boolean flags. This macro automatic …

Can you use W&B Sweeps with cloud infrastructures such as AWS Batch, ECS, etc.?

To publish the sweep_id so that any W&B Sweep agent can access it, implement a method for these agents to read and execu …

Do I need to provide values for all hyperparameters as part of the W&B Sweep. Can I set defaults?

Access hyperparameter names and values from the sweep configuration using (run.config()), which acts like a dictionary. …

How can I change the directory my sweep logs to locally?

Set the logging directory for W&B run data by configuring the environment variable WANDB_DIR. For example:

How can I resume a sweep using Python code?

To resume a sweep, pass the sweep_id to the wandb.agent() function.

How do I best log models from runs in a sweep?

One effective approach for logging models in a sweep involves creating a model artifact for the sweep. Each version repr …

How do I enable code logging with Sweeps?

To enable code logging for sweeps, add wandb.log_code() after initializing the W&B Run. This action is necessary even wh …

How do I fix `CommError, Run does not exist` during a sweep?

If you see both CommError, Run does not exist and ERROR Error uploading during a sweep, the most likely cause is that yo …

How do I fix `Cuda out of memory` during a sweep?

If you see Cuda out of memory during a sweep, refactor your code to use process-based execution. Rewrite your code as a …

How do I fix an `anaconda 400 error` during a sweep?

The following error usually occurs when you do not log the metric that you are optimizing: To fix this, make sure you ar …

How do I run sweeps with distributed training on SLURM?

When running a W&B sweep with distributed training on SLURM (for example, multi-GPU jobs with —gpus-per-node), only one …

How do I use custom CLI commands with sweeps?

You can use W&B Sweeps with custom CLI commands if training configuration passes command-line arguments. In the example …

How do I use the parallel coordinates chart in W&B?

The parallel coordinates chart visualizes the relationship between hyperparameters and metrics across many runs. Each ru …

How should I run sweeps on SLURM?

When using sweeps with the SLURM scheduling system, run wandb agent —count 1 SWEEP_ID in each scheduled job. This comma …

Is there a way to add extra values to a sweep, or do I need to start a new one?

Once a W&B Sweep starts, you cannot change the Sweep configuration. However, you can navigate to any table view, select …

Optimizing multiple metrics

To optimize multiple metrics in a single run, use a weighted sum of the individual metrics. Log the new combined metric …

What happens if I edit my Python files while a sweep is running?

While a sweep is running: If the train.py script which the sweep uses changes, the sweep continues to use the original t …

What is the `Est. Runs` column?

W&B provides an estimated number of Runs generated when creating a W&B Sweep with a discrete search space. This total re …

Why is my sweep agent not picking up new runs?

If your sweep agent starts but does not receive new run configurations, or receives one run and then idles, there are se …