tabensemb.model.AbstractNN.toggle_optimizer

method

AbstractNN.toggle_optimizer(optimizer: Optimizer | LightningOptimizer, optimizer_idx: int) → None

Makes sure only the gradients of the current optimizer’s parameters are calculated in the training step to prevent dangling gradients in multiple-optimizer setup.

This is only called automatically when automatic optimization is enabled and multiple optimizers are used. It works with untoggle_optimizer() to make sure param_requires_grad_state is properly reset.

Parameters:

• optimizer – The optimizer to toggle.

• optimizer_idx – The index of the optimizer to toggle.