Code examples and use cases

First order extensions with a ResNet

First order extensions with a ResNet

First order extensions with a ResNet
Mini-batch sub-sampling

Mini-batch sub-sampling

Mini-batch sub-sampling
Extension hook example

Extension hook example

Extension hook example
Diagonal Gauss-Newton Second order optimizer

Diagonal Gauss-Newton Second order optimizer

Diagonal Gauss-Newton Second order optimizer
Batched Jacobians

Batched Jacobians

Batched Jacobians
Custom module example

Custom module example

Custom module example
Saving memory in convolutions

Saving memory in convolutions

Saving memory in convolutions
BackPACK's retain_graph option

BackPACK’s retain_graph option

BackPACK's retain_graph option
Gradient of backpropagated quantities

Gradient of backpropagated quantities

Gradient of backpropagated quantities
Hutchinson Trace Estimation

Hutchinson Trace Estimation

Hutchinson Trace Estimation
Residual networks

Residual networks

Residual networks
Differentially Private SGD.

Differentially Private SGD.

Differentially Private SGD.
Recurrent networks

Recurrent networks

Recurrent networks
Matrix-free second-order optimization

Matrix-free second-order optimization

Matrix-free second-order optimization

Gallery generated by Sphinx-Gallery