Code examples and use cases

First order extensions with a ResNet

First order extensions with a ResNet

Mini-batch sub-sampling

Mini-batch sub-sampling

Extension hook example

Extension hook example

Diagonal Gauss-Newton Second order optimizer

Diagonal Gauss-Newton Second order optimizer

Custom module example

Custom module example

Saving memory in convolutions

Saving memory in convolutions

Gradient of backpropagated quantities

Gradient of backpropagated quantities

Hutchinson Trace Estimation

Hutchinson Trace Estimation

Residual networks

Residual networks

Differentially Private SGD.

Differentially Private SGD.

Recurrent networks

Recurrent networks

Matrix-free second-order optimization

Matrix-free second-order optimization