Getting started
Backpack
First order extensions with a ResNet
Mini-batch sub-sampling
Extension hook example
Diagonal Gauss-Newton Second order optimizer
Batched Jacobians
Custom module example
Saving memory in convolutions
BackPACK’s retain_graph option
Gradient of backpropagated quantities
Hutchinson Trace Estimation
Residual networks
Differentially Private SGD.
Recurrent networks
Matrix-free second-order optimization
Gallery generated by Sphinx-Gallery