Popular repositories Loading

1. backpack backpackPublic

   BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

   Python 617 57

2. cockpit cockpitPublic

   Cockpit: A Practical Debugging Tool for Training Deep Neural Networks

   Python 489 20

3. unfoldNd unfoldNdPublic

   (N=1,2,3)-dimensional unfold (im2col) and fold (col2im) in PyTorch

   Python 109 12

4. curvlinops curvlinopsPublic

   PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)

   Python 71 16

5. singd singdPublic

   [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)

   Python 24

6. hbp hbpPublic

   Hessian backpropagation (HBP): PyTorch extension of backpropagation for block-diagonal curvature matrix approximations

   Python 22 2