continual learning

On the Disconnect Between Theory and Practice of Neural Networks: Limits of the NTK Perspective

The neural tangent kernel (NTK) has garnered significant attention as a theoretical framework for describing the behavior of large-scale neural networks. Kernel methods are theoretically well-understood and as a result enjoy algorithmic benefits, …