A Fix for Softmax and Cross-Entropy: Derivations and Intuition
Why subtracting the maximum logit is not enough, and how to preserve small gradients in classification and knowledge distillation.
Recent posts
Fourier Inversion Formula
Corollary
Fourier Transform
Definition
Weyl’s Equidistribution Theorem
Definition 1.1