https://hojaeklee.github.io/tags/normalizations/Recent content in Normalizations on Hojae LeeHugo -- 0.160.1enMon, 28 Sep 2026 00:00:00 +0000https://hojaeklee.github.io/til/deep_learning/20260928_normalizations/Mon, 28 Sep 2026 00:00:00 +0000https://hojaeklee.github.io/til/deep_learning/20260928_normalizations/<p>After my <a href="https://hojaeklee.github.io/til/deep_learning/20260927_swish_and_swiglu/">Swish and SwiGLU</a> adventure, I wanted to do another set of chronological reading, this time on normalization techniques. Much like the activation functions, these are very commonplace in deep learning architecture, but beyond BatchNorm I hadn&rsquo;t sat down to read these as a group to parse out the use cases and the limitations that subsequent techniques answer.</p>