arxivcs.LGcs.NE2026-07-12
LayerNorm as Implicit Gain Control in Looped Transformers
In pre-LayerNorm looped transformers, LayerNorm inside the recurrent block acts as an implicit gain controller: by coupling the block's local Lipschitz constant inversely to the activation scale, it renders the recurrence Jacobian non-normal -- asymptotically contractive at every…