arxivcs.LGcs.AI2026-07-17
Kolmogorov--Arnold Networks for Small Language Models
Kolmogorov--Arnold Networks (KANs) replace fixed node activations with learned one-dimensional edge functions, offering an explicit interface for interpretation and a possible alternative to transformer feed-forward networks. We test these claims separately. In a six-layer, 10M-p…