Felippe Alves

Kolmogorov--Arnold Networks for Small Language Models

Felippe Alves, Renato Vicente

Kolmogorov--Arnold Networks (KANs) replace fixed node activations with learned one-dimensional edge functions, offering an explicit interface for interpretation and a possible alternative to transformer feed-forward networks. We test these claims separately. In a six-layer, 10M-p…Read more