Lightweight Nonautoregressive Audio Lm Head

“To make low frame rates feasible, we introduce factorized FSQ and a lightweight non-autoregressive audio LM head, scaling capacity to nearly 300 bits/frame without sacrificing efficient prediction.”