Feature Encoding in VAE-based Audio Decoders: Effects of Input, Depth and Distribution

Excerpt

arXiv:2610.07966v1 Announce Type: cross Abstract: Neural audio synthesis models like the Realtime Audio Variational autoEncoder (RAVE) achieve impressive genera tion quality, yet how their internal representations encode musical features remains poorly understood. We present a systematic layer-wise and cross-layer cluster analysis of RAVE decoder activations across three models trained on different musical domains, tested with four stimulus types. We then evaluate architectural generalization wi