Gå frakoblet med Player FM -appen!
[QA] Efficient Dictionary Learning with Switch Sparse Autoencoders
Manage episode 444616810 series 3524393
Switch Sparse Autoencoders efficiently scale feature extraction in neural networks by routing activations through smaller expert models, improving reconstruction and sparsity while reducing computational costs.
https://arxiv.org/abs//2410.08201
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1605 episoder
Manage episode 444616810 series 3524393
Switch Sparse Autoencoders efficiently scale feature extraction in neural networks by routing activations through smaller expert models, improving reconstruction and sparsity while reducing computational costs.
https://arxiv.org/abs//2410.08201
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1605 episoder
Все серии
×Velkommen til Player FM!
Player FM scanner netter for høykvalitets podcaster som du kan nyte nå. Det er den beste podcastappen og fungerer på Android, iPhone og internett. Registrer deg for å synkronisere abonnement på flere enheter.