[ECAI 2024] Unveiling the Power of Sparse Neural Networks for Feature Selection
-
Updated
Jul 25, 2024 - Python
[ECAI 2024] Unveiling the Power of Sparse Neural Networks for Feature Selection
Easily create and optimize PyTorch networks as in the Deep Rewiring paper (https://igi-web.tugraz.at/PDF/241.pdf). Install using 'pip install deep_rewire'
My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
Event-based neural networks
Characterization study repository for pruning, a popular way to compress a DL model. this repo also investigates optimal sparse tensor layouts for pruned nets
Neural Networks with Sparse Weights in Rust using GPUs, CPUs, and FPGAs via CUDA, OpenCL, and oneAPI
Sparse Matrix Library for GPUs, CPUs, and FPGAs via CUDA, OpenCL, and oneAPI
Master's Thesis Project - Lottery Tickets contain independent subnetworks when trained on independent tasks.
[ECML-PKDD 2024] Adaptive Sparsity Level during Training for Efficient Time Series Forecasting with Transformers
Offical implementation of "Sparser spiking activity can be better: Feature Refine-and-Mask spiking neural network for event-based visual recognition" (Neural Networks 2023)
[Machine Learning Journal (ECML-PKDD 2022 journal track)] Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders
[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang
Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"
[Machine Learning Journal (ECML-PKDD 2022 journal track)] A Brain-inspired Algorithm for Training Highly Sparse Neural Networks
This is the repository for the SNN-22 Workshop paper on "Generalization and Memorization in Sparse Neural Networks".
[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks
PyTorch Implementation of TopKAST
[IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola Pechenizkiy, and Peter Stone.
Robustness of Sparse Multilayer Perceptrons for Supervised Feature Selection
[ICLR 2022] "Peek-a-Boo: What (More) is Disguised in a Randomly Weighted Neural Network, and How to Find It Efficiently", by Xiaohan Chen, Jason Zhang and Zhangyang Wang.
Add a description, image, and links to the sparse-neural-networks topic page so that developers can more easily learn about it.
To associate your repository with the sparse-neural-networks topic, visit your repo's landing page and select "manage topics."