STAR: Sparse thresholded activation under partial-regularization for activation sparsity exploration

Z Zhu, A Pourtaherian, L Waeijen… - 2023 IEEE/CVF …, 2023 - ieeexplore.ieee.org
Brain-inspired event-driven processors execute deep neural networks (DNNs) in a sparsity-
aware manner. Specifically, if more zeros are induced in the activation maps, less
computation will be performed in the succeeding convolution layer. However, inducing
activation sparsity in DNNs remains a challenge. To address this, we propose a training
approach STAR (Sparse Thresholded Activation under partial-Regularization), which
combines activation regularization with thresholding, to overcome the barrier of a single …

[CITATION][C] Star: Sparse thresholded activation under partial-regularization for activation sparsity exploration. In 2023 IEEE

Z Zhu, A Pourtaherian, L Waeijen, E Bondarev… - CVF Conference on Computer …
Showing the best results for this search. See all results