Find in Library
Search millions of books, articles, and more
Indexed Open Access Databases
Optimization of Microarchitecture and Dataflow for Sparse Tensor CNN Acceleration
oleh: Ngoc-Son Pham, Taeweon Suh
Format: | Article |
---|---|
Diterbitkan: | IEEE 2023-01-01 |
Deskripsi
The inherent sparsity present in convolutional neural networks (CNNs) offers a valuable opportunity to significantly decrease the computational workload during inference. Nevertheless, leveraging unstructured sparsity typically comes with the trade-off of increased complexity or substantial hardware overheads for accelerators. To address these challenges, this research introduces an innovative inner join aimed at effectively reducing the size and power consumption of the sparsity-handling circuit. Additionally, a novel dataflow named Channel Stacking of Sparse Tensors (CSSpa) is presented, focusing on maximizing data reuse to minimize memory accesses – an aspect that significantly contributes to overall power consumption. Through comprehensive simulations, CSSpa demonstrates a <inline-formula> <tex-math notation="LaTeX">$1.6\times $ </tex-math></inline-formula> speedup and a <inline-formula> <tex-math notation="LaTeX">$5.6\times $ </tex-math></inline-formula> reduction in SRAM accesses when executing inference on the ResNet50 model, compared to the existing Sparten architecture. Furthermore, the implementation results reveal a notable <inline-formula> <tex-math notation="LaTeX">$2.32\times $ </tex-math></inline-formula> enhancement in hardware resource efficiency and a <inline-formula> <tex-math notation="LaTeX">$3.3\times $ </tex-math></inline-formula> improvement in energy efficiency compared to Sparten.