Find in Library

The inherent sparsity present in convolutional neural networks (CNNs) offers a valuable opportunity to significantly decrease the computational workload during inference. Nevertheless, leveraging unstructured sparsity typically comes with the trade-off of increased complexity or substantial hardware overheads for accelerators. To address these challenges, this research introduces an innovative inner join aimed at effectively reducing the size and power consumption of the sparsity-handling circuit. Additionally, a novel dataflow named Channel Stacking of Sparse Tensors (CSSpa) is presented, focusing on maximizing data reuse to minimize memory accesses &#x2013; an aspect that significantly contributes to overall power consumption. Through comprehensive simulations, CSSpa demonstrates a <inline-formula> <tex-math notation="LaTeX">$1.6\times $ </tex-math></inline-formula> speedup and a <inline-formula> <tex-math notation="LaTeX">$5.6\times $ </tex-math></inline-formula> reduction in SRAM accesses when executing inference on the ResNet50 model, compared to the existing Sparten architecture. Furthermore, the implementation results reveal a notable <inline-formula> <tex-math notation="LaTeX">$2.32\times $ </tex-math></inline-formula> enhancement in hardware resource efficiency and a <inline-formula> <tex-math notation="LaTeX">$3.3\times $ </tex-math></inline-formula> improvement in energy efficiency compared to Sparten.