Optimizing Sparse Matrix-Vector Multiplication on GPUS via Index Compression

Xue Sun, Kai Cheng Wei, Lien Fu Lai, Sung Han Tsai, Chao Chin Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Sparse matrix-vector multiplication (SpMV) as one of the most significant scientific kernels has been widely used in many scientific disciplines. In practical applications, large-scale spare matrices are usually used for calculation. During these years, Graphic Processing Unit (GPU) has become a powerful platform for high-performance computing, and optimizing SpMV on GPU based systems for efficient performance is the principal interest in many researches. In this paper, we proposed a new method to optimize SpMV on GPUs via index compression. Our index compression method can reduce the index value of the access space. The memory space for recording each column index is significantly reduced from two bytes to one byte, which outperforms the previous work on access performance. The main contributions we make are as follows: (1) Only one byte for each column index is required, which can significantly reduce the working set of the column index and further improve the cache hit ration. (2) Our method can be applied to any kind of matrices, while the previous work can only apply to subset of the matrices. Computational experiments on problems according to the previous work reveal that the best performance improvement ration for ours is up to about 1.5.

Original languageEnglish
Title of host publicationProceedings of 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018
EditorsBing Xu
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages598-602
Number of pages5
ISBN (Electronic)9781538645086
DOIs
Publication statusPublished - 2018 Dec 14
Event3rd IEEE Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018 - Chongqing, China
Duration: 2018 Oct 122018 Oct 14

Publication series

NameProceedings of 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018

Other

Other3rd IEEE Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018
CountryChina
CityChongqing
Period18-10-1218-10-14

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Information Systems
  • Control and Optimization
  • Instrumentation

Cite this

Sun, X., Wei, K. C., Lai, L. F., Tsai, S. H., & Wu, C. C. (2018). Optimizing Sparse Matrix-Vector Multiplication on GPUS via Index Compression. In B. Xu (Ed.), Proceedings of 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018 (pp. 598-602). [8577693] (Proceedings of 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference, IAEAC 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IAEAC.2018.8577693