Matrix Multiplication on Low-Power Processors

Research conducted under the supervision of Enrique Quintana and Adrian Castellon.

The Evolution of Matrix Multiplication Algorithms

Matrix multiplication is a core operation in mathematics, computer science, and engineering, with widespread applications in scientific computing, graphics, physics simulations, and deep learning. The computational complexity of this operation has been a major focus in algorithm research, particularly the pursuit of lowering its exponent, commonly denoted as omega (ω).

A breakthrough occurred in 1969 when Strassen dramatically reduced the exponent below the classical cubic bound, sparking a decades-long race among researchers to discover even faster algorithms. The progress is charted by a series of landmark results, especially in the early 1980s and again in the last decade. Recent advances (2020–2024) highlight how even minor improvements are now hard-won and intellectually significant.

Optimizing matrix multiplication is not only a theoretical challenge but also critical for real-world performance, especially in resource-constrained environments such as low-power processors—an area at the heart of this research project.


Visual Timeline

Timeline of Matrix Multiplication Exponent Reduction

Figure 1. Timeline of major advances in reducing the exponent of matrix multiplication (omega, ω). Each step represents a new upper bound, marking significant milestones in computational complexity theory.


Historical Table of Key Results

Table 1. Key milestones in reducing the exponent for matrix multiplication. Lower omega values reflect more efficient algorithms and progress in both theoretical and practical computational mathematics.
Year Omega Bound Authors Reference
1969 2.8074 Volker Strassen Numerische Mathematik
1978 2.7960 Victor Pan IEEE FOCS
1979 2.7800 Dario Bini, Massimo Capovani, Felice Romani Linear Algebra Appl.
1981 2.5220 Arnold Schönhage SIAM J. Comput.
1981 2.5170 Felice Romani SIAM J. Comput.
1981 2.4960 Don Coppersmith, Shmuel Winograd IEEE STOC
1986 2.4790 Volker Strassen Numerische Mathematik
1990 2.3755 Don Coppersmith, Shmuel Winograd J. Symb. Comput.
2010 2.3737 Andrew Stothers Thesis
2012 2.3729 Virginia Vassilevska Williams STOC
2014 2.3728639 François Le Gall arXiv
2020 2.3728596 Joshua Alman, Virginia Vassilevska Williams arXiv
2022 2.3718660 Ran Duan, Zeyu Wu, Chi Zhou arXiv
2024 2.3715520 Virginia Vassilevska Williams, Zhixian Xu, Kai Xu, Chi Zhou arXiv
2024 2.3713390 Joshua Alman, Ran Duan, Virginia Vassilevska Williams, Zhixian Xu, Kai Xu, Chi Zhou arXiv

This timeline and table summarize more than fifty years of ongoing advances in one of theoretical computer science’s most fundamental questions, providing the context for this project’s focus on practical, energy-efficient computation.