Matrix Multiplication on Low-Power Processors
Research conducted under the supervision of Enrique Quintana and Adrian Castellon.
The Evolution of Matrix Multiplication Algorithms
Matrix multiplication is a core operation in mathematics, computer science, and engineering, with widespread applications in scientific computing, graphics, physics simulations, and deep learning. The computational complexity of this operation has been a major focus in algorithm research, particularly the pursuit of lowering its exponent, commonly denoted as omega (ω).
A breakthrough occurred in 1969 when Strassen dramatically reduced the exponent below the classical cubic bound, sparking a decades-long race among researchers to discover even faster algorithms. The progress is charted by a series of landmark results, especially in the early 1980s and again in the last decade. Recent advances (2020–2024) highlight how even minor improvements are now hard-won and intellectually significant.
Optimizing matrix multiplication is not only a theoretical challenge but also critical for real-world performance, especially in resource-constrained environments such as low-power processors—an area at the heart of this research project.
Visual Timeline
Figure 1. Timeline of major advances in reducing the exponent of matrix multiplication (omega, ω). Each step represents a new upper bound, marking significant milestones in computational complexity theory.
Historical Table of Key Results
| Year | Omega Bound | Authors | Reference |
|---|---|---|---|
| 1969 | 2.8074 | Volker Strassen | Numerische Mathematik |
| 1978 | 2.7960 | Victor Pan | IEEE FOCS |
| 1979 | 2.7800 | Dario Bini, Massimo Capovani, Felice Romani | Linear Algebra Appl. |
| 1981 | 2.5220 | Arnold Schönhage | SIAM J. Comput. |
| 1981 | 2.5170 | Felice Romani | SIAM J. Comput. |
| 1981 | 2.4960 | Don Coppersmith, Shmuel Winograd | IEEE STOC |
| 1986 | 2.4790 | Volker Strassen | Numerische Mathematik |
| 1990 | 2.3755 | Don Coppersmith, Shmuel Winograd | J. Symb. Comput. |
| 2010 | 2.3737 | Andrew Stothers | Thesis |
| 2012 | 2.3729 | Virginia Vassilevska Williams | STOC |
| 2014 | 2.3728639 | François Le Gall | arXiv |
| 2020 | 2.3728596 | Joshua Alman, Virginia Vassilevska Williams | arXiv |
| 2022 | 2.3718660 | Ran Duan, Zeyu Wu, Chi Zhou | arXiv |
| 2024 | 2.3715520 | Virginia Vassilevska Williams, Zhixian Xu, Kai Xu, Chi Zhou | arXiv |
| 2024 | 2.3713390 | Joshua Alman, Ran Duan, Virginia Vassilevska Williams, Zhixian Xu, Kai Xu, Chi Zhou | arXiv |
This timeline and table summarize more than fifty years of ongoing advances in one of theoretical computer science’s most fundamental questions, providing the context for this project’s focus on practical, energy-efficient computation.