Michael Mahoney

I am at ICSI and the Department of Statistics at UC Berkeley, and I am also in the RISELab (in the past AMPLab) in the Department of EECS. Email: mmahoney is the username, and stat dot berkeley dot edu is the domain name

Most of my work focuses on the applied mathematics of data, in particular on the theory and practice of what is now called big data, although I was doing it back when it was just massive, and prior to that when it was just large. On the theory side, we develop algorithmic and statistical methods for matrix, graph, regression, optimization, and related problems. On the implementation side, we provide implementations (e.g., on single machine, distributed data system, and supercomputer environments) of a range of matrix, graph, and optimization algorithms. On the applied side, we apply these methods to a range of problems in internet and social media analysis, social networks analysis, as well as genetics, mass spec imaging, astronomy, climate, and a range of other scientific applications. For more information, you can also see my CV; and here is a headshot and bio.

Recent News

• Amir Gholami wrote a very nice blog on AI and Memory Wall on recent work we have been doing.

• I was interviewed by Ben Lorica on The Data Exchange. Topics included our recent NeurIPS 2020 Best Paper Award on the column subset selection method, how adversarially-trained deep networks transfer better, how to predict trends in the quality of state-of-the-art neural networks without access to training or testing data, and updates on the WeightWatcher tool.

• Congrulations to Michal Derezinski and Rajiv Khanna for winning the Best Paper Award at NeurIPS 2020.

• I was interviewed by Ben Lorica on O'Reilly Data Show Podcast. Topics included understanding deep neural networks and developing a practical theory for deep learning, our new Hessian AWare Quantization (HAWQ) framework for addressing problems pertaining to model size and inference speed/power, and how these relate to challenges at the foundations of data analysis.

• I am the Director of the new UC Berkeley FODA (Foundations of Data Analysis) Institute grant, which is part of the NSF TRIPODS program, to deepen the theoretical foundations of data science in a new transdisciplinary institute. Also involved are coPIs Bin Yu, Fernando Perez, Michael Jordan, and Peter Bartlett. Here is more information about it:

  The main FODA web page.
  The UC Berkeley press release about FODA.
  The summary article from Datanami about it.
  The original NSF announcement.
  The report from the planning workshop we wrote.

• Our edited volume on The Mathematics of Data, based on lectures from the 2016 PCMI Summer School, is available.

• I talked about our recent results on "Why Deep Learning Works: Implicit Self-Regularization in Deep Neural Networks" at the Simons' Institute 2018 Big Data RandNLA meeting, Sept 2018. Related talks were given by collaborator Charles Martin: at LBNL, June 2018; at ICSI, December 2018; and at Stanford, Januray 2020. More recently, I gave a longer and updated version at SF Bay Area DM-SIG Meeting, February 2019.

• I talked about "Alchemist: An Apache Spark <=> MPI Interface" at the XLDB meeting, May 2018. A related talk was given by postdoc Kai Rothauge at the Spark+AI meeting, June 2018.

• Linear Algebra for Data Science: A four-unit introductory class on linear algebra, from the perspective of probablity and related topics in the mathematics of data. It completely redesigns the usual presentation of linear algebra from the ground up to be more appropriate for data applications. I'll teach this for the first time in Spring 2018. (This is expanded from a two-unit "connector" class on mathematics for matrices/graphs/data that I designes and taught during Spring 2017 and Spring 2016.) (I have a detailed but work-in-progress set of course notes for this class. I will post them at an appropriate point; but, in the meantime, email me if you are interested in them.)

• Our technical report describes RISELab challenges.

• Video synopsis of our Communications of the ACM article on "RandNLA: Randomized Numerical Linear Algebra."

• My postdoc Julian Shun has been awarded the ACM's doctoral dissertation award for his 2015 CMU doctoral thesis "Shared-Memory Parallelism Can Be Simple, Fast, and Scalable".

• Our AMPLab-Cray-NERSC/LBL collaboration, to implement randomized linear algebra (RLA) algorithms in Spark on HPC platforms for LBL's scientific data applications, is described on HPC Wire.

• Role of RLA in HPC, as described HPC Wire.

• I gave a talk on "BIG Biomedicine and the Foundations of BIG Data Analysis" at Stanford University at Stanford Medical School, May 23, 2014, at their "Big Data in BioMedicine" Conference. Click "here" for a video of the talk. They also got two nice CEO-style pictures: here; and here.

Students and Postdocs

I have been fortunate to work with a number of great students and postdocs over the years.

Current Students and Postdocs:

• Emaan Hariri (student, UC Berkeley, MEng capstone, 2020-2021)

• Charles Yang (student, UC Berkeley, MEng capstone, 2020-2021)

• Geoffrey Negiar (PhD student, UC Berkeley, joint w. L. El Ghaoui)

• Aditi Krishnapriyan (postdoc, UC Berkeley / LBNL)

• Zhenyu Liao (postdoc, UC Berkeley)

• Liam Hodgkinson (postdoc, UC Berkeley)

• Jianfei Chen (postdoc, UC Berkeley, joint w. J. Gonzalez)

• Yaoqing Yang (postdoc, UC Berkeley, joint w. J. Gonzalez)

• Michal Derezinski (postdoc, UC Berkeley)

• Rajiv Khanna (postdoc, UC Berkeley)

• Ryan Theisen (PhD student, UC Berkeley)

• Vipul Gupta (PhD student, UC Berkeley, joint w. K. Ramchandran))

• N. Benjamin Erichson (postdoc, UC Berkeley)

• Zhewei Yao (PhD student, UC Berkeley)

• Feynman Liang (PhD student, UC Berkeley)

• Amir Gholaminejad (postdoc, UC Berkeley, joint w. K. Keutzer)

Former Students and Postdocs

• Francisco Utrera (student, UC Berkeley, MEng capstone, 2019-2020)

• Evan Kravitz (student, UC Berkeley, MEng capstone, 2019-2020; onto Amazon)

• Janelle Lines (student, UC Berkeley, MEng capstone, 2019-2020)

• Qixuan Wu (student, UC Berkeley, undergraduate, 2019-2020)

• Vanessa Lin (student, UC Berkeley, undergraduate, 2019-2020)

• Naijing Zhang (student, UC Berkeley, MEng capstone, 2019-2020; onto Google Youtube)

• Yifan Bai (student, UC Berkeley, MEng capstone, 2019-2020; onto Amazon)

• Xinran Rui (student, UC Berkeley, MEng capstone, 2019-2020; onto TensTorrent)

• Sarvagya Singh (student, UC Berkeley, MEng capstone, 2019-2020; onto Forward Health)

• Xing Jin (student, UC Berkeley, MEng capstone, 2019-2020; onto Volume Hedge Fund)

• Vyom Kavishwar (student, UC Berkeley, MEng capstone, 2019-2020; onto Hive)

• Yaohui Cai (visiting researcher, UC Berkeley, 2019-2020, joint w. K. Keutzer; onto Cornell for PhD)

• Sheng Shen (visiting researcher, 2019-2020, joint w. K. Keutzer; onto UCB for PhD)

• Daiyaan Arfeen (student, UC Berkeley, undergraduate 2019-2020, joint w. K. Keutzer; onto CMU for PhD)

• Kai Rothauge (postdoc, UC Berkeley, 2017-2019; onto a startup)

• Linjian Ma (student, UC Berkeley, MEng capstone, 2018-2019; onto UIUC for PhD)

• Gabe Montague (student, UC Berkeley, MEng capstone, 2018-2019; onto Co-Founder of Park and Pedal)

• Jiayu Ye (student, UC Berkeley, MEng capstone, 2018-2019; onto Google)

• Shusen Wang (postdoc, UC Berkeley, 2016-2018; now faculty at Stevens Institute)

• Danqing Zhang (student, UC Berkeley, PhD, 2018, advised by Alexei Pozdnoukhov; now at Amazon)

• Ruoxi Wang (student, Stanford, PhD, 2018, advised by Eric Darve; now at Google)

• Peng Xu (student, Stanford, PhD, 2018; now at Amazon)

• Aditya Devarakonda (student, UC Berkeley, PhD, 2018, joint w. J. Demmel; now at Hopkins APL)

• Norman Mu (visiting researcher, 2018, joint w. K. Keutzer; onto UCB for PhD)

• Stefan Ivo Palombo (student, UC Berkeley, undergraduate thesis, 2017-2018)

• Noah Golmant (student, UC Berkeley, undergraduate, 2017-2018, joint w. J. Gonzalez; now at OpenAI)

• Kimon Fountoulakis (postdoc, UC Berkeley, 2015-2018; now faculty at Waterloo)

• Julian Shun (postdoc, UC Berkeley, 2015-2017; now faculty at MIT)

• Fred Roosta (postdoc, UC Berkeley, 2015-2017; now faculty at Queensland)

• Alex Gittens (postdoc, UC Berkeley, 2015-2017; now faculty at RPI)

• Evgeniy Faerman (visiting researcher, UC Berkeley, 2016-2017)

• Felix Borutta (visiting researcher, UC Berkeley, 2016-2017)

• Liping Jing (visiting researcher, ICSI, 2016-2017, joint w. G. Friedland)

• Di Wang (student, UC Berkeley, PhD, 2017, joint w. S. Rao; now at Google)

• Simon Du (student, UC Berkeley, undergraduate thesis, 2014-2015, joint w. M. Gu; now at Washington)

• Jiyan Yang (student, Stanford, PhD, 2016; now at Facebook)

• Aaron Adcock (student, Stanford, PhD, 2014; now at Facebook)

• Xiangrui Meng (student, Stanford, PhD, 2014; at LinkedIn, then Databricks)

• Lorenzo Orecchia (intern, 2008, Yahoo; faculty at Boston, then Chicago)

• Jure Leskovec (intern, Yahoo, 2007; now faculty at Stanford)

• Hari Narayanan (intern, Yahoo, 2007; faculty at Washington, then TIFR, Mumbai)

• Jeff Phillips (intern, Yahoo, 2007; now faculty at Utah)

• Lek-Heng Lim (intern, Yahoo, 2006; now faculty at Chicago)

• Boulos Harb (intern, Yahoo, 2006; now at Google)

• James Campbell (student, Yale, undergraduate thesis, 2005)