Today's guest is the amazing Google DeepMind research scientist, Dr. Rosanne Liu!

Rosanne:

• Is a Research Scientist at Google DeepMind in California.

• Is Co-Founder and Executive Director of ML Collective, a non-profit that provides global ML research training and mentorship.

• Was a founding member of Uber AI Labs, where she served as a Senior Research Scientist.

• She has published deep learning research in top academic venues such as NeurIPS, ICLR, ICML and Science, and her work has been covered in publications like WIRED and the MIT Tech Review.

• Holds a PhD in Computer Science from Northwestern University.

Today’s episode, particularly in the second half when we dig into Rosanne’s fascinating research, is relatively technical so will probably appeal most to hands-on practitioners like data scientists and ML engineers.

In today’s episode, Rosanne details:

• The problem she founded the ML Collective to solve.

• How her work on the “intrinsic dimension” of deep learning models inspired the now-standard LoRA approach to fine-tuning LLMs.

• The thorny problems with LLM evaluation benchmarks and how they might be solved.

• The pros and cons of curiosity- vs goal-driven ML research.

• The positive impacts of diversity, equity and inclusion in the ML community.

The SuperDataScience podcast is available on all major podcasting platforms, YouTube, and at SuperDataScience.com.