Raymond Chua

📍 Montréal, Québec, Canada

Last updated 25 Nov 2025.

I am a final-year PhD candidate at McGill University and Mila, supervised by Doina Precup and Blake Richards. My research bridges machine learning and computational neuroscience, exploring how neural mechanisms of representation and memory can inspire more adaptive and continual learning in artificial agents. Building on this foundation, I am increasingly interested in mechanistic interpretability, using techniques inspired by neuroscience — such as representation similarity analysis and cross-attention probing — to understand how predictive representations such as successor features encode and transform information over time. I’m expected to graduate in Fall 2025 and am seeking opportunities to study and design learning systems that bridge theory (reinforcement learning), scalable models (foundation and language models), and real-world decision-making (robotics, embodied AI, and autonomous systems).

Beyond research, I’m passionate about improving AI capabilities through academic–industry partnerships, where I mentor students from McGill, UdeM, and Mila as they tackle real-world challenges with companies seeking to integrate machine learning into their products and pipelines. During my free time, I enjoy pushing both my intellectual and physical abilities through triathlon, which continues to teach me about endurance, balance, and growth.

news

Nov 24, 2025	Had the pleasure of giving an invited talk at Graphcore in London, where I presented my work on brain-inspired continual reinforcement learning. Great conversations with the team about bridging neuroscience and ML, and exciting to see the strong research culture there.
Nov 20, 2025	Visited Prof. Claudia Clopath’s lab at Imperial College London, where I gave a talk on our work titled “Brain-Inspired Continual Reinforcement Learning Agents.” I have met Claudia numerous times throughout my PhD journey, from Cosyne to giving a talk at our Biological and Artificial RL workshop at NeurIPS in 2020. It is my great honor to be able to spend time with her lab and learned about what they are working on as well!
Nov 13, 2025	Visited Prof. Rui Ponte Costa’s lab at University of Oxford, where I gave a talk on our work titled “Brain-Inspired Continual Reinforcement Learning Agents.” Rui was my master thesis supervisor, and it was wonderful to reconnect with him and his lab again!
Nov 12, 2025	Met up with the team at Prima Mente which is neuroscience-AI startup in London, UK, focusing on understanding the brain and advancing potential treatments for neurological and neurodegenerative diseases.
Oct 20, 2025	Gave a talk titled “Brain-Inspired Reinforcement Learning Agents” to visiting researchers from the Lamarr Institute for Machine Learning and Artificial Intelligence (Germany) at Mila – Quebec AI Institute, Montréal, Canada.

selected publications

NeurIPS

Deep RL Needs Deep Behavior Analysis: Exploring Implicit Planning by Model-Free Agents in Open-Ended Environments

Riley Simmons-Edler, Ryan P Badman, Felix Baastad Berg, and 5 more authors

Proceedings of the 39th Conference on Neural Information Processing Systems (NeurIPS), 2025

This is my first collaboration work with members of Prof. Kanaka Rajan’s lab. Riley and Ryan are first authors, and Prof. Kanaka Rajan is the corresponding author.

PDF
NeurIPS

Learning Successor Features the Simple Way

Raymond Chua, Arna Ghosh, Christos Kaplanis, and 2 more authors

Proceedings of the 38th Conference on Neural Information Processing Systems (NeurIPS), 2024

Raymond Chua is the corresponding author. Blake A. Richards and Doina Precup are co-senior authors.

PDF Code
Journal

Learning offline: memory replay in biological and artificial reinforcement learning

Emma L. Roscow, Raymond Chua, Rui Ponte Costa, and 2 more authors

Trends in Neurosciences, 2021

Abs PDF

Learning to act in an environment to maximise rewards is among the brain’s key functions. This process has often been conceptualised within the framework of reinforcement learning, which has also gained prominence in machine learning and artificial intelligence (AI) as a way to optimise decision making. A common aspect of both biological and machine reinforcement learning is the reactivation of previously experienced episodes, referred to as replay. Replay is important for memory consolidation in biological neural networks and is key to stabilising learning in deep neural networks. Here, we review recent developments concerning the functional roles of replay in the fields of neuroscience and AI. Complementary progress suggests how replay might support learning processes, including generalisation and continual learning, affording opportunities to transfer knowledge across the two fields to advance the understanding of biological and artificial learning and memory.