Research Interests

Computational/ theoretical neuroscience, machine intelligence. Frameworks and representations for understanding the world.

Publications, Preprints

2024

"Zyda: A 1.3 T Dataset for Open Language Modeling"

Y Tokpanov, B Millidge, P Glorioso, J Pilault, A Ibrahim, JCR Whittington, Q Anthony

arXiv, 2024

"Zamba: A Compact 7B SSM Hybrid Model"

P Glorioso, Q Anthony, Y Tokpanov, JCR Whittington, J Pilault, A Ibrahim, B Millidge

arXiv, 2024

2023

"On prefrontal working memory and hippocampal episodic memory: Unifying memories stored in weights and activation slots" [paper]

JCR Whittington, W Dorrell, TEJ Behrens, S Ganguli, M El-Gaby

bioRxiv, 2023

"A Cellular Basis for Mapping Behavioural Structure" [paper]

M El-Gaby, AL Harris, JCR Whittington, W Dorrell, A Bhomick, MW Walton, T Akam, TEJ Behrens

bioRxiv, 2023

"Disentanglement with Biological Constraints: A Theory of Functional Cell Types"  [paper] 

JCR Whittington, W Dorrell, S Ganguli, TEJ Behrens

International Conference on Learning Representations (ICLR), 2023. (Oral & Outstanding Paper Award honourable mention)

"Actionable Neural Representations: Grid Cells from Minimal Constraints"  [paper] 

W Dorrell, PE Latham, TEJ Behrens, JCR Whittington

International Conference on Learning Representations (ICLR), 2023

"Constructing future behaviour in the hippocampal formation through composition and replay" [paper]

JJW Bakermans,  J Warren,  JCR Whittington*, TEJ Behrens*

bioRxiv, 2023

"Disentanglement via latent quantization" [paper]

K Hsu, W Dorrell, JCR Whittington, J Wu, C Finn

Advances in Neural Information Processing Systems (NeurIPS), 2023

2022

"How to build a cognitive map: insights from models of the hippocampal formation" [paper] [preprint] [code]

JCR Whittington, D McCaffary, JJW Bakermans, TEJ Behrens

Nature Neurosciene, 2022

"Relating transformers to models and neural representations of the hippocampal formation" [paper]

JCR Whittington, J Warren, TEJ Behrens

International Conference on Learning Representations (ICLR), 2022

"Reinforcement learning: Dopamine ramps with fuzzy value estimates" [paper]

JCR Whittington, TEJ Behrens

Current Biology, 2022

2021

"Constellation: Learning relational abstractions over objects for compositional imagination" [paper]

JCR Whittington, R Kabra, L Matthey, CP Burgess, A Lerchner

arXiv, 2021

2020

"The Tolman-Eichenbaum Machine: Unifying space and relational memory through generalisation in the hippocampal formation" [paper] [preprint] [code]

JCR Whittington, TH Muller, S Mark, G Chen, C Barry, N Burgess, TEJ Behrens

Cell, 2020

2019

"Theories of error back-propagation in the brain" [paper]

JCR Whittington, R Bogacz

Trends in cognitive sciences, 2019

2018

"What is a cognitive map? Organising knowledge for flexible behaviour" [paper]

TEJ Behrens, TH Muller, JCR Whittington, S Mark, AB Baram, KL Stachenfeld, Z Kurth-Nelson

Neuron, 2018

"Generalisation of structural knowledge in the hippocampal-entorhinal system" [paper] [code]

JCR Whittington, TH Muller, S Mark, C Barry, TEJ Behrens

Advances in Neural Information Processing Systems (NeurIPS), 2018. (Oral)

"Intuitive planning: global navigation through cognitive maps based on grid-like codes" [paper]

AB Baram, TH Muller, JCR Whittington, TEJ Behrens

bioRxiv, 2018

2017

"An approximation of the error backpropagation algorithm in a predictive coding network with local hebbian synaptic plasticity" [paper, code]

JCR Whittington, R Bogacz

Neural computation, 2017