Stanford & Oxford University & Zyphra
email: jcrwhittington at gmail dot com
Research Interests
Computational/ theoretical neuroscience, machine intelligence. Frameworks and representations for understanding the world.
Publications, Preprints
2024
"Zyda: A 1.3 T Dataset for Open Language Modeling"
Y Tokpanov, B Millidge, P Glorioso, J Pilault, A Ibrahim, JCR Whittington, Q Anthony
arXiv, 2024
"Zamba: A Compact 7B SSM Hybrid Model"
P Glorioso, Q Anthony, Y Tokpanov, JCR Whittington, J Pilault, A Ibrahim, B Millidge
arXiv, 2024
2023
"On prefrontal working memory and hippocampal episodic memory: Unifying memories stored in weights and activation slots" [paper]
JCR Whittington, W Dorrell, TEJ Behrens, S Ganguli, M El-Gaby
bioRxiv, 2023
"A Cellular Basis for Mapping Behavioural Structure" [paper]
M El-Gaby, AL Harris, JCR Whittington, W Dorrell, A Bhomick, MW Walton, T Akam, TEJ Behrens
bioRxiv, 2023
"Disentanglement with Biological Constraints: A Theory of Functional Cell Types" [paper]
JCR Whittington, W Dorrell, S Ganguli, TEJ Behrens
International Conference on Learning Representations (ICLR), 2023. (Oral & Outstanding Paper Award honourable mention)
"Actionable Neural Representations: Grid Cells from Minimal Constraints" [paper]
W Dorrell, PE Latham, TEJ Behrens, JCR Whittington
International Conference on Learning Representations (ICLR), 2023
"Constructing future behaviour in the hippocampal formation through composition and replay" [paper]
JJW Bakermans, J Warren, JCR Whittington*, TEJ Behrens*
bioRxiv, 2023
"Disentanglement via latent quantization" [paper]
K Hsu, W Dorrell, JCR Whittington, J Wu, C Finn
Advances in Neural Information Processing Systems (NeurIPS), 2023
2022
"How to build a cognitive map: insights from models of the hippocampal formation" [paper] [preprint] [code]
JCR Whittington, D McCaffary, JJW Bakermans, TEJ Behrens
Nature Neurosciene, 2022
"Relating transformers to models and neural representations of the hippocampal formation" [paper]
JCR Whittington, J Warren, TEJ Behrens
International Conference on Learning Representations (ICLR), 2022
"Reinforcement learning: Dopamine ramps with fuzzy value estimates" [paper]
JCR Whittington, TEJ Behrens
Current Biology, 2022
2021
"Constellation: Learning relational abstractions over objects for compositional imagination" [paper]
JCR Whittington, R Kabra, L Matthey, CP Burgess, A Lerchner
arXiv, 2021
2020
"The Tolman-Eichenbaum Machine: Unifying space and relational memory through generalisation in the hippocampal formation" [paper] [preprint] [code]
JCR Whittington, TH Muller, S Mark, G Chen, C Barry, N Burgess, TEJ Behrens
Cell, 2020
2019
"Theories of error back-propagation in the brain" [paper]
JCR Whittington, R Bogacz
Trends in cognitive sciences, 2019
2018
"What is a cognitive map? Organising knowledge for flexible behaviour" [paper]
TEJ Behrens, TH Muller, JCR Whittington, S Mark, AB Baram, KL Stachenfeld, Z Kurth-Nelson
Neuron, 2018
"Generalisation of structural knowledge in the hippocampal-entorhinal system" [paper] [code]
JCR Whittington, TH Muller, S Mark, C Barry, TEJ Behrens
Advances in Neural Information Processing Systems (NeurIPS), 2018. (Oral)
"Intuitive planning: global navigation through cognitive maps based on grid-like codes" [paper]
AB Baram, TH Muller, JCR Whittington, TEJ Behrens
bioRxiv, 2018
2017
"An approximation of the error backpropagation algorithm in a predictive coding network with local hebbian synaptic plasticity" [paper, code]
JCR Whittington, R Bogacz
Neural computation, 2017