Spontaneous behaviour is structured by reinforcement without explicit reward
Creators
- Markowitz, Jeffrey E.1
- Gillis, Winthrop F.2
- Jay, Maya2
- Wood, Jeffrey2
- Harris, Ryley2
- Cieszkowski, Robert2
- Scott, Rebecca2
- Brann, David2
- Koveal, Dorothy2
- Kula, Tomasz2
- Weinreb, Caleb2
- Osman, Mohammed A2
- Pinto, Sandra Romero3
- Uchida, Naoshige3
- Linderman, Scott4
- Sabatini, Bernardo5
- Datta, Sandeep Robert2
- 1. Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University
- 2. Department of Neurobiology, Harvard Medical School
- 3. Department of Molecular and Cellular Biology, Harvard University; Center for Brain Science, Harvard University
- 4. Wu Tsai Neurosciences Institute, Stanford University; Department of Statistics, Stanford University
- 5. Department of Neurobiology, Harvard Medical School; Howard Hughes Medical Institute
Description
Spontaneous behaviour is structured by reinforcement without explicit reward
Repository containing datasets obtained for Markowitz, Gillis, Jay et al. 2023 Nature https://doi.org/10.1038/s41586-022-05611-2
Github link to related analysis code: https://github.com/dattalab/dopamine-reinforces-spontaneous-behavior
Abstract
Spontaneous animal behaviour is built from action modules that are concatenated by the brain into sequences. However, the neural mechanisms that guide the composition of naturalistic, self-motivated behaviour remain unknown. Here we show that dopamine systematically fluctuates in the dorsolateral striatum (DLS) as mice spontaneously express sub-second behavioural modules, despite the absence of task structure, sensory cues or exogenous reward. Photometric recordings and calibrated closed-loop optogenetic manipulations during open field behaviour demonstrate that DLS dopamine fluctuations increase sequence variation over seconds, reinforce the use of associated behavioural modules over minutes, and modulate the vigour with which modules are expressed, without directly influencing movement initiation or moment-to-moment kinematics. Although the reinforcing effects of optogenetic DLS dopamine manipulations vary across behavioural modules and individual mice, these differences are well predicted by observed variation in the relationships between endogenous dopamine and module use. Consistent with the possibility that DLS dopamine fluctuations act as a teaching signal, mice build sequences during exploration as if to maximize dopamine. Together, these findings suggest a model in which the same circuits and computations that govern action choices in structured tasks have a key role in sculpting the content of unconstrained, high-dimensional, spontaneous behaviour.
Files
dopamine-reinforces-spontaneous-behavior.zip
Files
(60.8 GB)
Name | Size | Download all |
---|---|---|
md5:8b858e447902642555200faf89e00179
|
60.8 GB | Preview Download |
Additional details
Related works
- Is cited by
- Journal article: 10.1038/s41586-022-05611-2 (DOI)