Operant conditioning of neural activity in freely behaving monkeys with intracranial reinforcement

被引:14
作者
Eaton, Ryan W. [1 ]
Libey, Tyler [2 ,3 ]
Fetz, Eberhard E. [1 ,2 ,3 ]
机构
[1] Univ Washington, Dept Physiol & Biophys, 1705 NE Pacific St, Seattle, WA 98195 USA
[2] Univ Washington, Dept Bioengn, Seattle, WA 98195 USA
[3] Univ Washington, Engn Res Ctr, Natl Sci Fdn, Ctr Sensorimotor Neural Engn, Seattle, WA 98195 USA
基金
美国国家卫生研究院; 美国国家科学基金会;
关键词
intracranial reinforcement; primate; operant conditioning; neural activity; free behavior; PRIMARY MOTOR CORTEX; NUCLEUS-ACCUMBENS; SELF-STIMULATION; ARM MUSCLES; REWARD; CELLS; RESPONSES; PLASTICITY; COMPUTER; NEURONS;
D O I
10.1152/jn.00423.2016
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Operant conditioning of neural activity has typically been performed under controlled behavioral conditions using food reinforcement. This has limited the duration and behavioral context for neural conditioning. To reward cell activity in unconstrained primates, we sought sites in nucleus accumbens (NAc) whose stimulation reinforced operant responding. In three monkeys, NAc stimulation sustained performance of a manual target-tracking task, with response rates that increased monotonically with increasing NAc stimulation. We recorded activity of single motor cortex neurons and documented their modulation with wrist force. We conditioned increased firing rates with the monkey seated in the training booth and during free behavior in the cage using an autonomous head-fixed recording and stimulating system. Spikes occurring above baseline rates triggered single or multiple electrical pulses to the reinforcement site. Such rate-contingent, unit-triggered stimulation was made available for periods of 1-3 min separated by 3-10 min time-out periods. Feedback was presented as event-triggered clicks both in-cage and in-booth, and visual cues were provided in many in-booth sessions. In-booth conditioning produced increases in single neuron firing probability with intracranial reinforcement in 48 of 58 cells. Reinforced cell activity could rise more than five times that of non-reinforced activity. In-cage conditioning produced significant increases in 21 of 33 sessions. In-cage rate changes peaked later and lasted longer than in-booth changes, but were often comparatively smaller, between 13 and 18% above non-reinforced activity. Thus intracranial stimulation reinforced volitional increases in cortical firing rates during both free behavior and a controlled environment, although changes in the latter were more robust. NEW & NOTEWORTHY Closed-loop brain-computer interfaces (BCI) were used to operantly condition increases in muscle and neural activity in monkeys by delivering activity-dependent stimuli to an intracranial reinforcement site (nucleus accumbens). We conditioned increased firing rates with the monkeys seated in a training booth and also, for the first time, during free behavior in a cage using an autonomous head-fixed BCI.
引用
收藏
页码:1112 / 1125
页数:14
相关论文
共 50 条
  • [31] Relationship between reinforcement rate and response rate in Pavlovian and operant conditioning with compound stimuli in rats
    Carneiro, Andeson Goncalves
    Paes, Guilherme
    Garcia-Mijares, Miriam
    BEHAVIOURAL PROCESSES, 2021, 191
  • [32] Optogenetic control of selective neural activity in multiple freely moving Drosophila adults
    Wu, Ming-Chin
    Chu, Li-An
    Hsiao, Po-Yen
    Lin, Yen-Yin
    Chi, Chen-Chieh
    Liu, Tsung-Ho
    Fu, Chien-Chung
    Chiang, Ann-Shyn
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (14) : 5367 - 5372
  • [33] Miniscope Imaging of Nucleus Accumbens Neural Activity in Freely Behaving Rats: Virus Injection, Gradient Index Lens Implantation, Recording Strategies, and Analytical Methods
    Beacher, Nicholas J.
    Wang, Michael W.
    Broomer, Matthew C.
    Kuo, Jessica Y.
    Washington, Kayden A.
    Targum, Miranda
    Zhang, Yan
    Barbera, Giovanni
    Lin, Da-Ting
    CURRENT PROTOCOLS, 2025, 5 (01):
  • [34] Memristor-Based Neural Network Circuit of Operant Conditioning Accorded With Biological Feature
    Sun, Junwei
    Han, Juntao
    Wang, Yanfeng
    Liu, Peng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (11) : 4475 - 4486
  • [35] Acute and chronic methylphenidate modulates the neuronal activity of the caudate nucleus recorded from freely behaving rats
    Claussen, Catherine
    Dafny, Nachum
    BRAIN RESEARCH BULLETIN, 2012, 87 (4-5) : 387 - 396
  • [36] Memristive Neural Network Circuit of Operant Conditioning With Reward Delay and Variable Punishment Intensity
    Chen, Bei
    Liu, Fazhan
    Iu, Herbert Ho-Ching
    Bao, Han
    Xu, Quan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (03) : 1002 - 1006
  • [37] Chronic methylphenidate modulates locomotor activity and sensory evoked responses in the VTA and NAc of freely behaving rats
    Yang, Pamela B.
    Swann, Alan C.
    Dafny, Nachum
    NEUROPHARMACOLOGY, 2006, 51 (03) : 546 - 556
  • [38] Acute and chronic methylphenidate alters prefrontal cortex neuronal activity recorded from freely behaving rats
    Salek, R. Layla
    Claussen, Catherine M.
    Perez, Adriana
    Dafny, Nachum
    EUROPEAN JOURNAL OF PHARMACOLOGY, 2012, 679 (1-3) : 60 - 67
  • [39] Nucleus accumbens neuronal activity in freely behaving rats is modulated following acute and chronic methylphenidate administration
    Chong, Samuel L.
    Claussen, Catherine M.
    Dafny, Nachum
    BRAIN RESEARCH BULLETIN, 2012, 87 (4-5) : 445 - 456
  • [40] A non-invasive head-holding device for chronic neural recordings in awake behaving monkeys
    Amemori, Satoko
    Amemori, Ken-ichi
    Cantor, Margaret L.
    Raybiel, Ann M.
    JOURNAL OF NEUROSCIENCE METHODS, 2015, 240 : 154 - 160