Oxytocin receptor behavioral effects and cell types in the bed nucleus of the stria terminalis

Oxytocin is a neuropeptide that can produce anxiolytic effects and promote social approach. However, emerging evidence shows that under some conditions, oxytocin can instead induce anxiety-related behaviors. These diverse effects of oxytocin appear to be mediated by circuit-specific actions. Recent data showed that inhibition of oxytocin receptors (OTRs) in the bed nucleus of the stria terminalis (BNST) was sufficient to increase social approach and decrease social vigilance in female California mice (Peromyscus californicus) exposed to social defeat stress. As a member of the G-protein coupled receptor family, OTRs can induce distinct downstream pathways by coupling to different G-protein isoforms. We show that infusion of carbetocin, a biased OTR-Gq agonist, in the BNST reduced social approach in both female and male California mice. In both females and males, carbetocin also increased social vigilance. To gain insight into cell types that could be mediating this effect, we analyzed previously published single-cell RNAseq data from the BNST and nucleus accumbens (NAc). In the NAc, we and others showed that OTR activation promotes social approach behaviors. In the BNST, Oxtr was expressed in over 40 cell types, that span both posterior and anterior subregions of the BNST. The majority of Oxtr-expressing neurons were GABAergic. In the anterior regions of BNST targeted in our carbetocin experiments, Cyp26b1-expressing neurons had high average Oxtr expression. In the NAc, most Oxtr+ cells were D1 dopamine receptor-expressing neurons and interneurons. These differences in Oxtr cell type distribution may help explain how activation of OTR in BNST versus NAc can have different effects on social approach and social vigilance.