Explore the vast range of titles available.

Naturalistic imaging paradigms, in which participants view complex videos in the scanner, are increasingly used in human cognitive neuroscience. Videos evoke temporally synchronized brain responses that are similar across subjects as well as within subjects, but the reproducibility of these brain responses across different data acquisition sites has not yet been quantified. Here, we characterize the consistency of brain responses across independent samples of participants viewing the same videos in functional magnetic resonance imaging (fMRI) scanners at different sites (Indiana University and Caltech). We compared brain responses collected at these different sites for two carefully matched datasets with identical scanner models, acquisition, and preprocessing details, along with a third unmatched dataset in which these details varied. Our overall conclusion is that for matched and unmatched datasets alike, video‐evoked brain responses have high consistency across these different sites, both when compared across groups and across pairs of individuals. As one might expect, differences between sites were larger for unmatched datasets than matched datasets. Residual differences between datasets could in part reflect participant‐level variability rather than scanner‐ or data‐ related effects. Altogether our results indicate promise for the development and, critically, generalization of video fMRI studies of individual differences in healthy and clinical populations alike. We found that when independent samples of participants watched the same videos in functional magnetic resonance imaging scanners at different sites, brain responses across most of the cortex were highly consistent across the two sites. As predicted, the highest across‐site consistency was observed when acquisition and processing details were carefully matched, but consistency remained high even when acquisition and processing details differed.

Recently, movie-watching fMRI has been recognized as a novel method to explore brain working patterns. Previous researchers correlated natural stimuli with brain responses to explore brain functional specialization by “reverse correlation” methods, which were based on within-group analysis. However, what external stimuli drive significantly different brain responses in two groups of different subjects were still unknown. To address this, sliding time windows technique combined with inter-subject functional correlation (ISFC) was proposed to detect movie events with significant group differences between autism spectrum disorder (ASD) and typical development (TD) subjects. Then, using inter-subject correlation (ISC) and ISFC analysis, we found that in three movie events involving character emotions, the ASD group showed significantly lower ISC in the middle temporal gyrus, temporal pole, cerebellum, caudate, precuneus, and showed decreased functional connectivity between large scale networks than that in TD. Under the movie event focusing on objects and scenes shot, the dorsal and ventral attentional networks of ASD have a strong synchronous response. Meanwhile, ASD also displayed increased functional connectivity between the frontoparietal network and dorsal attention network, frontoparietal network and sensorimotor network than TD. ASD has its own unique synchronous response rather than being “unresponsive” in natural movie-watching. Our findings provide a new method and valuable insight for exploring the inconsistency of the brain “tick collectively” to same natural stimuli. This analytic approach has the potential to explore pathological mechanisms and promote training methods of ASD.

Two ongoing movements in human cognitive neuroscience have researchers shifting focus from group-level inferences to characterizing single subjects, and complementing tightly controlled tasks with rich, dynamic paradigms such as movies and stories. Yet relatively little work combines these two, perhaps because traditional analysis approaches for naturalistic imaging data are geared toward detecting shared responses rather than between-subject variability. Here, we review recent work using naturalistic stimuli to study individual differences, and advance a framework for detecting structure in idiosyncratic patterns of brain activity, or “idiosynchrony”. Specifically, we outline the emerging technique of inter-subject representational similarity analysis (IS-RSA), including its theoretical motivation and an empirical demonstration of how it recovers brain-behavior relationships during movie watching using data from the Human Connectome Project. We also consider how stimulus choice may affect the individual signal and discuss areas for future research. We argue that naturalistic neuroimaging paradigms have the potential to reveal meaningful individual differences above and beyond those observed during traditional tasks or at rest. •We review literature using naturalistic paradigms to study individual differences.•We discuss the phenomenon of idiosyncratic time-locked responses (“idiosynchrony”).•We outline inter-subject representational similarity analysis (IS-RSA).•We apply IS-RSA to reveal brain-behavior relationships during movie watching.•We consider the role of stimulus selection and other directions for future work.

When people observe one another, behavioural alignment can be detected at many levels, from the physical to the mental. Likewise, when people process the same highly complex stimulus sequences, such as films and stories, alignment is detected in the elicited brain activity. In early sensory areas, shared neural patterns are coupled to the low-level properties of the stimulus (shape, motion, volume, etc.), while in high-order brain areas, shared neural patterns are coupled to high-levels aspects of the stimulus, such as meaning. Successful social interactions require such alignments (both behavioural and neural), as communication cannot occur without shared understanding. However, we need to go beyond simple, symmetric (mirror) alignment once we start interacting. Interactions are dynamic processes, which involve continuous mutual adaptation, development of complementary behaviour and division of labour such as leader–follower roles. Here, we argue that interacting individuals are dynamically coupled rather than simply aligned. This broader framework for understanding interactions can encompass both processes by which behaviour and brain activity mirror each other (neural alignment), and situations in which behaviour and brain activity in one participant are coupled (but not mirrored) to the dynamics in the other participant. To apply these more sophisticated accounts of social interactions to the study of the underlying neural processes we need to develop new experimental paradigms and novel methods of data analysis

Humans have a striking ability to infer meaning from even the sparsest and most abstract forms of narratives. At the same time, flexibility in the form of a narrative is matched by inherent ambiguity in its interpretation. How does the brain represent subtle, idiosyncratic differences in the interpretation of abstract and ambiguous narratives? In this fMRI study, subjects were scanned either watching a novel 7-min animation depicting a complex narrative through the movement of geometric shapes, or listening to a narration of the animation's social story. Using an intersubject representational similarity analysis that compared interpretation similarity and neural similarity across subjects, we found that the more similar two people's interpretations of the abstract shapes animation were, the more similar were their neural responses in regions of the default mode network (DMN) and fronto-parietal network. Moreover, these shared responses were modality invariant: the shapes movie and the verbal interpretation of the movie elicited shared responses in linguistic areas and a subset of the DMN when subjects shared interpretations. Together, these results suggest a network of high-level regions that are not only sensitive to subtle individual differences in narrative interpretation during naturalistic conditions, but also resilient to large differences in the modality of the narrative. •Shared narrative interpretation is correlated with neural similarity in DMN and FCPN.•Neural responses in DMN depend on shared interpretation, not stimulus modality.•Intersubject representation similarity analysis can detect individual differences.

•75 adolescents read and heard time-locked narratives during an fMRI scan.•Inter-subject correlation (ISC) was used to analyze reading ability's impact.•ISC was more sensitive to individual differences in reading ability than GLMs.•Reading ability affects brain activity in more regions than previously thought.•Worse readers had more idiosyncratic responses than better readers across the brain. Recent work using fMRI inter-subject correlation analysis has provided new information about the brain's response to video and audio narratives, particularly in frontal regions not typically activated by single words. This approach is very well suited to the study of reading, where narrative is central to natural experience. But since past reading paradigms have primarily presented single words or phrases, the influence of narrative on semantic processing in the brain – and how that influence might change with reading ability – remains largely unexplored. In this study, we presented coherent stories to adolescents and young adults with a wide range of reading abilities. The stories were presented in alternating visual and auditory blocks. We used a dimensional inter-subject correlation analysis to identify regions in which better and worse readers had varying levels of consistency with other readers. This analysis identified a widespread set of brain regions in which activity timecourses were more similar among better readers than among worse readers. These differences were not detected with standard block activation analyses. Worse readers had higher correlation with better readers than with other worse readers, suggesting that the worse readers had “idiosyncratic” responses rather than using a single compensatory mechanism. Close inspection confirmed that these differences were not explained by differences in IQ or motion. These results suggest an expansion of the current view of where and how reading ability is reflected in the brain, and in doing so, they establish inter-subject correlation as a sensitive tool for future studies of reading disorders.

For successful communication, we need to understand the external world consistently with others. This task requires sufficiently similar cognitive schemas or psychological perspectives that act as filters to guide the selection, interpretation and storage of sensory information, perceptual objects and events. Here we show that when individuals adopt a similar psychological perspective during natural viewing, their brain activity becomes synchronized in specific brain regions. We measured brain activity with functional magnetic resonance imaging (fMRI) from 33 healthy participants who viewed a 10-min movie twice, assuming once a ‘social’ (detective) and once a ‘non-social’ (interior decorator) perspective to the movie events. Pearson's correlation coefficient was used to derive multisubject voxelwise similarity measures (inter-subject correlations; ISCs) of functional MRI data. We used k-nearest-neighbor and support vector machine classifiers as well as a Mantel test on the ISC matrices to reveal brain areas wherein ISC predicted the participants' current perspective. ISC was stronger in several brain regions—most robustly in the parahippocampal gyrus, posterior parietal cortex and lateral occipital cortex—when the participants viewed the movie with similar rather than different perspectives. Synchronization was not explained by differences in visual sampling of the movies, as estimated by eye gaze. We propose that synchronous brain activity across individuals adopting similar psychological perspectives could be an important neural mechanism supporting shared understanding of the environment.

Affective disorders such as major depression are common but serious illnesses characterized by altered processing of emotional information. Although the frequency and severity of depressive symptoms increase dramatically over the course of childhood and adolescence, much of our understanding of their neurobiological bases comes from work characterizing adults’ responses to static emotional information. As a consequence, relationships between depressive brain phenotypes and naturalistic emotional processing, as well as the manner in which these associations emerge over the lifespan, remain poorly understood. Here, we apply static and dynamic inter-subject correlation analyses to examine how brain function is associated with clinical and non-clinical depressive symptom severity in 112 children and adolescents (7–21 years old) who viewed an emotionally evocative clip from the film Despicable Me during functional MRI. Our results reveal that adolescents with greater depressive symptom severity exhibit atypical fMRI responses during movie viewing, and that this effect is stronger during less emotional moments of the movie. Furthermore, adolescents with more similar item-level depressive symptom profiles showed more similar brain responses during movie viewing. In contrast, children’s depressive symptom severity and profiles were unrelated to their brain response typicality or similarity. Together, these results indicate a developmental change in the relationships between brain function and depressive symptoms from childhood through adolescence. Our findings suggest that depressive symptoms may shape how the brain responds to complex emotional information in a dynamic manner sensitive to both developmental stage and affective context. •Adolescents with worse depressive symptoms show less typical movie-driven brain activity.•Relationships between depressive symptoms and brain responses are stronger during less emotional moments of the movie.•Pairs of adolescents with more similar depressive symptom profiles share more similar brain responses to the movie.•Brain response typicality and pairwise similarity are unrelated to depressive symptoms in children.

•Contrastive learning was employed to align EEG patterns across subjects.•Higher intersubject correlation was obtained than state-of-the-art methods.•The model extracts latent patterns that reflect stimulus-relevant properties. Neural representations induced by naturalistic stimuli offer insights into how humans respond to stimuli in daily life. Understanding neural mechanisms underlying naturalistic stimuli processing hinges on the precise identification and extraction of the shared neural patterns that are consistently present across individuals. Targeting the Electroencephalogram (EEG) technique, known for its rich spatial and temporal information, this study presents a framework for Contrastive Learning of Shared SpatioTemporal EEG Representations across individuals (CL-SSTER). CL-SSTER utilizes contrastive learning to maximize the similarity of EEG representations across individuals for identical stimuli, contrasting with those for varied stimuli. The network employs spatial and temporal convolutions to simultaneously learn the spatial and temporal patterns inherent in EEG. The versatility of CL-SSTER was demonstrated on three EEG datasets, including a synthetic dataset, a natural speech comprehension EEG dataset, and an emotional video watching EEG dataset. CL-SSTER attained the highest inter-subject correlation (ISC) values compared to the state-of-the-art ISC methods. The latent representations generated by CL-SSTER exhibited reliable spatiotemporal EEG patterns, which can be explained by properties of the naturalistic stimuli. CL-SSTER serves as an interpretable and scalable framework for the identification of inter-subject shared neural representations in naturalistic neuroscience.