Explore the vast range of titles available.

Key Points The dominant view in current theories of face perception is that facial identity (recognizing who a person is) and facial expression (interpreting their moods and feelings) are processed by distinct parallel visual routes. Although there is considerable evidence to support the independent coding of identity and expression, it is not clear whether the idea of distinct parallel visual routes provides the best fit to the data. We conclude that there is clear evidence for some separation between the coding of facial identity and expression, the concept of independent visual pathways is not strongly supported. The data are consistent with other potential frameworks that deserve to be more fully explored. One alternative framework derives from image-based analysis of faces using principal component analysis (PCA). This shows that the independent perception of facial identity and facial expression can be modelled within a single representational framework in which some dimensions (principal components) code facial identity, some code facial expressions and others code both. PCA therefore indicates that the dissociation of identity and expression might be partial rather than absolute. We also focus on Haxby and colleagues' observations that facial expressions and other 'changeable' facial cues (such as lipspeech and gaze) are associated with the inferior occipital gyrus and superior temporal sulcus (STS), whereas 'invariant' facial cues (such as facial identity) are associated with the inferior occipital gyrus and lateral fusiform gyrus. This distinction begs more fundamental questions, such as why are facial characteristics divided in this manner and why is the STS more interested in facial expressions, lipspeech and gaze? One potential explanation lies in the fact that the STS is not only sensitive to changeable facial characteristics, but also to other perceptual dimensions that are inherently linked with them (such as their associated vocalizations and dynamic information). There is evidence that the STS might be involved in the integration of these different channels. Consequently, we propose that the prominent role of the STS in coding changeable facial characteristics might reflect an increased reliance on integrative mechanisms for interpreting changeable social signals. In summary, an approach to face perception that emphasizes the different physical properties and information-processing demands (such as reliance on integrative mechanisms) of different facial characteristics has considerable value. This differs from the classic approach, which has tended to emphasize distinctions based mainly on informational content (for example, identity versus expression). Faces convey a wealth of social signals. A dominant view in face-perception research has been that the recognition of facial identity and facial expression involves separable visual pathways at the functional and neural levels, and data from experimental, neuropsychological, functional imaging and cell-recording studies are commonly interpreted within this framework. However, the existing evidence supports this model less strongly than is often assumed. Alongside this two-pathway framework, other possible models of facial identity and expression recognition, including one that has emerged from principal component analysis techniques, should be considered.

First impressions of social traits, such as trustworthiness or dominance, are reliably perceived in faces, and despite their questionable validity they can have considerable real-world consequences. We sought to uncover the information driving such judgments, using an attribute-based approach. Attributes (physical facial features) were objectively measured from feature positions and colors in a database of highly variable “ambient” face photographs, and then used as input for a neural network to model factor dimensions (approachability, youthful-attractiveness, and dominance) thought to underlie social attributions. A linear model based on this approach was able to account for 58% of the variance in raters’ impressions of previously unseen faces, and factor-attribute correlations could be used to rank attributes by their importance to each factor. Reversing this process, neural networks were then used to predict facial attributes and corresponding image properties from specific combinations of factor scores. In this way, the factors driving social trait impressions could be visualized as a series of computer-generated cartoon face-like images, depicting how attributes change along each dimension. This study shows that despite enormous variation in ambient images of faces, a substantial proportion of the variance in first impressions can be accounted for through linear changes in objectively defined features.

Humans are remarkably accurate at recognizing familiar faces, whereas their ability to recognize, or even match, unfamiliar faces is much poorer. However, previous research has failed to identify neural correlates of this striking behavioral difference. Here, we found a clear difference in brain potentials elicited by highly familiar faces versus unfamiliar faces. This effect starts 200 ms after stimulus onset and reaches its maximum at 400 to 600 ms. This sustained-familiarity effect was substantially larger than previous candidates for a neural familiarity marker and was detected in almost all participants, representing a reliable index of high familiarity. Whereas its scalp distribution was consistent with a generator in the ventral visual pathway, its modulation by repetition and degree of familiarity suggests an integration of affective and visual information.

Whether the brain represents facial expressions as perceptual continua or as emotion categories remains controversial. Here, we measured the neural response to morphed images to directly address how facial expressions of emotion are represented in the brain. We found that face-selective regions in the posterior superior temporal sulcus and the amygdala responded selectively to changes in facial expression, independent of changes in identity. We then asked whether the responses in these regions reflected categorical or continuous neural representations of facial expression. Participants viewed images from continua generated by morphing between faces posing different expressions such that the expression could be the same, could involve a physical change but convey the same emotion, or could differ by the same physical amount but be perceived as two different emotions. We found that the posterior superior temporal sulcus was equally sensitive to all changes in facial expression, consistent with a continuous representation. In contrast, the amygdala was only sensitive to changes in expression that altered the perceived emotion, demonstrating a more categorical representation. These results offer a resolution to the controversy about how facial expression is processed in the brain by showing that both continuous and categorical representations underlie our ability to extract this important social cue.

Borderline personality disorder (BPD) is a common and serious mental illness, associated with a high risk of suicide and self harm. Those with a diagnosis of BPD often display difficulties with social interaction and struggle to form and maintain interpersonal relationships. Here we investigated the ability of participants with BPD to make social inferences from faces. 20 participants with BPD and 21 healthy controls were shown a series of faces and asked to judge these according to one of six characteristics (age, distinctiveness, attractiveness, intelligence, approachability, trustworthiness). The number and direction of errors made (compared to population norms) were recorded for analysis. Participants with a diagnosis of BPD displayed significant impairments in making judgements from faces. In particular, the BPD Group judged faces as less approachable and less trustworthy than controls. Furthermore, within the BPD Group there was a correlation between scores on the Childhood Trauma Questionnaire (CTQ) and bias towards judging faces as unapproachable. Individuals with a diagnosis of BPD have difficulty making appropriate social judgements about others from their faces. Judging more faces as unapproachable and untrustworthy indicates that this group may have a heightened sensitivity to perceiving potential threat, and this should be considered in clinical management and treatment.

Predictive coding theories of perception highlight the importance of constantly updated internal models of the world to predict future sensory inputs. Importantly, such theories suggest that prediction-error signalling should be specific to the violation of predictions concerning distinct attributes of the same stimulus. To interrogate this as yet untested prediction, we focused on two different aspects of face perception (identity and orientation) and investigated whether cortical regions which process particular stimulus attributes also signal prediction violations with respect to those same stimulus attributes. We employed a paradigm using sequential trajectories of images to create perceptual expectations about face orientation and identity, and then parametrically violated each attribute. Using MEG data, we identified double dissociations of expectancy violations in the dorsal and ventral visual streams, such that the right fusiform gyrus showed greater prediction-error signals to identity violations than to orientation violations, whereas the left angular gyrus showed the converse pattern of results. Our results suggest that perceptual prediction-error signalling is directly linked to regions associated with the processing of different stimulus properties. •Trial sequences generated (and then violated) expectations about orthogonal stimulus attributes (Identity and Orientation).•We used MEG spatial beamformer techniques to localise cortical sources of prediction error signals in time and space.•Early-latency responses to violated expectations about Face Identity were evident in the Right Fusiform Gyrus.•Expectation violation signals about Head Orientation were evident in the Left Angular Gyrus with a similar latency.•Responses to violated Identity expectations were doubly-dissociated from those to Orientation across ventral and dorsal streams.

We investigated the relationships between individual differences in different aspects of face-identity processing, using the Glasgow Face Matching Test (GFMT) as a measure of unfamiliar face perception, the Cambridge Face Memory Test (CFMT) as a measure of new face learning, and the Before They Were Famous task (BTWF) as a measure of familiar face recognition. These measures were integrated into two separate studies examining the relationship between face processing and other tasks. For Study 1 we gathered participants’ subjective ratings of their own face perception abilities. In Study 2 we used additional measures of perceptual and cognitive abilities, and personality factors to place individual differences in a broader context. Performance was significantly correlated across the three face-identity tasks in both studies, suggesting some degree of commonality of underlying mechanisms. For Study 1 the participants’ self-ratings correlated poorly with performance, reaching significance only for judgements of familiar face recognition. In Study 2 there were few associations between face tasks and other measures, with task-level influences seeming to account for the small number of associations present. In general, face tasks correlated with each other, but did not show an overall relation with other perceptual, cognitive or personality tests. Our findings are consistent with the existence of a general face-perception factor, able to account for around 25% of the variance in scores. However, other relatively task-specific influences are also clearly operating.

Neuroimaging studies have revealed topographically organised patterns of response to different objects in the ventral visual pathway. These patterns are thought to be based on the form of the object. However, it is not clear what dimensions of object form are important. Here, we determined the extent to which spatial properties (energy across the image) could explain patterns of response in these regions. We compared patterns of fMRI response to images from different object categories presented at different retinal sizes. Although distinct neural patterns were evident to different object categories, changing the size (and thus the spatial properties) of the images had a significant effect on these patterns. Next, we used a computational approach to determine whether more fine-grained differences in the spatial properties can explain the patterns of neural response to different objects. We found that the spatial properties of the image were able to predict patterns of neural response, even when categorical factors were removed from the analysis. We also found that the effect of spatial properties on the patterns of response varies across the ventral visual pathway. These results show how spatial properties can be an important organising principle in the topography of the ventral visual pathway. •Distinct neural patterns were evident to different object categories in ventral visual stream.•Changing the size of the images had a significant effect on these patterns.•A computational analysis shows that spatial properties of images can explain patterns of neural response to different objects.•The effect of spatial properties declined from posterior to anterior regions of the ventral stream.

As a social species in a constantly changing environment, humans rely heavily on the informational richness and communicative capacity of the face. Thus, understanding how the brain processes information about faces in real-time is of paramount importance. The N170 is a high-temporal resolution electrophysiological index of the brain’s early response to visual stimuli that is reliably elicited in carefully controlled laboratory-based studies. Although the N170 has often been reported to be of greatest amplitude to faces, there has been debate regarding whether this effect might be an artefact of certain aspects of the controlled experimental stimulation schedules and materials. To investigate whether the N170 can be identified in more realistic conditions with highly variable and cluttered visual images and accompanying auditory stimuli we recorded EEG ‘in the wild’, while participants watched pop videos. Scene-cuts to faces generated a clear N170 response, and this was larger than the N170 to transitions where the videos cut to non-face stimuli. Within participants, wild-type face N170 amplitudes were moderately correlated to those observed in a typical laboratory experiment. Thus, we demonstrate that the face N170 is a robust and ecologically valid phenomenon and not an artefact arising as an unintended consequence of some property of the more typical laboratory paradigm.

The idea that most of us are good at recognizing faces permeates everyday thinking and is widely used in the research literature. However, it is a correct characterization only of familiar-face recognition. In contrast, the perception and recognition of unfamiliar faces can be surprisingly error-prone, and this has important consequences in many real-life settings. We emphasize the variability in views of faces encountered in everyday life and point out how neglect of this important property has generated some misleading conclusions. Many approaches have treated image variability as unwanted noise, whereas we show how studies that use and explore the implications of image variability can drive substantial theoretical advances.