Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
6
result(s) for
"Crossmodality"
Sort by:
Exploring auditory morphodynamics: Audiovisual associations in sound-based music
2025
This article explores audiovisual associations within the context of contemporary and experimental music practices, particularly focusing on sound-based music. While extensive studies exist on crossmodality in relation to traditional music genres (such as classical instrumental music), the perceptual potential of sound-based music remains an underexplored field of psychological research. In an online procedure, 152 participants were exposed to six musical excerpts from spectralism and electronic-glitch music and were asked to rate the extent to which each audio matched with six ad hoc generated black and white abstract images. Statistical analysis revealed that ratings were highly consistent across participants, indicating that they may rely on a shared set of implicit perceptual criteria rooted in Gestalt and morphodynamic features common to both auditory and visual stimuli. In particular, smoothness, continuity, numericity, symmetry, and spectrotemporal dimensions emerged as the primary factors influencing the association ratings. We discuss the implication of these findings both for crossmodal research and musicology, and suggest some directions for future research in audiovisual associations using sound-based music.
Journal Article
Long-term versus short-term consistency in the grapheme–colour synaesthesia: Grapheme–colour pairings can change in adulthood
by
Chromý, Jan
,
Borůvková, Marianna
,
Sudzinová, Tereza
in
Adults
,
Age Groups
,
Behavioral Science and Psychology
2019
The aim of the article is to examine the stability of grapheme–colour matchings in adulthood. We carried out a panel study using computerized tests to measure short-term and long-term consistency. We conducted three testing rounds during 1 year and a half with a resulting sample of 26 synaesthetes. Our results suggest that the colours associated with individual graphemes can change substantially (e.g. from “salmon” to “aquamarine”) even during this relatively short time period. Based on a linear mixed model, we further argue that short-term and long-term consistency should be distinguished because these scores tend to differ. These results thus complement previous findings on the issue of grapheme–colour consistency and have important consequences for the study of synaesthesia in the future.
Journal Article
Crossmodal Language Comprehension—Psycholinguistic Insights and Computational Approaches
by
Staron, Tobias
,
Menzel, Wolfgang
,
Alaçam, Özge
in
Attention
,
Collaboration
,
Computer & video games
2020
Crossmodal interaction in situated language comprehension is important for effective and efficient communication. The relationship between linguistic and visual stimuli provides mutual benefit: While vision contributes, for instance, information to improve language understanding, language in turn plays a role in driving the focus of attention in the visual environment. However, language and vision are two different representational modalities, which accommodate different aspects and granularities of conceptualizations. To integrate them into a single, coherent system solution is still a challenge, which could profit from inspiration by human crossmodal processing. Based on fundamental psycholinguistic insights into the nature of situated language comprehension, we derive a set of performance characteristics facilitating the robustness of language understanding, such as crossmodal reference resolution, attention guidance, or predictive processing. Artificial systems for language comprehension should meet these characteristics in order to be able to perform in a natural and smooth manner. We discuss how empirical findings on the crossmodal support of language comprehension in humans can be applied in computational solutions for situated language comprehension and how they can help to mitigate the shortcomings of current approaches.
Journal Article
When does hearing laughter draw attention to happy faces? Task relevance determines the influence of a crossmodal affective context on emotional attention
2012
Prior evidence has shown that a person's affective context influences attention to emotional stimuli. The present study investigated whether a crossmodal affective context that is induced by remembering an emotional sound modulates attention to visual emotional stimuli. One group of participants had to remember a positive, negative, or neutral sound during each trial of a dot probe paradigm. A second group of participants also had to encode the valence of the sound. The results revealed that attention was preferentially deployed to stimuli that were emotionally congruent to the affective context. However, this effect was only evident when participants had to encode the valence of the affective context. These findings suggest that a crossmodal affective context modulates the deployment of attention to emotional stimuli provided that the affective connotation of the context is task-relevant.
Journal Article
Sensuous Cognition
by
Caballero, Rosario
,
Díaz Vera, Javier E.
in
Body language
,
Body language -- Psychological aspects
,
Cognition
2013
This book provides an interdisciplinary, unified view of sensual cognition and its cultural manifestations. The contributors favour an ecological perspective and revisit and problematize some of the core assumptions in Cognitive Linguistics. One of the original tenets of CL states that human thinking is grounded in experiential gestalts as well as in interaction between peoples' embodied minds and their various environments or cultures. In addition to looking in detail at this tenet, the volume provides major insights into the methodological and theoretical dimensions of Cognitive Linguistics research and describes applications of the paradigm in diverse contexts and cultures.
Estilo de ejecución musical y de danza en el tango: atributos, competencia y experiencia dinámica
2012
Los enfoques musicológicos clásicos proponen que el estilo musical puede entenderse como propiedad emergente de un conjunto de atributos susceptibles de ser descriptos en la estructura musical. Contrariamente, se propone la hipótesis de que el estilo, como un modo de hacer, puede ser entendido como la síntesis de componentes dinámicos de movimiento, tiempo, espacio, fuerza y direccionalidad. Esto corresponde a lo que Stern (2010) denomina formas dinámicas de la vitalidad, las que, al ser de naturaleza amodal, permitirían una continuidad estilística a través de diversas modalidades perceptuales por las que el contenido dinámico puede atravesar. Se explora empíricamente dicha continuidad, tomando como motivo de estudio el tango en su aspecto musical y de danza. Dos experimentos aportan evidencia empírica sobre la similitud de las relaciones estilísticas a lo largo de las diferentes modalidades, y de las cualidades dinámicas de los rasgos que se traspasan de la música a la danza.
Journal Article