Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
2,196
result(s) for
"Test-retest"
Sort by:
A comprehensive assessment of regional variation in the impact of head micromovements on functional connectomics
by
Craddock, R. Cameron
,
Di Martino, Adriana
,
Cheung, Brian
in
Biological and medical sciences
,
Brain - physiology
,
Brain mapping
2013
Functional connectomics is one of the most rapidly expanding areas of neuroimaging research. Yet, concerns remain regarding the use of resting-state fMRI (R-fMRI) to characterize inter-individual variation in the functional connectome. In particular, recent findings that “micro” head movements can introduce artifactual inter-individual and group-related differences in R-fMRI metrics have raised concerns. Here, we first build on prior demonstrations of regional variation in the magnitude of framewise displacements associated with a given head movement, by providing a comprehensive voxel-based examination of the impact of motion on the BOLD signal (i.e., motion–BOLD relationships). Positive motion–BOLD relationships were detected in primary and supplementary motor areas, particularly in low motion datasets. Negative motion–BOLD relationships were most prominent in prefrontal regions, and expanded throughout the brain in high motion datasets (e.g., children). Scrubbing of volumes with FD>0.2 effectively removed negative but not positive correlations; these findings suggest that positive relationships may reflect neural origins of motion while negative relationships are likely to originate from motion artifact. We also examined the ability of motion correction strategies to eliminate artifactual differences related to motion among individuals and between groups for a broad array of voxel-wise R-fMRI metrics. Residual relationships between motion and the examined R-fMRI metrics remained for all correction approaches, underscoring the need to covary motion effects at the group-level. Notably, global signal regression reduced relationships between motion and inter-individual differences in correlation-based R-fMRI metrics; Z-standardization (mean-centering and variance normalization) of subject-level maps for R-fMRI metrics prior to group-level analyses demonstrated similar advantages. Finally, our test–retest (TRT) analyses revealed significant motion effects on TRT reliability for R-fMRI metrics. Generally, motion compromised reliability of R-fMRI metrics, with the exception of those based on frequency characteristics — particularly, amplitude of low frequency fluctuations (ALFF). The implications of our findings for decision-making regarding the assessment and correction of motion are discussed, as are insights into potential differences among volume-based metrics of motion.
•Positive but not negative motion-BOLD relationships appear to be neural in origin.•Motion should always be accounted for in group-level analyses.•Global signal regression and Z-standardization mitigate motion effects.•Motion compromises test-retest reliability, and correction strategies improve.
Journal Article
Improving the reliability of measurements in orthopaedics and sports medicine
by
Karlsson, Jon
,
Mouton, Caroline
,
Królikowska, Aleksandra
in
agreement
,
Clinical trials
,
Correlation coefficient
2023
A large space still exists for improving the measurements used in orthopaedics and sports medicine, especially as we face rapid technological progress in devices used for diagnostic or patient monitoring purposes. For a specific measure to be valuable and applicable in clinical practice, its reliability must be established. Reliability refers to the extent to which measurements can be replicated, and three types of reliability can be distinguished: inter-rater, intra-rater, and test–retest. The present article aims to provide insights into reliability as one of the most important and relevant properties of measurement tools. It covers essential knowledge about the methods used in orthopaedics and sports medicine for reliability studies. From design to interpretation, this article guides readers through the reliability study process. It addresses crucial issues such as the number of raters needed, sample size calculation, and breaks between particular trials. Different statistical methods and tests are presented for determining reliability depending on the type of gathered data, with particular attention to the commonly used intraclass correlation coefficient.
Journal Article
Parallel and identical test–retest reliability of the Tower of London test – Freiburg version
by
Schumacher, Lena V.
,
Schyle, Valentin
,
Rahm, Benjamin
in
Agreements
,
Cognitive ability
,
Females
2023
The Tower of London - Freiburg version (TOL-F) was developed in three parallel-test versions (A, B, and C) that only differ in their physical appearance by interchanged ball colors, but not in their cognitive demands. We addressed the question whether the test-retest reliability of an identical problem set differs from the parallel test-retest reliability of a structurally identical problem set with a marginally different physical appearance.
Reliabilities were assessed in two samples of young adults over a 1-week interval: In the parallel test-retest sample (
= 93; 49 female), half of the participants accomplished version A at the first session and version B at the second session, while the other half started with version B in the first session and continued with A in the second session. In the identical test-retest sample (
= 86; 48 female), half of the participants performed on version A in both the first and the second session, while the other half went through the same procedure with version B.
For overall planning accuracy, intraclass correlation coefficients for absolute agreement were
= .501 for the parallel test-retest and
= .605 for the identical test-retest sample, with Pearson correlations of
= .559 and
= .708 respectively. Greatest lower bound estimates of reliability were adequate to high in the two samples (ranging between .765 and .854) confirming previous studies.
Although the TOL-F revealed only moderate intraclass correlations for absolute agreement, it showed some of the highest psychometric indices compared to repeated assessments with other TOL tests.
Journal Article
Standardizing the intrinsic brain: Towards robust measurement of inter-individual variation in 1000 functional connectomes
by
Craddock, R. Cameron
,
Milham, Michael P.
,
Yan, Chao-Gan
in
Animals
,
Brain - anatomy & histology
,
Brain - physiology
2013
As researchers increase their efforts to characterize variations in the functional connectome across studies and individuals, concerns about the many sources of nuisance variation present and their impact on resting state fMRI (R-fMRI) measures continue to grow. Although substantial within-site variation can exist, efforts to aggregate data across multiple sites such as the 1000 Functional Connectomes Project (FCP) and International Neuroimaging Data-sharing Initiative (INDI) datasets amplify these concerns. The present work draws upon standardization approaches commonly used in the microarray gene expression literature, and to a lesser extent recent imaging studies, and compares them with respect to their impact on relationships between common R-fMRI measures and nuisance variables (e.g., imaging site, motion), as well as phenotypic variables of interest (age, sex). Standardization approaches differed with regard to whether they were applied post-hoc vs. during pre-processing, and at the individual vs. group level; additionally they varied in whether they addressed additive effects vs. additive+multiplicative effects, and were parametric vs. non-parametric. While all standardization approaches were effective at reducing undesirable relationships with nuisance variables, post-hoc approaches were generally more effective than global signal regression (GSR). Across approaches, correction for additive effects (global mean) appeared to be more important than for multiplicative effects (global SD) for all R-fMRI measures, with the exception of amplitude of low frequency fluctuations (ALFF). Group-level post-hoc standardizations for mean-centering and variance-standardization were found to be advantageous in their ability to avoid the introduction of artifactual relationships with standardization parameters; though results between individual and group-level post-hoc approaches were highly similar overall. While post-hoc standardization procedures drastically increased test–retest (TRT) reliability for ALFF, modest reductions were observed for other measures after post-hoc standardizations—a phenomena likely attributable to the separation of voxel-wise from global differences among subjects (global mean and SD demonstrated moderate TRT reliability for these measures). Finally, the present work calls into question previous observations of increased anatomical specificity for GSR over mean centering, and draws attention to the near equivalence of global and gray matter signal regression.
•Global mean and SD for R-fMRI measures showed strong site, motion and age effects.•Post-hoc standardizations were more effective in reducing nuisance effects than GSR.•Correction for additive effects is more important than for multiplicative effects.•Group-level standardizations are advantageous to individual-level standardizations.
Journal Article
Toward reliable characterization of functional homogeneity in the human brain: Preprocessing, scan duration, imaging resolution and computational space
by
Jiang, Lili
,
Zang, Yu-Feng
,
Castellanos, F. Xavier
in
Advantages
,
Alzheimer's disease
,
Attention deficit hyperactivity disorder
2013
While researchers have extensively characterized functional connectivity between brain regions, the characterization of functional homogeneity within a region of the brain connectome is in early stages of development. Several functional homogeneity measures were proposed previously, among which regional homogeneity (ReHo) was most widely used as a measure to characterize functional homogeneity of resting state fMRI (R-fMRI) signals within a small region (Zang et al., 2004). Despite a burgeoning literature on ReHo in the field of neuroimaging brain disorders, its test–retest (TRT) reliability remains unestablished. Using two sets of public R-fMRI TRT data, we systematically evaluated the ReHo's TRT reliability and further investigated the various factors influencing its reliability and found: 1) nuisance (head motion, white matter, and cerebrospinal fluid) correction of R-fMRI time series can significantly improve the TRT reliability of ReHo while additional removal of global brain signal reduces its reliability, 2) spatial smoothing of R-fMRI time series artificially enhances ReHo intensity and influences its reliability, 3) surface-based R-fMRI computation largely improves the TRT reliability of ReHo, 4) a scan duration of 5min can achieve reliable estimates of ReHo, and 5) fast sampling rates of R-fMRI dramatically increase the reliability of ReHo. Inspired by these findings and seeking a highly reliable approach to exploratory analysis of the human functional connectome, we established an R-fMRI pipeline to conduct ReHo computations in both 3-dimensions (volume) and 2-dimensions (surface).
[Display omitted]
► Motion and non-brain tissue correction significantly improve the ReHo's reliability. ► Global brain signal regression significantly reduces the ReHo's reliability. ► 5min scan duration is enough to achieve reliable ReHo estimates. ► Surface-based analysis produces highly reliable ReHo measures. ► Multi-band EPI resting-state brain dramatically increases the reliability of ReHo.
Journal Article
Reliable intrinsic connectivity networks: Test–retest evaluation using ICA and dual regression approach
by
Milham, Michael P.
,
Castellanos, F. Xavier
,
Adelstein, Jonathan S.
in
Brain - physiology
,
Brain Mapping - methods
,
Dual regression
2010
Functional connectivity analyses of resting-state fMRI data are rapidly emerging as highly efficient and powerful tools for in vivo mapping of functional networks in the brain, referred to as intrinsic connectivity networks (ICNs). Despite a burgeoning literature, researchers continue to struggle with the challenge of defining computationally efficient and reliable approaches for identifying and characterizing ICNs. Independent component analysis (ICA) has emerged as a powerful tool for exploring ICNs in both healthy and clinical populations. In particular, temporal concatenation group ICA (TC-GICA) coupled with a back-reconstruction step produces participant-level resting state functional connectivity maps for each group-level component. The present work systematically evaluated the test–retest reliability of TC-GICA derived RSFC measures over the short-term (<45 min) and long-term (5–16 months). Additionally, to investigate the degree to which the components revealed by TC-GICA are detectable via single-session ICA, we investigated the reproducibility of TC-GICA findings. First, we found moderate-to-high short- and long-term test–retest reliability for ICNs derived by combining TC-GICA and dual regression. Exceptions to this finding were limited to physiological- and imaging-related artifacts. Second, our reproducibility analyses revealed notable limitations for template matching procedures to accurately detect TC-GICA based components at the individual scan level. Third, we found that TC-GICA component's reliability and reproducibility ranks are highly consistent. In summary, TC-GICA combined with dual regression is an effective and reliable approach to exploratory analyses of resting state fMRI data.
Journal Article
Test–retest reliability of resting-state connectivity network characteristics using fMRI and graph theoretical measures
2012
Characterizing the brain connectome using neuroimaging data and measures derived from graph theory emerged as a new approach that has been applied to brain maturation, cognitive function and neuropsychiatric disorders. For a broad application of this method especially for clinical populations and longitudinal studies, the reliability of this approach and its robustness to confounding factors need to be explored. Here we investigated test–retest reliability of graph metrics of functional networks derived from functional magnetic resonance imaging (fMRI) recorded in 33 healthy subjects during rest. We constructed undirected networks based on the Anatomic-Automatic-Labeling (AAL) atlas template and calculated several commonly used measures from the field of graph theory, focusing on the influence of different strategies for confound correction. For each subject, method and session we computed the following graph metrics: clustering coefficient, characteristic path length, local and global efficiency, assortativity, modularity, hierarchy and the small-worldness scalar. Reliability of each graph metric was assessed using the intraclass correlation coefficient (ICC).
Overall ICCs ranged from low to high (0 to 0.763) depending on the method and metric. Methodologically, the use of a broader frequency band (0.008–0.15Hz) yielded highest reliability indices (mean ICC=0.484), followed by the use of global regression (mean ICC=0.399). In general, the second order metrics (small-worldness, hierarchy, assortativity) studied here, tended to be more robust than first order metrics.
In conclusion, our study provides methodological recommendations which allow the computation of sufficiently robust markers of network organization using graph metrics derived from fMRI data at rest.
► Test–retest reliability of graph metrics derived from resting-state fMRI. ► Different preprocessing and confound correction methods are examined. ► Moderate overall reliability, but differed between methods. ► Using a broad filter frequency range (0.008–0.15Hz) yielded best results.
Journal Article
Functional connectivity in BOLD and CBF data: Similarity and reliability of resting brain networks
2015
Resting-state functional connectivity (FC) fMRI (rs-fcMRI) offers an appealing approach to mapping the brain's intrinsic functional organization. Blood oxygen level dependent (BOLD) and arterial spin labeling (ASL) are the two main rs-fcMRI approaches to assess alterations in brain networks associated with individual differences, behavior and psychopathology. While the BOLD signal is stronger with a higher temporal resolution, ASL provides quantitative, direct measures of the physiology and metabolism of specific networks. This study systematically investigated the similarity and reliability of resting brain networks (RBNs) in BOLD and ASL. A 2×2×2 factorial design was employed where each subject underwent repeated BOLD and ASL rs-fcMRI scans on two occasions on two MRI scanners respectively. Both independent and joint FC analyses revealed common RBNs in ASL and BOLD rs-fcMRI with a moderate to high level of spatial overlap, verified by Dice Similarity Coefficients. Test–retest analyses indicated more reliable spatial network patterns in BOLD (average modal Intraclass Correlation Coefficients: 0.905±0.033 between-sessions; 0.885±0.052 between-scanners) than ASL (0.545±0.048; 0.575±0.059). Nevertheless, ASL provided highly reproducible (0.955±0.021; 0.970±0.011) network-specific CBF measurements. Moreover, we observed positive correlations between regional CBF and FC in core areas of all RBNs indicating a relationship between network connectivity and its baseline metabolism. Taken together, the combination of ASL and BOLD rs-fcMRI provides a powerful tool for characterizing the spatiotemporal and quantitative properties of RBNs. These findings pave the way for future BOLD and ASL rs-fcMRI studies in clinical populations that are carried out across time and scanners.
•Statistical Comparison of functional connectivity (FC) in BOLD and pCASL.•BOLD provided highly reliable known Resting State Networks (RBNs).•ASL provided similar RBNs with lower but still sufficient reliability.•ASL further provided highly reproducible network CBF.•Combination of ASL and BOLD provides a powerful tool to characterize RBNs.
Journal Article
Personality testing of large language models: limited temporal stability, but highlighted prosociality
by
Bojić, Ljubiša
,
Dinić, Bojana M.
,
Bodroža, Bojana
in
AI chatbot
,
Artificial intelligence
,
Cognition & reasoning
2024
As large language models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully understand LLMs and reveal their potential opportunities, drawbacks and overall societal impact. With that in mind, this research conducted an extensive investigation into seven LLMs, aiming to assess the temporal stability and inter-rater agreement on their responses on personality instruments in two time points. In addition, LLMs’ personality profile was analysed and compared with human normative data. The findings revealed varying levels of inter-rater agreement in the LLMs’ responses over a short time, with some LLMs showing higher agreement (e.g. Llama3 and GPT-4o) compared with others (e.g. GPT-4 and Gemini). Furthermore, agreement depended on used instruments as well as on domain or trait. This implies the variable robustness in LLMs’ ability to reliably simulate stable personality characteristics. In the case of scales which showed at least fair agreement, LLMs displayed mostly a socially desirable profile in both agentic and communal domains, as well as a prosocial personality profile reflected in higher agreeableness and conscientiousness and lower Machiavellianism. Exhibiting temporal stability and coherent responses on personality traits is crucial for AI systems due to their societal impact and AI safety concerns.
Journal Article
Kinocardiography Derived from Ballistocardiography and Seismocardiography Shows High Repeatability in Healthy Subjects
by
Rabineau, Jérémy
,
Hossein, Amin
,
Gorlier, Damien
in
Ballistocardiography
,
cardiac contractility
,
cardiac kinetic energy
2021
Recent years have witnessed an upsurge in the usage of ballistocardiography (BCG) and seismocardiography (SCG) to record myocardial function both in normal and pathological populations. Kinocardiography (KCG) combines these techniques by measuring 12 degrees-of-freedom of body motion produced by myocardial contraction and blood flow through the cardiac chambers and major vessels. The integral of kinetic energy (iK) obtained from the linear and rotational SCG/BCG signals, and automatically computed over the cardiac cycle, is used as a marker of cardiac mechanical function. The present work systematically evaluated the test–retest (TRT) reliability of KCG iK derived from BCG/SCG signals in the short term (<15 min) and long term (3–6 h) on 60 healthy volunteers. Additionally, we investigated the difference of repeatability with different body positions. First, we found high short-term TRT reliability for KCG metrics derived from SCG and BCG recordings. Exceptions to this finding were limited to metrics computed in left lateral decubitus position where the TRT reliability was moderate-to-high. Second, we found low-to-moderate long-term TRT reliability for KCG metrics as expected and confirmed by blood pressure measurements. In summary, KCG parameters derived from BCG/SCG signals show high repeatability and should be further investigated to confirm their use for cardiac condition longitudinal monitoring.
Journal Article