Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
205
result(s) for
"interobserver agreement"
Sort by:
Kvasir-Capsule, a video capsule endoscopy dataset
by
Næss, Espen
,
Lux, Mathias
,
Schmidt, Peter T.
in
692/699/1503/197
,
692/700/139/422
,
Annan medicin och hälsovetenskap
2021
Artificial intelligence (AI) is predicted to have profound effects on the future of video capsule endoscopy (VCE) technology. The potential lies in improving anomaly detection while reducing manual labour. Existing work demonstrates the promising benefits of AI-based computer-assisted diagnosis systems for VCE. They also show great potential for improvements to achieve even better results. Also, medical data is often sparse and unavailable to the research community, and qualified medical personnel rarely have time for the tedious labelling work. We present
Kvasir-Capsule
, a large VCE dataset collected from examinations at a Norwegian Hospital.
Kvasir-Capsule
consists of 117 videos which can be used to extract a total of 4,741,504 image frames. We have labelled and medically verified 47,238 frames with a bounding box around findings from 14 different classes. In addition to these labelled images, there are 4,694,266 unlabelled frames included in the dataset. The
Kvasir-Capsule
dataset can play a valuable role in developing better algorithms in order to reach true potential of VCE technology.
Measurement(s)
Gastrointestinal Tract • gastrointestinal system disease
Technology Type(s)
Capsule Endoscope • visual assessment of
in vivo
video recording
Sample Characteristic - Organism
Homo sapiens
Sample Characteristic - Environment
alimentary part of gastrointestinal system
Machine-accessible metadata file describing the reported data:
https://doi.org/10.6084/m9.figshare.14178905
Journal Article
Classifying Anal Intraepithelial Neoplasia 2 Based on LAST Recommendations
2021
Abstract
Objectives: The Lower Anogenital Squamous Terminology (LAST) recommendations classify human papillomavirus–associated squamous lesions into low- and high-grade squamous intraepithelial lesions (LSILs/HSILs). Our study aimed to assess interobserver agreement among 6 experienced pathologists in assigning 40 anal lesions previously diagnosed as anal intraepithelial neoplasia 2 (AIN 2) to either HSIL or non-HSIL categories.
Methods: Agreement based on photomicrographs of H&E alone or H&E plus p16 immunohistochemistry was calculated using κ coefficients.
Results: Agreement was fair based on H&E alone (κ = 0.42; 95% confidence interval [CI], 0.34-0.52). Adding p16 improved agreement to moderate (κ = 0.55; 95% CI, 0.54-0.62). On final diagnosis, 21 cases (53%) had unanimous diagnoses, and 19 (47%) were divided. When designating p16 results as positive or negative, agreement was excellent (κ = 0.92; 95% CI, 0.83-0.95). Among variables (staining location, extent, and intensity), staining of the basal/parabasal layers was a consistent feature in cases with consensus for positive results (20/20). Of the 67 H&E diagnoses with conflicting p16 results, participants modified 32 (48%), downgrading 23 HSILs and upgrading 9 non-HSILs.
Conclusions: Although p16 increased interobserver agreement, disagreement remained considerable regarding intermediate lesions. p16 expression, particularly if negative, can reduce unwarranted HSIL diagnoses and unnecessary treatment.
Journal Article
Interobserver variability in thyroid ultrasound
by
de Carlos, Joaquín
,
Anda, Emma
,
Pineda, Jose Javier
in
Calcification
,
Cancer
,
Cellular biology
2024
Purpose
Ultrasound evaluation of thyroid nodules is the preferred technique, but it is dependent on operator interpretation, leading to inter-observer variability. The current study aimed to determine the inter-physician consensus on nodular characteristics, risk categorization in the classification systems, and the need for fine needle aspiration puncture.
Methods
Four endocrinologists from the same center blindly evaluated 100 ultrasound images of thyroid nodules from 100 different patients. The following ultrasound features were evaluated: composition, echogenicity, margins, calcifications, and microcalcifications. Nodules were also classified according to ATA, EU-TIRADS, K-TIRADS, and ACR-TIRADS classifications. Krippendorff’s alpha test was used to assess interobserver agreement.
Results
The interobserver agreement for ultrasound features was: Krippendorff’s coefficient 0.80 (0.71–0.89) for composition, 0.59 (0.47–0.72) for echogenicity, 0.73 (0.57–0.88) for margins, 0.55 (0.40–0.69) for calcifications, and 0.50 (0.34–0.67) for microcalcifications. The concordance for the classification systems was 0.7 (0.61–0.80) for ATA, 0.63 (0.54–0.73) for EU-TIRADS, 0.64 (0.55–0.73) for K-TIRADS, and 0.68 (0.60–0.77) for K-TIRADS. The concordance in the indication of fine needle aspiration puncture (FNA) was 0.86 (0.71–1), 0.80 (0.71–0.88), 0.77 0.67–0.87), and 0.73 (0.64–0.83) for systems previously described respectively.
Conclusions
Interobserver agreement was acceptable for the identification of nodules requiring cytologic study using various classification systems. However, limited concordance was observed in risk stratification and many ultrasonographic characteristics of the nodules.
Journal Article
An international confirmatory study of the prognostic value of early PET/CT in diffuse large B-cell lymphoma: comparison between Deauville criteria and ΔSUVmax
2013
Purpose
The role of interim PET/CT in guiding therapeutic strategies in diffuse large B-cell lymphoma (DLBCL) is debated, mainly because interpretation rules vary among centres. This study aimed to explore the reproducibility and confirm the prognostic value of early PET/CT using the Deauville criteria and ΔSUVmax.
Methods
This international confirmatory study retrospectively evaluated 114 patients with newly diagnosed DLBCL treated with a rituximab-containing regimen. All patients underwent
18
F-FDG PET/CT at baseline (PET0) and after two cycles (PET2), with no therapy change based on the latter. Scans were interpreted by three observers using the Deauville five-point scale and ΔSUVmax between PET0 and PET2 was calculated. Interpretations were evaluated for interobserver agreement and for progression-free survival (PFS) prediction.
Results
Median follow-up was 39 months. Early PET/CT was predictive of outcome when interpreted with the Deauville criteria and ΔSUVmax. Using the five-point scale, the overall kappa value was 0.66 with the reference background set in the liver (score ≥4) and interobserver agreement was even better using a 66 % ΔSUVmax cut-off (κ = 0.83). Moreover, the prognostic value of interim PET was slightly inferior when using a Deauville score ≥4 than when using a 66 % ΔSUVmax cut-off: for the Deauville score the 3-year PFS estimate was 59 % (45–73 %) in PET2-positive patients vs. 81 % (71–91 %) in PET2-negative patients (
P
= 0.003); for the 66 % ΔSUVmax cut-off the 3-year PFS estimate was 44 % (23–65 %) in PET2-positive patients vs. 79 % (70–88 %) in PET2-negative patients (
P
= 0.0002).
Conclusion
Although the Deauville criteria are valid for assessing the prognostic value of early PET/CT in DLBCL, computation of the ΔSUVmax leads to better performance and interobserver reproducibility, and should be preferred when a baseline scan is available.
Journal Article
Reproducibility of histological cell type in high-grade endometrial carcinoma
by
Kalloger, Steve E
,
Ewanowich, Carol A
,
Duggan, Máire A
in
631/1647/664/1257
,
692/699/67/1517/1931
,
692/700/139/422
2013
Subclassification of endometrial carcinoma according to histological type shows variable interobserver agreement. The aim of this study was to assess specifically the interobserver agreement of histological type in high-grade endometrial carcinomas, recorded by gynecological pathologists from five academic centers across Canada. In a secondary aim, the agreement of consensus diagnosis with immunohistochemical marker combinations was assessed including six routine (TP53, CDKN2A (p16), ER, PGR, Ki67, and VIM) and six experimental immunohistochemical markers (PTEN, ARID1A, CTNNB1, IGF2BP3, HNF1B, and TFF3). The paired interobserver agreement ranged from
κ
0.50 to 0.63 (median 0.58) and the intraobserver agreement from
κ
0.49 to 0.67 (median 0.61). Consensus about histological type based on morphological assessment was reached in 72% of high-grade endometrial carcinomas. A seven-marker immunohistochemical panel differentiated FIGO grade 3 endometrioid from serous carcinoma with a 100% concordance rate compared with the consensus diagnosis. More practically, a three-marker panel including TP53, ER, and CDKN2A (p16) can aid in the differential diagnosis of FIGO grade 3 endometrioid from endometrial serous carcinoma. Our study demonstrates that the inter- and intraobserver reproducibility of histological type based on morphology alone are mostly moderate. Ancillary techniques such as immunohistochemical marker panels are likely needed to improve diagnostic reproducibility of histological types within high-grade endometrial carcinomas.
Journal Article
Skeletal F-PSMA-1007 uptake in prostate cancer patients
2023
Background/objectives: Accurate and uniform interpretation and reporting of metastatic prostate cancer (PCa) lesions on prostate-specific membrane antigen (PSMA) positron emission tomography/computed tomography (PET/CT) are indispensable. 18 F-PSMA-1007 is increasingly used because of its favorable imaging characteristics. However, increased non-specific skeletal uptake may be an important pitfall of this radioligand. Therefore, we aimed to assess the interobserver variation in reporting skeletal 18 F-PSMA-1007 uptake on PET/CT. Design/methods: In total, 33 18 F-PSMA-1007 PET/CT scans of 21 patients with primary PCa and 12 patients with biochemical recurrence were included, and a total of 85 skeletal lesions were evaluated by three independent observers. The primary endpoint was the interobserver variability of the likelihood of malignancy of the skeletal lesions on both patient and lesion level (kappa analysis). Results: Observers qualified most lesions as not malignant (81–91%) and the overall mean interobserver agreement was moderate on both patient (κ: 0.54) and lesion level (κ: 0.55). In 52 lesions without corresponding CT substrate, the rating resulted in not malignant in 95–100%. Availability of additional imaging (60% of lesions) did not improve interobserver agreement (κ: 0.39 on lesion level) and resulted in unchanged rating for all observers in 78%. Conclusion: This interobserver analysis of skeletal 18 F-PSMA-1007 uptake resulted in moderate agreement, in line with rates reported in literature. Importantly, the presence of non-specific skeletal uptake without CT substrate, as a potential shortcoming of 18 F-PSMA-1007, did not impair interobserver agreement.
Journal Article
Interobserver agreement in BPPV diagnosis using eye movement recordings
2025
Benign Paroxysmal Positional Vertigo (BPPV) is one of the most prevalent peripheral vestibular disorders seen in specialized dizziness clinics. Despite being a well-understood condition with effective treatment options, BPPV remains associated with significant diagnostic delays and healthcare costs. If proven reliable, telemedicine approaches could help address these challenges by improving diagnostic accessibility and efficiency. To investigate the interobserver agreement in BPPV diagnosis, when using eye movement recordings. Six vestibular medicine specialists (Specialist 1, 2, 3, 4, 5, 6) were recruited to participate in this study. The specialists were asked to evaluate the recordings of 240 patient cases who underwent assessment for BPPV (first assessment). After viewing the recordings of each case, they were required to make a BPPV diagnosis. Five specialists (2, 3, 4, 5, 6) agreed to repeat the procedure twice, to additionally evaluate the intraobserver agreement (second assessment). The proportion of agreement and Cohen’s kappa were calculated for both interobserver and intraobserver agreement. Furthermore, agreement with the original diagnoses was evaluated. The interobserver agreement between experts was fair to moderate with a Cohen’s kappa value of 0.40 (CI 95% [0.35, 0.45]) and a proportion of agreement of 60% (CI 95% [54, 67]). Specialists 2, 4, and 5 exhibited substantial intraobserver agreement. In contrast, Specialist 3 demonstrated fair intraobserver agreement, while Specialist 6 showed almost perfect intraobserver agreement. Regarding the first assessment, agreement with the original diagnoses ranged from fair to substantial, with kappa values between 0.40 and 0.70, and corresponding percentages between 58 and 78%. Similar results were observed for the second assessment. The interobserver agreement between specialists diagnosing BPPV using eye movement recordings, was fair to moderate. The suboptimal agreement could be related to missing clinical information (e.g. patient history and symptoms during positional maneuvers). Future studies should incorporate this information and reassess interobserver agreement.
Journal Article
Reliability assessment of methylthioadenosine phosphorylase immunohistochemistry as a surrogate biomarker for CDKN2A homozygous deletion in adult-type IDH-mutant diffuse gliomas
by
Babaoglu, Berrin
,
Gundogdu, Fatma
,
Soylemezoglu, Figen
in
Adult
,
Analysis
,
Astrocytoma - genetics
2024
According to the 2021 World Health Organization classification of brain tumors, astrocytomas containing a CDKN2A/B homozygous deletion (HD) are designated as grade 4 even when no microvascular proliferation and/or necrosis is present. In this study, we aimed to investigate the relationship between CDKN2A HD and loss of methylthioadenosine phosphorylase (MTAP) expression in adult-type IDH-mutant gliomas and to assess the sensitivity and specificity of MTAP immunohistochemistry (IHC) along with interobserver agreement as a surrogate biomarker for CDKN2A HD. Eighty-eight astrocytomas and 71 oligodendrogliomas cases that were diagnosed between 2014 and 2021 at Hacettepe University were selected and tissue microarrays were conducted to perform CDKN2A fluorescence in situ hybridization and MTAP IHC. Twenty-five (15.7%) cases harbored CDKN2A HD. MTAP loss was detected in 28 (15.7%) cases by the first observer and 27 (17%) cases by the second observer. The sensitivity and specificity of MTAP were calculated as 88% and 95.52%-96.27% for 2 observers. A very good/perfect agreement was noted between the observers (Cohen kappa coefficient = 0.938). Intratumoral heterogeneity was observed in 4 cases. MTAP IHC was found to be a reliable surrogate biomarker as a possible alternative to CDKN2A HD identification with a high sensitivity and specificity along with high interobserver agreement.
Journal Article
Novel prognostic histopathological grading system in oral squamous cell carcinoma based on tumour budding and cell nest size shows high interobserver and intraobserver concordance
by
Haller, Bernhard
,
Jöhrens, Korinna
,
Kolk, Andreas
in
Cancer
,
cell nest size
,
histomorphological grading
2019
AimsSquamous cell carcinoma of the oral cavity (OSCC) is a common tumour entity with a variable, partially highly aggressive clinical course. Recently, we proposed a novel (three-tiered) clinically useful grading scheme strongly associated with patient outcome in OSCC, consisting of a sum score of the histomorphological patterns tumour budding and cell nest size which outperforms WHO based grading algorithms currently in use. The aim of our study was to probe for interobserver and intraobserver reliability of this novel grading system.Methods108 OSCC were retrospectively scored according to the proposed grading scheme by three independent pathologists—two experienced head and neck pathologists and one pathologist in training—blinded to each other’s scoring results.ResultsThe Cohen’s Kappa (κ) values for concordance rates between experienced pathologists were κ=0.97 for the overall grade, κ=0.97 for budding activity and κ=0.91 for cell nest size, indicating a strong interobserver reliability of our proposed grading system. Initial interobserver agreement was markedly lower with the pathologist in training (κ=0.55 for overall grade) but improved significantly after a training session (κ=0.87 for overall grade). Intraobserver concordance was high (κ=0.95 for overall grade), indicating a high reproducibility of the algorithm.ConclusionsIn conclusion, our study indicates that OSCC grading based on our proposed novel scheme yields an excellent inter-reader and intrareader agreement, further supporting the suitability of this grading system for routine pathological practice.
Journal Article
Interobserver agreement on landmark and flexure identification in colon capsule endoscopy
by
Schelde-Olesen, B.
,
Herp, J.
,
Bjørsum-Meyer, T.
in
Abdominal Surgery
,
Colon
,
Colorectal Surgery
2023
Purpose
When an optical colonoscopy is carried out, Scope Guide can assist the endoscopist in determining the localization. In colon capsule endoscopy (CCE), this support is not available. To our knowledge, the interobserver agreement on landmark identification has never been studied. This study aims to investigate the interobserver agreement on landmark identification in CCE.
Methods
An interobserver study was carried out comparing the landmark identification (the ileocecal valve, hepatic flexure, splenic flexure, and anus) in CCE investigations between an external private contractor and three in-house CCE readers with different levels of experience. All CCE investigations analyzed in this study were carried out as a part of the Danish screening program for colorectal cancer. Patients were between 50 and 74 years old with a positive fecal immunochemical test (FIT). A random sample of 20 CCE investigations was taken from the total sample of more than 800 videos.
Results
Overall interobserver agreement on all landmarks was 51%. Interobserver agreement on the first cecal image (ileocecal valve), hepatic flexure, splenic flexure, and last rectal image (anus) was 72%, 29%, 22%, and 83%, respectively. The overall interobserver agreement, including only examinations with adequate bowel preparation (
n
= 16), was 54%, and for individual landmarks, 73%, 32%, 24%, and 85%.
Conclusion
Overall interobserver agreement on all four landmarks from CCE was poor. Measures are needed to improve landmark identification in CCE investigations. Artificial intelligence could be a possible solution to this problem.
Journal Article