Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
456
result(s) for
"False positive rate"
Sort by:
How do steppe plants follow their optimal environmental conditions or persist under suboptimal conditions? The differing strategies of annuals and perennials
by
Albert, Cécile H
,
Université Rennes 1, Grant/Award Number: ANR-11-IDEX-0001-02; Labex OT-Med, Grant/Award Number: ANR-11-LABX-0061;French government through the AMIDEX project, Grant/Award Number: ANR-11-IDEX-0001-02
,
Berrached, Rachda
in
Biodiversity and Ecology
,
Dispersal
,
Dispersion
2018
For a species to be able to respond to environmental change, it must either succeed in following its optimal environmental conditions or in persisting under suboptimal conditions, but we know very little about what controls these capacities. We parameterized species distribution models (SDMs) for 135 plant species from the Algerian steppes. We interpreted low false-positive rates as reflecting a high capacity to followoptimal environmental conditions and high false-negative rates as a high capacity to persist under suboptimal environmental conditions. We also measured functional traits in the field and built a unique plant trait database for the North-African steppe.For both perennial and annual species, we explored how these two capacities can be explained by species traits and whether relevant trait values reflect species strategies or biases in SDMs. We found low false-positive rates in species with small seeds, flowers attracting specialist pollinators, and specialized distributions (among annuals and perennials), low root:shoot ratios, wide root-systems, and large leaves (perennialsonly) (R2 = .52–58). We found high false-negative rates in species with marginal environmental distribution (among annuals and perennials), small seeds, relatively deep roots, and specialized distributions (annuals) or large leaves, wide root-systems, and monocarpic life cycle (perennials) (R2 = .38 for annuals and 0.65 for perennials). Overall, relevant traits are rarely indicative of the possible biases of SDMs, but ratherreflect the species’ reproductive strategy, dispersal ability, stress tolerance, and pollination strategies. Our results suggest that wide undirected dispersal in annual species and efficient resource acquisition in perennial species favor both capacities, whereas short life spans in perennial species favor persistence in suboptimal environmental conditions and flowers attracting specialist pollinators in perennial and annual speciesfavor following optimal environmental conditions. Species that neither follow nor persist will be at risk under future environmental change.
Journal Article
False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies
by
Glickman, Mark E.
,
Rao, Sowmya R.
,
Schultz, Mark R.
in
Analysis. Health state
,
Biological and medical sciences
,
Biomedical Research - methods
2014
Procedures for controlling the false positive rate when performing many hypothesis tests are commonplace in health and medical studies. Such procedures, most notably the Bonferroni adjustment, suffer from the problem that error rate control cannot be localized to individual tests, and that these procedures do not distinguish between exploratory and/or data-driven testing vs. hypothesis-driven testing. Instead, procedures derived from limiting false discovery rates may be a more appealing method to control error rates in multiple tests.
Controlling the false positive rate can lead to philosophical inconsistencies that can negatively impact the practice of reporting statistically significant findings. We demonstrate that the false discovery rate approach can overcome these inconsistencies and illustrate its benefit through an application to two recent health studies.
The false discovery rate approach is more powerful than methods like the Bonferroni procedure that control false positive rates. Controlling the false discovery rate in a study that arguably consisted of scientifically driven hypotheses found nearly as many significant results as without any adjustment, whereas the Bonferroni procedure found no significant results.
Although still unfamiliar to many health researchers, the use of false discovery rate control in the context of multiple testing can provide a solid basis for drawing conclusions about statistical significance.
Journal Article
The Use of Ensemble Models for Multiple Class and Binary Class Classification for Improving Intrusion Detection Systems
by
Khan, Suleman
,
Alenezi, Mamdouh
,
Alazab, Mamoun
in
artificial intelligence
,
ensemble methods
,
false positive rate
2020
The pursuit to spot abnormal behaviors in and out of a network system is what led to a system known as intrusion detection systems for soft computing besides many researchers have applied machine learning around this area. Obviously, a single classifier alone in the classifications seems impossible to control network intruders. This limitation is what led us to perform dimensionality reduction by means of correlation-based feature selection approach (CFS approach) in addition to a refined ensemble model. The paper aims to improve the Intrusion Detection System (IDS) by proposing a CFS + Ensemble Classifiers (Bagging and Adaboost) which has high accuracy, high packet detection rate, and low false alarm rate. Machine Learning Ensemble Models with base classifiers (J48, Random Forest, and Reptree) were built. Binary classification, as well as Multiclass classification for KDD99 and NSLKDD datasets, was done while all the attacks were named as an anomaly and normal traffic. Class labels consisted of five major attacks, namely Denial of Service (DoS), Probe, User-to-Root (U2R), Root to Local attacks (R2L), and Normal class attacks. Results from the experiment showed that our proposed model produces 0 false alarm rate (FAR) and 99.90% detection rate (DR) for the KDD99 dataset, and 0.5% FAR and 98.60% DR for NSLKDD dataset when working with 6 and 13 selected features.
Journal Article
FMRI Clustering in AFNI: False-Positive Rates Redux
by
Reynolds, Richard C.
,
Glen, Daniel R.
,
Cox, Robert W.
in
Cluster Analysis
,
False Positive Reactions
,
Humans
2017
Recent reports of inflated false-positive rates (FPRs) in FMRI group analysis tools by Eklund and associates in 2016 have become a large topic within (and outside) neuroimaging. They concluded that existing parametric methods for determining statistically significant clusters had greatly inflated FPRs (“up to 70%,” mainly due to the faulty assumption that the noise spatial autocorrelation function is Gaussian shaped and stationary), calling into question potentially “countless” previous results; in contrast, nonparametric methods, such as their approach, accurately reflected nominal 5% FPRs. They also stated that AFNI showed “particularly high” FPRs compared to other software, largely due to a bug in 3dClustSim. We comment on these points using their own results and figures and by repeating some of their simulations. Briefly, while parametric methods show some FPR inflation in those tests (and assumptions of Gaussian-shaped spatial smoothness also appear to be generally incorrect), their emphasis on reporting the single worst result from thousands of simulation cases greatly exaggerated the scale of the problem. Importantly, FPR statistics depends on “task” paradigm and voxelwise p value threshold; as such, we show how results of their study provide useful suggestions for FMRI study design and analysis, rather than simply a catastrophic downgrading of the field's earlier results. Regarding AFNI (which we maintain), 3dClustSim's bug effect was greatly overstated—their own results show that AFNI results were not “particularly” worse than others. We describe further updates in AFNI for characterizing spatial smoothness more appropriately (greatly reducing FPRs, although some remain >5%); in addition, we outline two newly implemented permutation/randomization-based approaches producing FPRs clustered much more tightly about 5% for voxelwise p ≤ 0.01.
Journal Article
DNA sequencing of maternal plasma to detect Down syndrome: An international clinical validation study
by
Deciu, Cosmin
,
Kloza, Edward M.
,
Neveux, Louis M.
in
631/1647/514/1948
,
631/208/2489/144
,
Adult
2011
Prenatal screening for Down syndrome has improved, but the number of resulting invasive diagnostic procedures remains problematic. Measurement of circulating cell-free DNA in maternal plasma might offer improvement.
A blinded, nested case-control study was designed within a cohort of 4664 pregnancies at high risk for Down syndrome. Fetal karyotyping was compared with an internally validated, laboratory-developed test based on next-generation sequencing in 212 Down syndrome and 1484 matched euploid pregnancies. None had been previously tested. Primary testing occurred at a CLIA-certified commercial laboratory, with cross validation by a CLIA-certified university laboratory.
Down syndrome detection rate was 98.6% (209/212), the false-positive rate was 0.20% (3/1471), and the testing failed in 13 pregnancies (0.8%); all were euploid. Before unblinding, the primary testing laboratory also reported multiple alternative interpretations. Adjusting chromosome 21 counts for guanine cytosine base content had the largest impact on improving performance.
When applied to high-risk pregnancies, measuring maternal plasma DNA detects nearly all cases of Down syndrome at a very low false-positive rate. This method can substantially reduce the need for invasive diagnostic procedures and attendant procedure-related fetal losses. Although implementation issues need to be addressed, the evidence supports introducing this testing on a clinical basis.
Journal Article
Fetoplacental mosaicism: potential implications for false-positive and false-negative noninvasive prenatal screening results
by
Simoni, Giuseppe
,
Bajaj, Komal
,
Grimi, Beatrice
in
631/208/2489/1381/1661
,
692/700/139/1512
,
Amniotic fluid
2014
Purpose:
Noninvasive prenatal screening for fetal aneuploidy analyzes cell-free fetal DNA circulating in the maternal plasma. Because cell-free fetal DNA is mainly of placental trophoblast origin, false-positive and false-negative findings may result from placental mosaicism. The aim of this study was to calculate the potential contribution of placental mosaicism in discordant results of noninvasive prenatal screening.
Methods:
We performed a retrospective audit of 52,673 chorionic villus samples in which cytogenetic analysis of the cytotrophoblast (direct) and villus mesenchyme (culture) was performed, which was followed by confirmatory amniocentesis in chorionic villi mosaic cases. Using cases in which cytogenetic discordance between cytotrophoblast and amniotic fluid samples was identified, we calculated the potential contribution of cell line–specific mosaicism to false-positive and false-negative results of noninvasive prenatal screening.
Results:
The false-positive rate, secondary to the presence of abnormal cell line with common trisomies in cytotrophoblast and normal amniotic fluid, ranged from 1/1,065 to 1/3,931 at 10% and 100% mosaicism, respectively; the false-negative rate was calculated from cases of true fetal mosaicism, in which a mosaic cell line was absent in cytotrophoblast and present in the fetus; this occurred in 1/107 cases.
Conclusion:
Despite exciting advances, underlying biologic mechanisms will never allow 100% sensitivity or specificity.
Genet Med
16
8, 620–624.
Journal Article
The impact of study design on pattern estimation for single-trial multivariate pattern analysis
by
Davis, Tyler
,
Mumford, Jeanette A.
,
Poldrack, Russell A.
in
Biological and medical sciences
,
Brain - physiology
,
Brain Mapping - methods
2014
A prerequisite for a pattern analysis using functional magnetic resonance imaging (fMRI) data is estimating the patterns from time series data, which then are input into the pattern analysis. Here we focus on how the combination of study design (order and spacing of trials) with pattern estimator impacts the Type I error rate of the subsequent pattern analysis. When Type I errors are inflated, the results are no longer valid, so this work serves as a guide for designing and analyzing MVPA studies with controlled false positive rates. The MVPA strategies examined are pattern classification and similarity, utilizing single trial activation patterns from the same functional run. Primarily focusing on the Least Squares Single and Least Square All pattern estimators, we show that collinearities in the models, along with temporal autocorrelation, can cause false positive correlations between activation pattern estimates that adversely impact the false positive rates of pattern similarity and classification analyses. It may seem intuitive that increasing the interstimulus interval (ISI) would alleviate this issue, but remaining weak correlations between activation patterns persist and have a strong influence in pattern similarity analyses. Pattern similarity analyses using only activation patterns estimated from the same functional run of data are susceptible to inflated false positives unless trials are randomly ordered, with a different randomization for each subject. In other cases, where there is any structure to trial order, valid pattern similarity analysis results can only be obtained if similarity computations are restricted to pairs of activation patterns from independent runs. Likewise, for pattern classification, false positives are minimized when the testing and training sets in cross validation do not contain patterns estimated from the same run.
•Assessment of Type I error in pattern similarity and classification analyses.•Type I errors of similarity analyses are notably affected by study design.•Classification analyses are more robust to study design choice.•The optimal design for pattern similarity is to use between-run-based patterns.•The optimal analysis strategy for classification is between-run cross validation.
Journal Article
DNA sequencing of maternal plasma reliably identifies trisomy 18 and trisomy 13 as well as Down syndrome: an international collaborative study
by
Deciu, Cosmin
,
Kloza, Edward M.
,
Neveux, Louis M.
in
631/208/514/1948
,
692/420/2489/1381/1286
,
692/700/139/1512
2012
Purpose:
To determine whether maternal plasma cell–free DNA sequencing can effectively identify trisomy 18 and 13.
Methods:
Sixty-two pregnancies with trisomy 18 and 12 with trisomy 13 were selected from a cohort of 4,664 pregnancies along with matched euploid controls (including 212 additional Down syndrome and matched controls already reported), and their samples tested using a laboratory-developed, next-generation sequencing test. Interpretation of the results for chromosome 18 and 13 included adjustment for CG content bias.
Results:
Among the 99.1% of samples interpreted (1,971/1,988), observed trisomy 18 and 13 detection rates were 100% (59/59) and 91.7% (11/12) at false-positive rates of 0.28% and 0.97%, respectively. Among the 17 samples without an interpretation, three were trisomy 18. If
z
-score cutoffs for trisomy 18 and 13 were raised slightly, the overall false-positive rates for the three aneuploidies could be as low as 0.1% (2/1,688) at an overall detection rate of 98.9% (280/283) for common aneuploidies. An independent academic laboratory confirmed performance in a subset.
Conclusion:
Among high-risk pregnancies, sequencing circulating cell–free DNA detects nearly all cases of Down syndrome, trisomy 18, and trisomy 13, at a low false-positive rate. This can potentially reduce invasive diagnostic procedures and related fetal losses by 95%. Evidence supports clinical testing for these aneuploidies.
Genet Med
2012:14(3):296–305
Journal Article
False Discovery and False Nondiscovery Rates in Single-Step Multiple Testing Procedures
2006
Results on the false discovery rate (FDR) and the false nondiscovery rate (FNR) are developed for single-step multiple testing procedures. In addition to verifying desirable properties of FDR and FNR as measures of error rates, these results extend previously known results, providing further insights, particularly under dependence, into the notions of FDR and FNR and related measures. First, considering fixed configurations of true and false null hypotheses, inequalities are obtained to explain how an FDR- or FNR-controlling single-step procedure, such as a Bonferroni or S̆idák procedure, can potentially be improved. Two families of procedures are then constructed, one that modifies the FDR-controlling and the other that modifies the FNR-controlling S̆idák procedure. These are proved to control FDR or FNR under independence less conservatively than the corresponding families that modify the FDR- or FNR-controlling Bonferroni procedure. Results of numerical investigations of the performance of the modified S̆idák FDR procedure over its competitors are presented. Second, considering a mixture model where different configurations of true and false null hypotheses are assumed to have certain probabilities, results are also derived that extend some of Storey's work to the dependence case.
Journal Article
A flexible framework for hypothesis testing in high dimensions
2020
Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high dimensional regime where the number of parameters exceeds the number of samples (p > n). To make informative inference, we assume that the model is approximately sparse, i.e. the effect of covariates on the response can be well approximated by conditioning on a relatively small number of covariates whose identities are unknown. We develop a framework for testing very general hypotheses regarding the model parameters. Our framework encompasses testing whether the parameter lies in a convex cone, testing the signal strength, and testing arbitrary functionals of the parameter.We show that the procedure proposed controls the type I error, and we also analyse the power of the procedure. Our numerical experiments confirm our theoretical findings and demonstrate that we control the false positive rate (type I error) near the nominal level and have high power. By duality between hypotheses testing and confidence intervals, the framework proposed can be used to obtain valid confidence intervals for various functionals of the model parameters.For linear functionals, the length of confidence intervals is shown to be minimax rate optimal.
Journal Article