Explore the vast range of titles available.

Biologists determine experimental effects by perturbing biological entities or units. When done appropriately, independent replication of the entity-intervention pair contributes to the sample size (N) and forms the basis of statistical inference. If the wrong entity-intervention pair is chosen, an experiment cannot address the question of interest. We surveyed a random sample of published animal experiments from 2011 to 2016 where interventions were applied to parents and effects examined in the offspring, as regulatory authorities provide clear guidelines on replication with such designs. We found that only 22% of studies (95% CI = 17%-29%) replicated the correct entity-intervention pair and thus made valid statistical inferences. Nearly half of the studies (46%, 95% CI = 38%-53%) had pseudoreplication while 32% (95% CI = 26%-39%) provided insufficient information to make a judgement. Pseudoreplication artificially inflates the sample size, and thus the evidence for a scientific claim, resulting in false positives. We argue that distinguishing between biological units, experimental units, and observational units clarifies where replication should occur, describe the criteria for genuine replication, and provide concrete examples of in vitro, ex vivo, and in vivo experimental designs.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the \"ARRIVE Essential 10,\" which constitutes the minimum requirement, and the \"Recommended Set,\" which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration (E&E) document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

Background Pseudoreplication occurs when observations are not statistically independent, but treated as if they are. This can occur when there are multiple observations on the same subjects, when samples are nested or hierarchically organised, or when measurements are correlated in time or space. Analysis of such data without taking these dependencies into account can lead to meaningless results, and examples can easily be found in the neuroscience literature. Results A single issue of Nature Neuroscience provided a number of examples and is used as a case study to highlight how pseudoreplication arises in neuroscientific studies, why the analyses in these papers are incorrect, and appropriate analytical methods are provided. 12% of papers had pseudoreplication and a further 36% were suspected of having pseudoreplication, but it was not possible to determine for certain because insufficient information was provided. Conclusions Pseudoreplication can undermine the conclusions of a statistical analysis, and it would be easier to detect if the sample size, degrees of freedom, the test statistic, and precise p -values are reported. This information should be a requirement for all publications.

Background Animals from the same litter are often more alike compared with animals from different litters. This litter-to-litter variation, or “litter effects”, can influence the results in addition to the experimental factors of interest. Furthermore, sometimes an experimental treatment can only be applied to whole litters rather than to individual offspring. An example is the valproic acid (VPA) model of autism, where VPA is administered to pregnant females thereby inducing the disease phenotype in the offspring. With this type of experiment the sample size is the number of litters and not the total number of offspring. If such experiments are not appropriately designed and analysed, the results can be severely biased as well as extremely underpowered. Results A review of the VPA literature showed that only 9% (3/34) of studies correctly determined that the experimental unit ( n ) was the litter and therefore made valid statistical inferences. In addition, litter effects accounted for up to 61% (p <0.001) of the variation in behavioural outcomes, which was larger than the treatment effects. In addition, few studies reported using randomisation (12%) or blinding (18%), and none indicated that a sample size calculation or power analysis had been conducted. Conclusions Litter effects are common, large, and ignoring them can make replication of findings difficult and can contribute to the low rate of translating preclinical in vivo studies into successful therapies. Only a minority of studies reported using rigorous experimental methods, which is consistent with much of the preclinical in vivo literature.

Brain microvascular endothelial cells (BEC) constitute the blood-brain barrier (BBB) which forms a dynamic interface between the blood and the central nervous system (CNS). This highly specialized interface restricts paracellular diffusion of fluids and solutes including chemicals, toxins and drugs from entering the brain. In this study we compared the transcriptome profiles of the human immortalized brain endothelial cell line hCMEC/D3 and human primary BEC. We identified transcriptional differences in immune response genes which are directly related to the immortalization procedure of the hCMEC/D3 cells. Interestingly, astrocytic co-culturing reduced cell adhesion and migration molecules in both BECs, which possibly could be related to regulation of immune surveillance of the CNS controlled by astrocytic cells within the neurovascular unit. By matching the transcriptome data from these two cell lines with published transcriptional data from freshly isolated mouse BECs, we discovered striking differences that could explain some of the limitations of using cultured BECs to study BBB properties. Key protein classes such as tight junction proteins, transporters and cell surface receptors show differing expression profiles. For example, the claudin-5, occludin and JAM2 expression is dramatically reduced in the two human BEC lines, which likely explains their low transcellular electric resistance and paracellular leakiness. In addition, the human BEC lines express low levels of unique brain endothelial transporters such as Glut1 and Pgp. Cell surface receptors such as LRP1, RAGE and the insulin receptor that are involved in receptor-mediated transport are also expressed at very low levels. Taken together, these data illustrate that BECs lose their unique protein expression pattern outside of their native environment and display a more generic endothelial cell phenotype. A collection of key genes that seems to be highly regulated by the local surroundings of BEC within the neurovascular unit are presented and discussed.

Drug-induced liver injury remains a frequent reason for drug withdrawal. Accordingly, more predictive and translational models are required to assess human hepatotoxicity risk. This study presents a comprehensive evaluation of two promising models to assess mechanistic hepatotoxicity, microengineered Organ-Chips and 3D hepatic spheroids, which have enhanced liver phenotype, metabolic activity and stability in culture not attainable with conventional 2D models. Sensitivity of the models to two hepatotoxins, acetaminophen (APAP) and fialuridine (FIAU), was assessed across a range of cytotoxicity biomarkers (ATP, albumin, miR-122, α-GST) as well as their metabolic functionality by quantifying APAP, FIAU and CYP probe substrate metabolites. APAP and FIAU produced dose- and time-dependent increases in miR-122 and α-GST release as well as decreases in albumin secretion in both Liver-Chips and hepatic spheroids. Metabolic turnover of CYP probe substrates, APAP and FIAU, was maintained over the 10-day exposure period at concentrations where no cytotoxicity was detected and APAP turnover decreased at concentrations where cytotoxicity was detected. With APAP, the most sensitive biomarkers were albumin in the Liver-Chips (EC50 5.6 mM, day 1) and miR-122 and ATP in the liver spheroids (14-fold and EC50 2.9 mM, respectively, day 3). With FIAU, the most sensitive biomarkers were albumin in the Liver-Chip (EC50 126 µM) and miR-122 (15-fold) in the liver spheroids, both on day 7. In conclusion, both models exhibited integrated toxicity and metabolism, and broadly similar sensitivity to the hepatotoxicants at relevant clinical concentrations, demonstrating the utility of these models for improved hepatotoxicity risk assessment.

Regulatory authorities require animal toxicity tests for new chemical entities. Organ weight changes are accepted as a sensitive indicator of chemically induced organ damage, but can be difficult to interpret because changes in organ weight might reflect chemically-induced changes in overall body weight. A common solution is to calculate the relative organ weight (organ to body weight ratio), but this inadequately controls for the dependence on body weight – a point made by statisticians for decades, but which has not been widely adopted. The recommended solution is an analysis of covariance (ANCOVA), but it is rarely used, possibly because both the method of statistical correction and the interpretation of the output may be unclear to those with minimal statistical training. Using relative organ weights can easily lead to incorrect conclusions, resulting in poor decisions, wasted resources, and an ethically questionable use of animals. We propose to cast the problem into a causal modelling framework as it directly assesses questions of scientific interest, the results are easy to interpret, and the analysis is simple to perform with freely available software. Furthermore, by taking a Bayesian approach we can model unequal variances, control for multiple testing, and directly provide evidence of safety.

Few studies that examine the neurogenesis-behaviour relationship formally establish covariation between neurogenesis and behaviour or rule out competing explanations. The behavioural relevance of neurogenesis might therefore be overestimated if other mechanisms account for some, or even all, of the experimental effects. A systematic review of the literature was conducted and the data reanalysed using causal mediation analysis, which can estimate the behavioural contribution of new hippocampal neurons separately from other mechanisms that might be operating. Results from eleven eligible individual studies were then combined in a meta-analysis to increase precision (representing data from 215 animals) and showed that neurogenesis made a negligible contribution to behaviour (standarised effect  = 0.15; 95% CI  = -0.04 to 0.34; p = 0.128); other mechanisms accounted for the majority of experimental effects (standardised effect  = 1.06; 95% CI  = 0.74 to 1.38; p = 1.7×10-11).

Introduction: Microphysiological systems (MPS; organ-on-a-chip) aim to recapitulate the 3D organ microenvironment and improve clinical predictivity relative to previous approaches. Though MPS studies provide great promise to explore treatment options in a multifactorial manner, they are often very complex. It is therefore important to assess and manage technical confounding factors, to maximise power, efficiency and scalability. Methods: As an illustration of how MPS studies can benefit from a systematic evaluation of confounders, we developed an experimental design approach for a bone marrow (BM) MPS and tested it for a specified context of use, the assessment of lineage-specific toxicity. Results: We demonstrated the accuracy of our multicolour flow cytometry set-up to determine cell type and maturity, and the viability of a “repeated measures” design where we sample from chips repeatedly for increased scalability and robustness. Importantly, we demonstrated an optimal way to arrange technical confounders. Accounting for these confounders in a mixed-model analysis pipeline increased power, which meant that the expected lineage-specific toxicities following treatment with olaparib or carboplatin were detected earlier and at lower doses. Furthermore, we performed a sample size analysis to estimate the appropriate number of replicates required for different effect sizes. This experimental design-based approach will generalise to other MPS set-ups. Discussion: This design of experiments approach has established a groundwork for a reliable and reproducible in vitro analysis of BM toxicity in a MPS, and the lineage-specific toxicity data demonstrate the utility of this model for BM toxicity assessment. Toxicity data demonstrate the utility of this model for BM toxicity assessment.

This Formal Comment responds to Jordan et al., and stresses that if scientific findings are to be robust, training in experimental design and statistics is critical to ensure that research questions, design considerations, and analyses are aligned.