Thumbnail Image
Item

Diagnosing scientific replicability through probabilistic distinguishability

Wang, Peng
; 
Cao, Hongyuan
; 
Wen, Xiaoquan
Citations
Google Scholar:
Lookup
Altmetric:
Files
Thumbnail Image
btag140.pdf
Adobe PDF, 3.21 MB
Author
Wang, Peng
Cao, Hongyuan
Wen, Xiaoquan
Supervisor
Department
Statistics and Data Science
Embargo End Date
Type
Journal article
Date
License
http://creativecommons.org/licenses/by/4.0/
Language
English
Collections
Publications
Show all metadata
Research Projects
Organizational Units
Journal Issue
Abstract
MOTIVATION: Despite the widely recognized importance of replicability in biological research, computational methods to quantify irreplicability and identify irreplicable instances remain underdeveloped. This article presents an efficient and robust computational framework to address this gap. RESULTS: To tackle the challenge of defining an acceptable level of intrinsic heterogeneity among replicable studies, we introduce a distinguishability criterion, ensuring that replicable effects, while potentially heterogeneous, can be distinguished from zero effects and maintain consistent directions with high probability. We implement a Bayesian model criticism approach, reporting a Bayesian P-value to identify potential irreplicable instances. Through numerical experiments, we demonstrate the efficacy of the proposed methods in detecting batch effects in high-throughput experiments and identifying instances of the publication bias. Finally, we apply the framework to multi-tissue eQTL data from the GTEx consortium, uncovering tissue-specific eQTLs that represent biological heterogeneity across tissues. AVAILABILITY AND IMPLEMENTATION: An R package DiscRep implementing our method is available on GitHub (https://github.com/PengWang96/DiscRep).
Citation
P. Wang, H. Cao, X. Wen, "Diagnosing scientific replicability through probabilistic distinguishability," Bioinformatics, vol. 42, no. 5, pp. btag140-, 2026, https://doi.org/10.1093/bioinformatics/btag140.
Source
Bioinformatics
Conference
Keywords
31 Biological Sciences, 3102 Bioinformatics and Computational Biology, Algorithms, Bayes Theorem, Computational Biology, Humans, Quantitative Trait Loci, Reproducibility of Results, Software
Subjects
Source
Publisher
Oxford University Press
DOI
10.1093/bioinformatics/btag140
Additional links
https://academic.oup.com/bioinformatics/article/42/5/btag140/8538005
Full-text link