Refining the Concept of Scientific Inference When Working with Big Data : Proceedings of a Workshop

The concept of utilizing big data to enable scientific discovery has generated tremendous excitement and investment from both private and public sectors over the past decade, and expectations continue to grow. Using big data analytics to identify complex patterns hidden inside volumes of data that have never been combined could accelerate the rate of scientific discovery and lead to the development of beneficial technologies and products. However, producing actionable scientific knowledge from such large, complex data sets requires statistical models that produce reliable inferences (NRC, 2013). Without careful consideration of the suitability of both available data and the statistical models applied, analysis of big data may result in misleading correlations and false discoveries, which can potentially undermine confidence in scientific research if the results are not reproducible. In June 2016 the National Academies of Sciences, Engineering, and Medicine convened a workshop to examine critical challenges and opportunities in performing scientific inference reliably when working with big data. Participants explored new methodologic developments that hold significant promise and potential research program areas for the future. This publication summarizes the presentations and discussions from the workshop. Table of ContentsFront Matter1 Introduction2 Framing the Workshop3 Inference About Discoveries Based on Integration of Diverse Data Sets4 Inference About Causal Discoveries Driven by Large Observational Data5 Inference When Regularization Is Used to Simplify Fitting of High-Dimensional Models6 Panel DiscussionReferencesAppendixesAppendix A: Registered Workshop ParticipantsAppendix B: Workshop AgendaAppendix C: Acronyms