Methods To Foster Transparency And Reproducibility Of Federal Statistics

Author : National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics
Publisher : National Academies Press
Page : 125 pages
File Size : 54,6 Mb
Release : 2019-04-01
Category : Social Science
ISBN : 9780309486293

Get Book

Methods to Foster Transparency and Reproducibility of Federal Statistics by National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics Pdf

In 2014 the National Science Foundation (NSF) provided support to the National Academies of Sciences, Engineering, and Medicine for a series of Forums on Open Science in response to a government-wide directive to support increased public access to the results of research funded by the federal government. However, the breadth of the work resulting from the series precluded a focus on any specific topic or discussion about how to improve public access. Thus, the main goal of the Workshop on Transparency and Reproducibility in Federal Statistics was to develop some understanding of what principles and practices are, or would be, supportive of making federal statistics more understandable and reviewable, both by agency staff and the public. This publication summarizes the presentations and discussions from the workshop.

Author : National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics
Publisher : National Academies Press
Page : 125 pages
File Size : 49,7 Mb
Release : 2019-03-01
Category : Social Science
ISBN : 9780309486323

Get Book

Methods to Foster Transparency and Reproducibility of Federal Statistics by National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics Pdf

In 2014 the National Science Foundation (NSF) provided support to the National Academies of Sciences, Engineering, and Medicine for a series of Forums on Open Science in response to a government-wide directive to support increased public access to the results of research funded by the federal government. However, the breadth of the work resulting from the series precluded a focus on any specific topic or discussion about how to improve public access. Thus, the main goal of the Workshop on Transparency and Reproducibility in Federal Statistics was to develop some understanding of what principles and practices are, or would be, supportive of making federal statistics more understandable and reviewable, both by agency staff and the public. This publication summarizes the presentations and discussions from the workshop.

Author : National Academies Of Sciences Engineeri,National Academies of Sciences Engineering and Medicine,Division Of Behavioral And Social Scienc,Division of Behavioral and Social Sciences and Education,Committee On National Statistics,Panel on Transparency and Reproducibility of Federal Statistics for the National Center for Science and Engineering Statistics
Publisher : National Academies Press
Page : 128 pages
File Size : 49,8 Mb
Release : 2022-08-18
Category : Science
ISBN : 0309270456

Get Book

Transparency in Statistical Information for the National Center for Science and Engineering Statistics and All Federal Statistical Agencies by National Academies Of Sciences Engineeri,National Academies of Sciences Engineering and Medicine,Division Of Behavioral And Social Scienc,Division of Behavioral and Social Sciences and Education,Committee On National Statistics,Panel on Transparency and Reproducibility of Federal Statistics for the National Center for Science and Engineering Statistics Pdf

Widely available, trustworthy government statistics are essential for policy makers and program administrators at all levels of government, for private sector decision makers, for researchers, and for the media and the public. In the United States, principal statistical agencies as well as units and programs in many other agencies produce various key statistics in areas ranging from the science and engineering enterprise to education and economic welfare. Official statistics are often the result of complex data collection, processing, and estimation methods. These methods can be challenging for agencies to document and for users to understand. At the request of the National Center for Science and Engineering Statistics (NCSES), this report studies issues of documentation and archiving of NCSES statistical data products in order to enable NCSES to enhance the transparency and reproducibility of the agency's statistics and facilitate improvement of the statistical program workflow processes of the agency and its contractors. Transparency in Statistical Information for the National Center for Science and Engineering Statistics and All Federal Statistical Agencies also explores how NCSES could work with other federal statistical agencies to facilitate the adoption of currently available documentation and archiving standards and tools.

Author : National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Panel on Improving Federal Statistics for Policy and Social Science Research Using Multiple Data Sources and State-of-the-Art Estimation Methods
Publisher : National Academies Press
Page : 195 pages
File Size : 41,8 Mb
Release : 2018-01-27
Category : Social Science
ISBN : 9780309465373

Get Book

Federal Statistics, Multiple Data Sources, and Privacy Protection by National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Panel on Improving Federal Statistics for Policy and Social Science Research Using Multiple Data Sources and State-of-the-Art Estimation Methods Pdf

The environment for obtaining information and providing statistical data for policy makers and the public has changed significantly in the past decade, raising questions about the fundamental survey paradigm that underlies federal statistics. New data sources provide opportunities to develop a new paradigm that can improve timeliness, geographic or subpopulation detail, and statistical efficiency. It also has the potential to reduce the costs of producing federal statistics. The panel's first report described federal statistical agencies' current paradigm, which relies heavily on sample surveys for producing national statistics, and challenges agencies are facing; the legal frameworks and mechanisms for protecting the privacy and confidentiality of statistical data and for providing researchers access to data, and challenges to those frameworks and mechanisms; and statistical agencies access to alternative sources of data. The panel recommended a new approach for federal statistical programs that would combine diverse data sources from government and private sector sources and the creation of a new entity that would provide the foundational elements needed for this new approach, including legal authority to access data and protect privacy. This second of the panel's two reports builds on the analysis, conclusions, and recommendations in the first one. This report assesses alternative methods for implementing a new approach that would combine diverse data sources from government and private sector sources, including describing statistical models for combining data from multiple sources; examining statistical and computer science approaches that foster privacy protections; evaluating frameworks for assessing the quality and utility of alternative data sources; and various models for implementing the recommended new entity. Together, the two reports offer ideas and recommendations to help federal statistical agencies examine and evaluate data from alternative sources and then combine them as appropriate to provide the country with more timely, actionable, and useful information for policy makers, businesses, and individuals.

Author : National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Panel on Improving Federal Statistics for Policy and Social Science Research Using Multiple Data Sources and State-of-the-Art Estimation Methods
Publisher : National Academies Press
Page : 151 pages
File Size : 40,5 Mb
Release : 2017-04-21
Category : Social Science
ISBN : 9780309454285

Get Book

Innovations in Federal Statistics by National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Panel on Improving Federal Statistics for Policy and Social Science Research Using Multiple Data Sources and State-of-the-Art Estimation Methods Pdf

Federal government statistics provide critical information to the country and serve a key role in a democracy. For decades, sample surveys with instruments carefully designed for particular data needs have been one of the primary methods for collecting data for federal statistics. However, the costs of conducting such surveys have been increasing while response rates have been declining, and many surveys are not able to fulfill growing demands for more timely information and for more detailed information at state and local levels. Innovations in Federal Statistics examines the opportunities and risks of using government administrative and private sector data sources to foster a paradigm shift in federal statistical programs that would combine diverse data sources in a secure manner to enhance federal statistics. This first publication of a two-part series discusses the challenges faced by the federal statistical system and the foundational elements needed for a new paradigm.

Author : National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Board on Research Data and Information,Division on Engineering and Physical Sciences,Committee on Applied and Theoretical Statistics,Board on Mathematical Sciences and Analytics,Division on Earth and Life Studies,Nuclear and Radiation Studies Board,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Board on Behavioral, Cognitive, and Sensory Sciences,Committee on Reproducibility and Replicability in Science
Publisher : National Academies Press
Page : 257 pages
File Size : 55,9 Mb
Release : 2019-10-20
Category : Science
ISBN : 9780309486163

Get Book

Reproducibility and Replicability in Science by National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Board on Research Data and Information,Division on Engineering and Physical Sciences,Committee on Applied and Theoretical Statistics,Board on Mathematical Sciences and Analytics,Division on Earth and Life Studies,Nuclear and Radiation Studies Board,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Board on Behavioral, Cognitive, and Sensory Sciences,Committee on Reproducibility and Replicability in Science Pdf

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Author : United States. President's Commission on Federal Statistics
Publisher : Unknown
Page : 296 pages
File Size : 40,6 Mb
Release : 1971
Category : Government publications
ISBN : UCSC:32106005880817

Get Book

Federal Statistics; Report by United States. President's Commission on Federal Statistics Pdf

Author : National Research Council,Division of Behavioral and Social Sciences and Education,Committee on National Statistics
Publisher : National Academies Press
Page : 179 pages
File Size : 48,9 Mb
Release : 2013-06-22
Category : Social Science
ISBN : 9780309284332

Get Book

Principles and Practices for a Federal Statistical Agency by National Research Council,Division of Behavioral and Social Sciences and Education,Committee on National Statistics Pdf

Publicly available statistics from government agencies that are credible, relevant, accurate, and timely are essential for policy makers, individuals, households, businesses, academic institutions, and other organizations to make informed decisions. Even more, the effective operation of a democratic system of government depends on the unhindered flow of statistical information to its citizens. In the United States, federal statistical agencies in cabinet departments and independent agencies are the governmental units whose principal function is to compile, analyze, and disseminate information for such statistical purposes as describing population characteristics and trends, planning and monitoring programs, and conducting research and evaluation. The work of these agencies is coordinated by the U.S. Office of Management and Budget. Statistical agencies may acquire information not only from surveys or censuses of people and organizations, but also from such sources as government administrative records, private-sector datasets, and Internet sources that are judged of suitable quality and relevance for statistical use. They may conduct analyses, but they do not advocate policies or take partisan positions. Statistical purposes for which they provide information relate to descriptions of groups and exclude any interest in or identification of an individual person, institution, or economic unit. Four principles are fundamental for a federal statistical agency: relevance to policy issues, credibility among data users, trust among data providers, and independence from political and other undue external influence. Principles and Practices for a Federal Statistical Agency: Fifth Edition explains these four principles in detail.

Author : National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Committee on Responsible Science
Publisher : National Academies Press
Page : 327 pages
File Size : 54,9 Mb
Release : 2018-01-13
Category : Science
ISBN : 9780309391252

Get Book

Fostering Integrity in Research by National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Committee on Responsible Science Pdf

The integrity of knowledge that emerges from research is based on individual and collective adherence to core values of objectivity, honesty, openness, fairness, accountability, and stewardship. Integrity in science means that the organizations in which research is conducted encourage those involved to exemplify these values in every step of the research process. Understanding the dynamics that support â€" or distort â€" practices that uphold the integrity of research by all participants ensures that the research enterprise advances knowledge. The 1992 report Responsible Science: Ensuring the Integrity of the Research Process evaluated issues related to scientific responsibility and the conduct of research. It provided a valuable service in describing and analyzing a very complicated set of issues, and has served as a crucial basis for thinking about research integrity for more than two decades. However, as experience has accumulated with various forms of research misconduct, detrimental research practices, and other forms of misconduct, as subsequent empirical research has revealed more about the nature of scientific misconduct, and because technological and social changes have altered the environment in which science is conducted, it is clear that the framework established more than two decades ago needs to be updated. Responsible Science served as a valuable benchmark to set the context for this most recent analysis and to help guide the committee's thought process. Fostering Integrity in Research identifies best practices in research and recommends practical options for discouraging and addressing research misconduct and detrimental research practices.

Author : National Academies of Sciences, Engineering, and Medicine,Division on Engineering and Physical Sciences,Board on Mathematical Sciences and Their Applications,Committee on Applied and Theoretical Statistics
Publisher : National Academies Press
Page : 133 pages
File Size : 47,6 Mb
Release : 2016-03-29
Category : Mathematics
ISBN : 9780309392020

Get Book

Statistical Challenges in Assessing and Fostering the Reproducibility of Scientific Results by National Academies of Sciences, Engineering, and Medicine,Division on Engineering and Physical Sciences,Board on Mathematical Sciences and Their Applications,Committee on Applied and Theoretical Statistics Pdf

Questions about the reproducibility of scientific research have been raised in numerous settings and have gained visibility through several high-profile journal and popular press articles. Quantitative issues contributing to reproducibility challenges have been considered (including improper data measurement and analysis, inadequate statistical expertise, and incomplete data, among others), but there is no clear consensus on how best to approach or to minimize these problems. A lack of reproducibility of scientific results has created some distrust in scientific findings among the general public, scientists, funding agencies, and industries. While studies fail for a variety of reasons, many factors contribute to the lack of perfect reproducibility, including insufficient training in experimental design, misaligned incentives for publication and the implications for university tenure, intentional manipulation, poor data management and analysis, and inadequate instances of statistical inference. The workshop summarized in this report was designed not to address the social and experimental challenges but instead to focus on the latter issues of improper data management and analysis, inadequate statistical expertise, incomplete data, and difficulties applying sound statistic inference to the available data. Many efforts have emerged over recent years to draw attention to and improve reproducibility of scientific work. This report uniquely focuses on the statistical perspective of three issues: the extent of reproducibility, the causes of reproducibility failures, and the potential remedies for these failures.

Author : Jonathan Klick,Eric Helland
Publisher : University of Chicago Press
Page : 315 pages
File Size : 49,5 Mb
Release : 2018-03-22
Category : Law
ISBN : 9780226438184

Get Book

Supreme Court Economic Review by Jonathan Klick,Eric Helland Pdf

The Supreme Court Economic Review is a faculty-edited, peer-reviewed, interdisciplinary law and economics series with a particular focus on economic and social science analysis of judicial decision making, institutional analysis of law and legal structures, political economy and public choice issues regarding courts and other decision-makers, and the relationship between legal and political institutions and the institutions of a free society governed by constitutions and the rule of law. Contributors include renowned legal scholars, economists, and policy-makers, and consistently ranks among the most influential journals of law and economics.

Author : National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Board on Research Data and Information,Division on Engineering and Physical Sciences,Committee on Applied and Theoretical Statistics,Board on Mathematical Sciences and Analytics,Division on Earth and Life Studies,Nuclear and Radiation Studies Board,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Board on Behavioral, Cognitive, and Sensory Sciences,Committee on Reproducibility and Replicability in Science
Publisher : National Academies Press
Page : 257 pages
File Size : 55,7 Mb
Release : 2019-09-20
Category : Science
ISBN : 9780309486194

Get Book

Reproducibility and Replicability in Science by National Academies of Sciences, Engineering, and Medicine,Policy and Global Affairs,Committee on Science, Engineering, Medicine, and Public Policy,Board on Research Data and Information,Division on Engineering and Physical Sciences,Committee on Applied and Theoretical Statistics,Board on Mathematical Sciences and Analytics,Division on Earth and Life Studies,Nuclear and Radiation Studies Board,Division of Behavioral and Social Sciences and Education,Committee on National Statistics,Board on Behavioral, Cognitive, and Sensory Sciences,Committee on Reproducibility and Replicability in Science Pdf

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Author : ENGINEERING NATIONAL ACADEMIES OF SCIENCES (AND MEDICINE. DIVISION OF BEHAVIORAL AND SOCIAL.),National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics
Publisher : Unknown
Page : 227 pages
File Size : 45,5 Mb
Release : 2021-12-26
Category : Computers
ISBN : 0309681146

Get Book

Principles and Practices for a Federal Statistical Agency by ENGINEERING NATIONAL ACADEMIES OF SCIENCES (AND MEDICINE. DIVISION OF BEHAVIORAL AND SOCIAL.),National Academies of Sciences, Engineering, and Medicine,Division of Behavioral and Social Sciences and Education,Committee on National Statistics Pdf

Government statistics are widely used to inform decisions by policymakers, program administrators, businesses and other organizations as well as households and the general public. Principles and Practices for a Federal Statistical Agency, Seventh Edition will assist statistical agencies and units, as well as other agencies engaged in statistical activities, to carry out their responsibilities to provide accurate, timely, relevant, and objective information for public and policy use. This report will also inform legislative and executive branch decision makers, data users, and others about the characteristics of statistical agencies that enable them to serve the public good.

Author : Anonim
Publisher : Springer Nature
Page : 141 pages
File Size : 45,8 Mb
Release : 2022
Category : Electronic books
ISBN : 9783031199226

Get Book

Key Topics in Psychological Methods by Anonim Pdf

This volume features cutting-edge and impactful articles from across Springer's diverse journals publishing program. In this curated collection, our editorial team has brought together highly-cited and downloaded articles on the topic of Psychological Methods into one single resource. Moreover, this book enables readers to review a broad spectrum of quality research on a specialized topic, which we hope facilitates interdisciplinary and critical discussions of the topic at hand. As part of the Key Topics in Behavioral Sciences book series, this volume aims to serve as a quick reference for readers when writing or researching new topics or subject areas. Other topics in the series will include Psychological Research Methods, Health and Behavior, Industrial and Organizational Psychology, Sports Psychology, and Consumer Behavior. In the first section of the volume, articles focus on such topics as Artificial Intelligence, Cultural Learning, Human Evolution, Human-Computer Interaction, Referential Triangle, Social Interaction, Differences, Diversity, Evolution, Genetics, Populations, and Race. Next, the second section features research on Double Dialogicality, Generalization, Qualitative Research, Single Case, Data Analysis, Data Screening, Insufficient Effort Responding, Research Design, Research Methods, and Survey Research. Lastly in the final section of this collection, Data Snooping, Harking, Publication Bias, Simulation, Open Science, Philosophy Of Science, Questionable Research Practices, Research Ethics, Content-Analysis, Dictionary Analysis, Natural Language Processing, Structural Topic Modeling, Text Analysis, Thematic Analysis, and Topic Modeling are discussed.

Author : Garret Christensen,Jeremy Freese,Edward Miguel
Publisher : University of California Press
Page : 266 pages
File Size : 41,7 Mb
Release : 2019-07-23
Category : Social Science
ISBN : 9780520296930

Get Book

Transparent and Reproducible Social Science Research by Garret Christensen,Jeremy Freese,Edward Miguel Pdf

Recently, social science has had numerous episodes of influential research that was found invalid when placed under rigorous scrutiny. The growing sense that many published results are potentially erroneous has made those conducting social science research more determined to ensure the underlying research is sound. Transparent and Reproducible Social Science Research is the first book to summarize and synthesize new approaches to combat false positives and non-reproducible findings in social science research, document the underlying problems in research practices, and teach a new generation of students and scholars how to overcome them. Understanding that social science research has real consequences for individuals when used by professionals in public policy, health, law enforcement, and other fields, the book crystallizes new insights, practices, and methods that help ensure greater research transparency, openness, and reproducibility. Readers are guided through well-known problems and are encouraged to work through new solutions and practices to improve the openness of their research. Created with both experienced and novice researchers in mind, Transparent and Reproducible Social Science Research serves as an indispensable resource for the production of high quality social science research.