Peer Review In An Era Of Evaluation

Author : Eva Forsberg
Publisher : Springer Nature
Page : 414 pages
File Size : 41,7 Mb
Release : 2022
Category : Education
ISBN : 9783030752637

Get Book

Peer Review in an Era of Evaluation by Eva Forsberg Pdf

This open access volume explores peer review in the scientific community and academia. While peer review is as old as modern science itself, recent changes in the evaluation culture of higher education systems have increased the use of peer review, and its purposes, forms and functions have become more diversified. This book put together a comprehensive set of conceptual and empirical contributions on various peer review practices with relevance for the scientific community and higher education institutions worldwide. Consisting of three parts, the editors and contributors examine the history, problems and developments of peer review, as well as the specificities of various peer review practices. In doing so, this book gives an overview on and examine peer review , and asks how it can move forward. Eva Forsberg is Professor of Education at Uppsala University, Sweden. Her research focuses education governance and evaluation, academic work and the interface between educational policy, practice and research. Lars Geschwind is Professor in Engineering Education Policy and Management at KTH Royal Institute of Technology, Sweden. His main research interests are higher education policy, institutional governance, academic leadership and academic work. Sara Levander is Senior Lecturer and Researcher in Education at Uppsala University, Sweden. Her research interests are higher education, academic work and faculty evaluation in academic recruitment and promotion. Wieland Wermke is Associate Professor in Special Education at Stockholm University, Sweden. His research interest focuses on comparative education methodology, and teacher practice at different levels of education.

Author : Ann C. Weller
Publisher : Information Today, Inc.
Page : 368 pages
File Size : 41,6 Mb
Release : 2001
Category : Business & Economics
ISBN : 1573871001

Get Book

Editorial Peer Review by Ann C. Weller Pdf

This book is the first to provide an in-depth analysis of the peer review process in scholarly publishing. Author Weller offers a systematic review of published studies of editorial peer review in the following broad categories: general studies of rejection rates, studies of editors, studies of authors, and studies of reviewers. The book concludes with an examination of new models of editorial peer review intended to enhance the scientific communication process as it moves from a print to an electronic environment.

Author : Gemma Derrick
Publisher : Springer
Page : 230 pages
File Size : 55,8 Mb
Release : 2018-02-08
Category : Education
ISBN : 9783319636276

Get Book

The Evaluators’ Eye by Gemma Derrick Pdf

This book offers an empirical analysis of how academic peer review panels mediate the traditionally non-academic criterion of societal impact. The UK’s 2014 Research Excellence Framework (REF2014) for the first time included an “Impact” criterion that considered how research had influenced society, beyond academia. Using a series of interviews with REF2014 Main Panel A evaluators, the book explores how a dominant definition of Impact was constructed within panels and how this led to the development of strategies around valuing it as an ambiguous object. By doing so, Derrick brings a unique perspective to Impact that is currently overlooked in the dominant Impact evaluation discourse. Through examining the evaluation procedure as a dynamic process it is argued that the best models, strategies and insights for Impact evaluation are those constructed in practice, within peer review groups. By exploring the legitimacy of peer review as a tool to assess the societal impact of research, Derrick states that the future for Impact evaluation is not to seek alternative tools where peer review seemingly fails, but instead to highlight ways in which peer review panels can work smarter. The book will be essential reading for students, academics and policy-makers working in Education, as well as researchers interested in peer review processes and the research evaluation frameworks and audit exercises globally.

Author : E. Rae Harcum,Ellen Rosen
Publisher : Praeger
Page : 0 pages
File Size : 41,6 Mb
Release : 1993-04-30
Category : Psychology
ISBN : 9780275945145

Get Book

The Gatekeepers of Psychology by E. Rae Harcum,Ellen Rosen Pdf

This book is a wake-up call for those who contend that the peer review system for journal publications works. It supports the current groundswell of dissatisfaction with peer review. Harcum and Rosen challenge the notion of simple biases of researchers and argue that many reviews are simply incompetent. The biases against new scientific approaches and philosophies are exacerbated if proposed by unknown researchers or if contrary to the established research stars. The authors also destroy the myth of the appeal system as a forum whereby peers can debate scientific issues. The primary purpose of this work is to raise the consciousness of the scientific community, particularly psychologists, about serious flaws in peer review. The authors demonstrate in a dramatic way how poor the system really is, and propose a critical change--the institution of a viable system for appeals.

Author : Serge Lehky
Publisher : BioBitField
Page : 110 pages
File Size : 52,5 Mb
Release : 2011
Category : Philosophy
ISBN : 9780982956908

Get Book

Peer Evaluation and Selection Systems by Serge Lehky Pdf

Humans tend to judge each other, often spontaneously and effortlessly, but also formally and deliberately. The author argues that this process of peer evaluation, or peer review, developed as a result of natural selection and offers adaptive benefits to individuals and communities. However, the peer review process is also stochastic, is based on assumptions, and relies on surrogate measures of success. As a result, particular instances of peer review may be non-adaptive or maladaptive. Another limitation of peer review is that it is useless in the face of novelty. Although peer review, in a broad sense, is critical to the success of human societies, the meaning of peer review is often overly simplified and misunderstood, its results overvalued, and its outcomes misinterpreted - causing much turmoil and frustration. The individuals who participate in a peer review process, especially those rejected by peers, as well as organizations that utilize peer review for decision making, will benefit from the insights proposed in this book.

Author : Robert J. Marder,Mark A. Smith,Richard A. Sheff
Publisher : HC Pro, Inc.
Page : 191 pages
File Size : 53,9 Mb
Release : 2007
Category : Business & Economics
ISBN : 9781601460110

Get Book

Effective Peer Review by Robert J. Marder,Mark A. Smith,Richard A. Sheff Pdf

HCPro is pleased to introduce Effective Peer Review: A Practical Guide to Contemporary Design, Second Edition, authored by The Greeley Company experts, Robert J. Marder, MD and Mark A. Smith, MD, MBA, FACS. Completely updated to help you: * Comply with The Joint Commission's 2007 standards * Deliver focused and ongoing professional practice evaluations * Evaluate physician core competencies * And much more! Peer review continues to rate as a top problematic issue and one you can't ignore. The pressure is driven by publicly available national data, The Joint Commission's 2007 standards expanding measurement of physician competence, and hospital boards' need to be assured that the peer review process is functioning effectively. Learn how to go beyond just satisfying a regulatory requirement to performing peer review that fosters true improvement within your facility. Although hospitals go through the motions of peer review, they are often unable to make it a meaningful process-one that results in true improvement in physician performance and meets The Joint Commission's standards. Transform your peer review process and meet external requirements with Effective Peer Review: A Practical Guide to Contemporary Design, Second Edition. Get best practices to make peer review worthwhile Newly updated and in high demand, Effective Peer Review, Second Edition, outlines and provides advice about how to do physician peer review effectively. Authored by experts from The Greeley Company, this book and CD-ROM goes beyond just reviewing the Joint Commission standards. It puts the standards in context by emphasizing best practices you can implement in your peer review process. Plus, you'll receive thorough discussion about data analysis and collection, along with peer review scoring and rating systems. Critical information at your fingertips Offering step-by-step guidance to peer review, this book and CD-ROM will help you: * Streamline your exist

Author : Serap Kurbanoğlu,Sonja Špiranec,Yurdagül Ünal,Joumana Boustany,Denis Kos
Publisher : Springer Nature
Page : 746 pages
File Size : 41,6 Mb
Release : 2022-04-05
Category : Education
ISBN : 9783030998851

Get Book

Information Literacy in a Post-Truth Era by Serap Kurbanoğlu,Sonja Špiranec,Yurdagül Ünal,Joumana Boustany,Denis Kos Pdf

This book constitutes the refereed post-conference proceedings of the 7th European Conference on Information Literacy, ECIL 2021, held in online mode in September 2021. The 61 revised papers included in this volume were carefully reviewed and selected from 192 submissions. The papers are organized in the topical sections on ​information literacy in a post-truth era and news literacy; health literacy; data literacy; digital literacy and digital empowerment; other literacies; information literacy in different contexts; information literacy education in different sectors; information literacy instruction; assessment and evaluation of information literacy; academic integrity, plagiarism and digital piracy; information behaviour; information literacy, libraries and librarians; information literacy in different cultures and countries; information literacy and democracy, citizenship, active participation.

Author : Pearl Eliadis,Indran A. Naidoo,Ray C. Rist
Publisher : Taylor & Francis
Page : 172 pages
File Size : 55,9 Mb
Release : 2023-04-07
Category : Political Science
ISBN : 9781000862614

Get Book

Policy Evaluation in the Era of COVID-19 by Pearl Eliadis,Indran A. Naidoo,Ray C. Rist Pdf

Did evaluation meet the challenges of the COVID-19 crisis? How were evaluation practices, architectures, and values affected? Policy Evaluation in the Era of COVID-19 is the first to offer a broad canvas that explores government responses and ideas to tackle the challenges that evaluation practice faces in preparing for the next global crisis. Practitioners and established academic experts in the field of policy evaluation present a sophisticated synthesis of institutional, national, and disciplinary perspectives, with insights drawn from developments in Australia, Canada and the UK, as well as the UN. Contributors examine the impacts of evaluation on socioeconomic recovery planning, government innovations in pivoting internal operations to address the crisis, and the role of parliamentary and audit institutions during the pandemic. Chapters also example the Sustainable Development Goals, and the inadequacy of human rights-based approaches in evaluation, while examining the imperative proposed by some authors that it is time that we take seriously the call for substantial transformation. Written in a clear and accessible style, Policy Evaluation in the Era of COVID-19 offers a much-needed insight on the role evaluation played during this unique and critical juncture in history.

Author : Nikolaus Kriegeskorte,Diana Deca
Publisher : Frontiers E-books
Page : 194 pages
File Size : 48,7 Mb
Release : 2024-06-03
Category : Electronic
ISBN : 9782889190683

Get Book

Beyond open access: visions for open evaluation of scientific papers by post-publication peer review by Nikolaus Kriegeskorte,Diana Deca Pdf

A scientific publication system needs to provide two basic services: access and evaluation. The traditional publication system restricts the access to papers by requiring payment, and it restricts the evaluation of papers by relying on just 2-4 pre-publication peer reviews and by keeping the reviews secret. As a result, the current system suffers from a lack of quality and transparency of the peer-review evaluation process, and the only immediately available indication of a new paper’s quality is the prestige of the journal it appeared in. Open access is now widely accepted as desirable and is slowly beginning to become a reality. However, the second essential element, evaluation, has received less attention. Open evaluation, an ongoing post-publication process of transparent peer review and rating of papers, promises to address the problems of the current system. However, it is unclear how exactly such a system should be designed. The evaluation system steers the attention of the scientific community and, thus, the very course of science. For better or worse, the most visible papers determine the direction of each field and guide funding and public policy decisions. Evaluation, therefore, is at the heart of the entire endeavor of science. As the number of scientific publications explodes, evaluation and selection will only gain importance. A grand challenge of our time, therefore, is to design the future system, by which we evaluate papers and decide which ones deserve broad attention. So far scientists have left the design of the evaluation process to journals and publishing companies. However, the steering mechanism of science should be designed by scientists. The cognitive, computational, and brain sciences are best prepared to take on this task, which will involve social and psychological considerations, software design, and modeling of the network of scientific papers and their interrelationships. This Research Topic in Frontiers in Computational Neuroscience collects visions for a future system of open evaluation. Because critical arguments about the current system abound, these papers will focus on constructive ideas and comprehensive designs for open evaluation systems. Design decisions include: Should the reviews and ratings be entirely transparent, or should some aspects be kept secret? Should other information, such as paper downloads be included in the evaluation? How can scientific objectivity be strengthened and political motivations weakened in the future system? Should the system include signed and authenticated reviews and ratings? Should the evaluation be an ongoing process, such that promising papers are more deeply evaluated? How can we bring science and statistics to the evaluation process (e.g. should rating averages come with error bars)? How should the evaluative information about each paper (e.g. peer ratings) be combined to prioritize the literature? Should different individuals and organizations be able to define their own evaluation formulae (e.g. weighting ratings according to different criteria)? How can we efficiently transition toward the future system? Ideally, the future system will derive its authority from a scientific literature on community-based open evaluation. We hope that these papers will provide a starting point.

Author : Melinda Baldwin
Publisher : University of Chicago Press
Page : 318 pages
File Size : 40,9 Mb
Release : 2015-08-18
Category : Science
ISBN : 9780226261591

Get Book

Making "Nature" by Melinda Baldwin Pdf

Making "Nature" is the first book to chronicle the foundation and development of Nature, one of the world's most influential scientific institutions. Now nearing its hundred and fiftieth year of publication, Nature is the international benchmark for scientific publication. Its contributors include Charles Darwin, Ernest Rutherford, and Stephen Hawking, and it has published many of the most important discoveries in the history of science, including articles on the structure of DNA, the discovery of the neutron, the first cloning of a mammal, and the human genome. But how did Nature become such an essential institution? In Making "Nature," Melinda Baldwin charts the rich history of this extraordinary publication from its foundation in 1869 to current debates about online publishing and open access. This pioneering study not only tells Nature's story but also sheds light on much larger questions about the history of science publishing, changes in scientific communication, and shifting notions of "scientific community." Nature, as Baldwin demonstrates, helped define what science is and what it means to be a scientist.

Author : Martin Paul Eve,Cameron Neylon,Daniel Paul O'Donnell,Samuel Moore,Robert Gadie,Victoria Odeniyi,Shahina Parvin
Publisher : Cambridge University Press
Page : 128 pages
File Size : 49,8 Mb
Release : 2020-12-31
Category : Language Arts & Disciplines
ISBN : 110874270X

Get Book

Reading Peer Review by Martin Paul Eve,Cameron Neylon,Daniel Paul O'Donnell,Samuel Moore,Robert Gadie,Victoria Odeniyi,Shahina Parvin Pdf

This Element describes for the first time the database of peer review reports at PLOS ONE, the largest scientific journal in the world, to which the authors had unique access. Specifically, this Element presents the background contexts and histories of peer review, the data-handling sensitivities of this type of research, the typical properties of reports in the journal to which the authors had access, a taxonomy of the reports, and their sentiment arcs. This unique work thereby yields a compelling and unprecedented set of insights into the evolving state of peer review in the twenty-first century, at a crucial political moment for the transformation of science. It also, though, presents a study in radicalism and the ways in which PLOS's vision for science can be said to have effected change in the ultra-conservative contemporary university. This title is also available as Open Access on Cambridge Core.

Author : National Research Council,Division of Behavioral and Social Sciences and Education,Center for Education,Committee on Research in Education
Publisher : National Academies Press
Page : 106 pages
File Size : 41,8 Mb
Release : 2004-09-18
Category : Education
ISBN : 9780309090995

Get Book

Strengthening Peer Review in Federal Agencies That Support Education Research by National Research Council,Division of Behavioral and Social Sciences and Education,Center for Education,Committee on Research in Education Pdf

Peer review is a method used to inform decision-making by engaging experts in a critical evaluation of the merits of a product or proposal. It is most commonly known as a mechanism for judging the quality of proposals for research funding, or manuscripts submitted for publication in academic journals. It is at once a tool with which scientific judgment is formalized and decisions about the allocation of scarce public resources are legitimized. Strengthening Peer Review in Federal Agencies That Support Education Research seeks to advance an improved understanding of a scientific approach to addressing education problems and to engage the field of education research in action-oriented dialogue about how to further the accumulation of scientific knowledge. The focus of this report is on peer review as it is applied to the evaluation of proposals for federal funding of education research projects.

Author : David Godfrey
Publisher : Springer Nature
Page : 299 pages
File Size : 43,9 Mb
Release : 2020-09-03
Category : Education
ISBN : 9783030481308

Get Book

School Peer Review for Educational Improvement and Accountability by David Godfrey Pdf

This book explores how peer reviews are used in school improvement, accountability and education system reform. Importantly, these issues are studied through numerous international cases and new empirical evidence. This volume also identifies and describes barriers and facilitators to the development, use, sustainability and expansion of school peer review. School peer reviews are a form of internal evaluation driven by schools themselves rather than externally imposed, such as with school inspections. Schools collaborate with other schools in networks, collect data through self-evaluation and in school review visits. They provide feedback, challenge and support to each other. Despite the increased use of school peer review in system reform and school improvement, very little research has been conducted on this model and there is a dearth of literature that looks at the phenomenon internationally. This book fills this gap and will be an invaluable source for academics in school leadership and educational evaluation and accountability, as well as those working at the level of executive leadership in school networks, NGOs and in government policy-making.

Author : Marc J. Epstein,Frank H. M. Verbeeten,Sally K. Widener
Publisher : Emerald Group Publishing
Page : 268 pages
File Size : 53,8 Mb
Release : 2018-09-07
Category : Business & Economics
ISBN : 9781787564701

Get Book

Performance Measurement and Management Control by Marc J. Epstein,Frank H. M. Verbeeten,Sally K. Widener Pdf

This volume contains exemplary papers that were presented at the 2017 Conference on Performance Measurement and Management Control in Nice, France, by researchers in the field from North America, South America, Africa, Europe, and Asia.

Author : Harnad
Publisher : CUP Archive
Page : 100 pages
File Size : 42,5 Mb
Release : 1982
Category : Language Arts & Disciplines
ISBN : 0521273064

Get Book

Peer Commentary on Peer Rev by Harnad Pdf