Computational Psychometrics New Methodologies For A New Generation Of Digital Learning And Assessment

Computational Psychometrics New Methodologies For A New Generation Of Digital Learning And Assessment Book in PDF, ePub and Kindle version is available to download in english. Read online anytime anywhere directly from your device. Click on the download button below to get a free pdf file of Computational Psychometrics New Methodologies For A New Generation Of Digital Learning And Assessment book. This book definitely worth reading, it is an incredibly well-written.

Computational Psychometrics: New Methodologies for a New Generation of Digital Learning and Assessment

Author : Alina A. von Davier,Robert J. Mislevy,Jiangang Hao
Publisher : Springer Nature
Page : 265 pages
File Size : 40,7 Mb
Release : 2022-01-01
Category : Education
ISBN : 9783030743949

Get Book

Computational Psychometrics: New Methodologies for a New Generation of Digital Learning and Assessment by Alina A. von Davier,Robert J. Mislevy,Jiangang Hao Pdf

This book defines and describes a new discipline, named “computational psychometrics,” from the perspective of new methodologies for handling complex data from digital learning and assessment. The editors and the contributing authors discuss how new technology drastically increases the possibilities for the design and administration of learning and assessment systems, and how doing so significantly increases the variety, velocity, and volume of the resulting data. Then they introduce methods and strategies to address the new challenges, ranging from evidence identification and data modeling to the assessment and prediction of learners’ performance in complex settings, as in collaborative tasks, game/simulation-based tasks, and multimodal learning and assessment tasks. Computational psychometrics has thus been defined as a blend of theory-based psychometrics and data-driven approaches from machine learning, artificial intelligence, and data science. All these together provide a better methodological framework for analysing complex data from digital learning and assessments. The term “computational” has been widely adopted by many other areas, as with computational statistics, computational linguistics, and computational economics. In those contexts, “computational” has a meaning similar to the one proposed in this book: a data-driven and algorithm-focused perspective on foundations and theoretical approaches established previously, now extended and, when necessary, reconceived. This interdisciplinarity is already a proven success in many disciplines, from personalized medicine that uses computational statistics to personalized learning that uses, well, computational psychometrics. We expect that this volume will be of interest not just within but beyond the psychometric community. In this volume, experts in psychometrics, machine learning, artificial intelligence, data science and natural language processing illustrate their work, showing how the interdisciplinary expertise of each researcher blends into a coherent methodological framework to deal with complex data from complex virtual interfaces. In the chapters focusing on methodologies, the authors use real data examples to demonstrate how to implement the new methods in practice. The corresponding programming codes in R and Python have been included as snippets in the book and are also available in fuller form in the GitHub code repository that accompanies the book.

Computational Aspects of Psychometric Methods

Author : Patricia Martinková,Adéla Hladká
Publisher : CRC Press
Page : 348 pages
File Size : 53,7 Mb
Release : 2023-07-03
Category : Psychology
ISBN : 9781000899177

Get Book

Computational Aspects of Psychometric Methods by Patricia Martinková,Adéla Hladká Pdf

This book covers the computational aspects of psychometric methods involved in developing measurement instruments and analyzing measurement data in social sciences. It covers the main topics of psychometrics such as validity, reliability, item analysis, item response theory models, and computerized adaptive testing. The computational aspects comprise the statistical theory and models, comparison of estimation methods and algorithms, as well as an implementation with practical data examples in R and also in an interactive ShinyItemAnalysis application. Key Features: Statistical models and estimation methods involved in psychometric research Includes reproducible R code and examples with real datasets Interactive implementation in ShinyItemAnalysis application The book is targeted toward a wide range of researchers in the field of educational, psychological, and health-related measurements. It is also intended for those developing measurement instruments and for those collecting and analyzing data from behavioral measurements, who are searching for a deeper understanding of underlying models and further development of their analytical skills.

Advancing Natural Language Processing in Educational Assessment

Author : Victoria Yaneva,Matthias von Davier
Publisher : Taylor & Francis
Page : 339 pages
File Size : 42,9 Mb
Release : 2023-06-05
Category : Education
ISBN : 9781000904192

Get Book

Advancing Natural Language Processing in Educational Assessment by Victoria Yaneva,Matthias von Davier Pdf

Advancing Natural Language Processing in Educational Assessment examines the use of natural language technology in educational testing, measurement, and assessment. Recent developments in natural language processing (NLP) have enabled large-scale educational applications, though scholars and professionals may lack a shared understanding of the strengths and limitations of NLP in assessment as well as the challenges that testing organizations face in implementation. This first-of-its-kind book provides evidence-based practices for the use of NLP-based approaches to automated text and speech scoring, language proficiency assessment, technology-assisted item generation, gamification, learner feedback, and beyond. Spanning historical context, validity and fairness issues, emerging technologies, and implications for feedback and personalization, these chapters represent the most robust treatment yet about NLP for education measurement researchers, psychometricians, testing professionals, and policymakers. The Open Access version of this book, available at www.taylorfrancis.com, has been made available under a Creative Commons Attribution-NonCommercial-No Derivatives 4.0 license.

Design Recommendations for Intelligent Tutoring Systems: Volume 10 - Strengths, Weaknesses, Opportunities and Threats (SWOT) Analysis of Intelligent Tutoring Systems

Author : Anne Sinatra,Art Graesser,Xiangen Hu,Gregory Goodwin,Vasile Rus
Publisher : U.S. Army DEVCOM – Soldier Center
Page : 160 pages
File Size : 51,5 Mb
Release : 2023-03-10
Category : Computers
ISBN : 9780997725834

Get Book

Design Recommendations for Intelligent Tutoring Systems: Volume 10 - Strengths, Weaknesses, Opportunities and Threats (SWOT) Analysis of Intelligent Tutoring Systems by Anne Sinatra,Art Graesser,Xiangen Hu,Gregory Goodwin,Vasile Rus Pdf

This book is a resource for those who are new to intelligent tutoring systems (ITSs), as well as those with a great deal of experience with them. This is the tenth book in our Design Recommendations for Intelligent Tutoring Systems book series. The focus of this book is on Strengths, Weaknesses, Opportunities, and Threats (SWOT) Analyses of varying components of ITSs. Each chapter in the book represents a different topic area, and includes a SWOT analysis that is specific to that topic and how it relates to ITSs. This book can be read in order, or a reader can choose a specific topic area and move directly to that chapter. Each SWOT Analysis describes the current state of the topic area, and how the lessons learned from the analysis could be applied to the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare et al., 2012; Sottilare et al., 2017). GIFT is an ITS architecture that is open-source, modular, and domain independent (Sottilare et al., 2017). Each book in the design recommendations series has addressed a different ITS topic area, and how the work in each chapter can relate to and inform the GIFT architecture. GIFT has continually been in development, with features consistently being added to improve functionality, as well as reduce the skill requirement for authoring content in GIFT. GIFT is freely available in both downloadable and Cloud versions at https://www.GIFTtutoring.org.

Assessing Through the Lens of Social and Emotional Learning

Author : Cynthia Sistek,Dee L. Fabry
Publisher : Corwin Press
Page : 260 pages
File Size : 44,5 Mb
Release : 2024-01-11
Category : Education
ISBN : 9781071907436

Get Book

Assessing Through the Lens of Social and Emotional Learning by Cynthia Sistek,Dee L. Fabry Pdf

Help usher in a new era of student assessment This empowering guide revolutionizes the assessment process by putting students at the center. Dive into practical strategies and best practices for fostering social and emotional learning (SEL) competencies through student-centered assessments and discover how you can transform classrooms into inclusive spaces where learning thrives. Inside you′ll find Humanistic assessing practices to integrate into everyday teaching and learning Best practices for designing and implementing savvy SEL assessments Ways to develop a classroom that is student empowered and culturally relevant Rubrics, portfolios, and digital tools that demonstrate students’ competencies and knowledge through an SEL lens Explore dozens of practical examples, case studies, and field-tested activities that support research-based teaching and learning across the curriculum. Assessing Through the Lens of Social and Emotional Learning inspires educators to move beyond traditional testing to focus on nurturing and fostering skills that students will need for both academic and lifelong success.

Principles and Applications of Adaptive Artificial Intelligence

Author : Lv, Zhihan
Publisher : IGI Global
Page : 332 pages
File Size : 54,5 Mb
Release : 2024-01-24
Category : Computers
ISBN : 9798369302323

Get Book

Principles and Applications of Adaptive Artificial Intelligence by Lv, Zhihan Pdf

The rapid adoption of deep learning models has resulted in many business services becoming model services, yet most AI systems lack the necessary automation and industrialization capabilities. This leads to heavy reliance on manual operation and maintenance, which not only consumes power but also causes resource wastage and stability issues during system mutations. The inadequate self-adaptation of AI systems poses significant challenges in terms of cost-effectiveness and operational stability. Principles and Applications of Adaptive Artificial Intelligence, edited by Zhihan Lv from Uppsala University, Sweden, offers a comprehensive solution to the self-adaptation problem in AI systems. It explores the latest concepts, technologies, and applications of Adaptive AI, equipping academic scholars and professionals with the necessary knowledge to overcome the challenges faced by traditional business logic transformed into model services. With its problem-solving approach, real-world case studies, and thorough analysis, the Handbook provides practitioners with practical ideas and solutions, while also serving as a valuable teaching material and reference guide for students and educators in AI-related disciplines. By emphasizing self-adaptation, continuous model iteration, and dynamic learning based on real-time feedback, the book empowers readers to significantly enhance the cost-effectiveness and operational stability of AI systems, making it an indispensable resource for researchers, professionals, and students seeking to revolutionize their research and applications in the field of Adaptive AI.

Quantitative Psychology

Author : Marie Wiberg,Dylan Molenaar,Jorge González,Jee-Seon Kim,Heungsun Hwang
Publisher : Springer Nature
Page : 329 pages
File Size : 44,5 Mb
Release : 2022-07-12
Category : Mathematics
ISBN : 9783031045721

Get Book

Quantitative Psychology by Marie Wiberg,Dylan Molenaar,Jorge González,Jee-Seon Kim,Heungsun Hwang Pdf

The volume represents presentations given at the 86th annual meeting of the Psychometric Society, held virtually on July 19–23, 2021. About 500 individuals contributed paper presentations, symposiums, poster presentations, pre-conference workshops, keynote presentations, and invited presentations. Since the 77th meeting, Springer has published the conference proceedings volume from this annual meeting to allow presenters to share their work and ideas with the wider research community, while still undergoing a thorough review process. This proceedings covers a diverse set of psychometric topics, including item response theory, Bayesian models, reliability, longitudinal measures, and cognitive diagnostic models.

Talent Assessment

Author : Tracy Kantrowitz,Douglas H. Reynolds,John Scott
Publisher : Oxford University Press
Page : 585 pages
File Size : 44,5 Mb
Release : 2023
Category : Business & Economics
ISBN : 9780197611050

Get Book

Talent Assessment by Tracy Kantrowitz,Douglas H. Reynolds,John Scott Pdf

"Technology-enhanced assessments for selection and development have flourished over the past several decades. Sophisticated assessment programs that weren't possible even a few years ago can now be assembled and launched on a global scale to measure almost any attribute in any language with greater realism, efficiency, and precision than ever before. Large-scale assessment applications have emerged where candidates are recruited online, automatically screened, assessed and prioritized, and presented with online interview questions based on the results of their assessments - all without any human contact. Many organizations have enthusiastically embraced these developments due to the obvious practical benefits and immediate payoff associated with increased efficiency and reduced costs to move candidates from recruitment through to selection"--

Artificial Intelligence in Education

Author : Ido Roll,Danielle McNamara,Sergey Sosnovsky,Rose Luckin,Vania Dimitrova
Publisher : Springer Nature
Page : 536 pages
File Size : 55,6 Mb
Release : 2021-06-11
Category : Computers
ISBN : 9783030782702

Get Book

Artificial Intelligence in Education by Ido Roll,Danielle McNamara,Sergey Sosnovsky,Rose Luckin,Vania Dimitrova Pdf

This two-volume set LNAI 12748 and 12749 constitutes the refereed proceedings of the 22nd International Conference on Artificial Intelligence in Education, AIED 2021, held in Utrecht, The Netherlands, in June 2021.* The 40 full papers presented together with 76 short papers, 2 panels papers, 4 industry papers, 4 doctoral consortium, and 6 workshop papers were carefully reviewed and selected from 209 submissions. The conference provides opportunities for the cross-fertilization of approaches, techniques and ideas from the many fields that comprise AIED, including computer science, cognitive and learning sciences, education, game design, psychology, sociology, linguistics as well as many domain-specific areas. ​*The conference was held virtually due to the COVID-19 pandemic.

Design Recommendations for Intelligent Tutoring System - Volume 5: Assessment Methods

Author : Dr. Robert Sottilare,Dr. Arthur Graesser,Dr. Xiangen Hu,Dr. Gregory Goodwin
Publisher : US Army Research Laboratory
Page : 355 pages
File Size : 46,5 Mb
Release : 2017-08-28
Category : Electronic
ISBN : 9780997725728

Get Book

Design Recommendations for Intelligent Tutoring System - Volume 5: Assessment Methods by Dr. Robert Sottilare,Dr. Arthur Graesser,Dr. Xiangen Hu,Dr. Gregory Goodwin Pdf

This book is the fifth in a planned series of books that examine key topics (e.g., learner modeling, instructional strategies, authoring, domain modeling, assessment, impact on learning, team tutoring, machine learning, and potential standards) in intelligent tutoring system (ITS) design through the lens of the Generalized Intelligent Framework for Tutoring (GIFT) (Sottilare, Brawner, Goldberg & Holden, 2012; Sottilare, Brawner, Sinatra, & Johnston, 2017). GIFT is a modular, service-oriented architecture created to reduce the cost and skill required to author ITSs, manage instruction within ITSs, and evaluate the effect of ITS technologies on learning, performance, retention, transfer of skills, and other instructional outcomes. Along with this volume, the first four books in this series, Learner Modeling (ISBN 978-0-9893923-0-3), Instructional Management (ISBN 978-0-9893923-2-7), Authoring Tools (ISBN 978-0-9893923-6-5) and Domain Modeling (978-0-9893923-9-6) are freely available at www.GIFTtutoring.org and on Google Play.

Sociocognitive Foundations of Educational Measurement

Author : Robert J. Mislevy
Publisher : Routledge
Page : 438 pages
File Size : 46,6 Mb
Release : 2018-04-09
Category : Education
ISBN : 9781317976523

Get Book

Sociocognitive Foundations of Educational Measurement by Robert J. Mislevy Pdf

Several key developments challenge the field of educational measurement today: demands for tests at larger scales with higher stakes, an improved understanding of how people develop capabilities, and new technologies for interactive digital assessments. Sociocognitive Foundations of Educational Measurement integrates new developments in educational measurement and educational psychology in order to provide researchers, testing professionals, and students with an innovative sociocognitive perspective on assessment. This comprehensive volume begins with a broad explanation of the sociocognitive perspective and the foundations of assessment, then provides a series of focused applications to major topics such as assessment arguments, validity, fairness, interactive assessment, and a conception of "measurement" in educational assessment. Classical test theory, item response theory, categorical models, mixture models, cognitive diagnosis models, and Bayesian networks are explored from the resulting perspective. Ideal for specialists in these areas, graduate students, developers, and scholars in both educational measurement and fields that contribute to a sociocognitive perspective, this book consolidates nearly a decade of research into a fresh perspective on educational measurement.

Test Fairness in the New Generation of Large?Scale Assessment

Author : Hong Jiao,Robert W. Lissitz
Publisher : IAP
Page : 239 pages
File Size : 46,7 Mb
Release : 2017-06-01
Category : Education
ISBN : 9781681238951

Get Book

Test Fairness in the New Generation of Large?Scale Assessment by Hong Jiao,Robert W. Lissitz Pdf

The new generation of tests is faced with new challenges. In the K?12 setting, the new learning targets are intended to assess higher?order thinking skills and prepare students to be ready for college and career and to keep American students competitive with their international peers. In addition, the new generation of state tests requires the use of technology in item delivery and embedding assessment in real?world, authentic, situations. It further requires accurate assessment of students at all ability levels. One of the most important questions is how to maintain test fairness in the new assessments with technology innovative items and technology delivered tests. In the traditional testing programs such as licensure and certification tests and college admission tests, test fairness has constantly been a key psychometric issue in test development and this continues to be the case with the national testing programs. As test fairness needs to be addressed throughout the whole process of test development, experts from state, admission, and licensure tests will address test fairness challenges in the new generation assessment. The book chapters clarify misconceptions of test fairness including the use of admission test results in cohort comparison, the use of international assessment results in trend evaluation, whether standardization and fairness necessarily mean uniformity when test?takers have different cultural backgrounds, and whether standardization can insure fairness. More technically, chapters also address issues related to how compromised items and test fairness are related to classification decisions, how accessibility in item development and accommodation could be mingled with technology, how to assess special populations with dyslexia, using Blinder?Oaxaca Decomposition for differential item functioning detection, and differential feature functioning in automated scoring. Overall, this book addresses test fairness issues in state assessment, college admission testing, international assessment, and licensure tests. Fairness is discussed in the context of culture and special populations. Further, fairness related to performance assessment and automated scoring is a focus as well. This book provides a very good source of information related to test fairness issues in test development in the new generation of assessment where technology is highly involved.

The Routledge International Handbook of Automated Essay Evaluation

Author : Mark D. Shermis,Joshua Wilson
Publisher : Taylor & Francis
Page : 647 pages
File Size : 53,8 Mb
Release : 2024-06-27
Category : Psychology
ISBN : 9781040033241

Get Book

The Routledge International Handbook of Automated Essay Evaluation by Mark D. Shermis,Joshua Wilson Pdf

The Routledge International Handbook of Automated Essay Evaluation (AEE) is a definitive guide at the intersection of automation, artificial intelligence, and education. This volume encapsulates the ongoing advancement of AEE, reflecting its application in both large-scale and classroom-based assessments to support teaching and learning endeavors. It presents a comprehensive overview of AEE's current applications, including its extension into reading, speech, mathematics, and writing research; modern automated feedback systems; critical issues in automated evaluation such as psychometrics, fairness, bias, transparency, and validity; and the technological innovations that fuel current and future developments in this field. As AEE approaches a tipping point of global implementation, this Handbook stands as an essential resource, advocating for the conscientious adoption of AEE tools to enhance educational practices ethically. The Handbook will benefit readers by equipping them with the knowledge to thoughtfully integrate AEE, thereby enriching educational assessment, teaching, and learning worldwide. Aimed at researchers, educators, AEE developers, and policymakers, the Handbook is poised not only to chart the current landscape but also to stimulate scholarly discourse, define and inform best practices, and propel and guide future innovations.

Advancements in Technology-Based Assessment: Emerging Item Formats, Test Designs, and Data Sources

Author : Frank Goldhammer,Ronny Scherer,Samuel Greiff
Publisher : Frontiers Media SA
Page : 275 pages
File Size : 48,5 Mb
Release : 2020-02-20
Category : Electronic
ISBN : 9782889635061

Get Book

Advancements in Technology-Based Assessment: Emerging Item Formats, Test Designs, and Data Sources by Frank Goldhammer,Ronny Scherer,Samuel Greiff Pdf

This eBook is a collection of articles from a Frontiers Research Topic. Frontiers Research Topics are very popular trademarks of the Frontiers Journals Series: they are collections of at least ten articles, all centered on a particular subject. With their unique mix of varied contributions from Original Research to Review Articles, Frontiers Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author by contacting the Frontiers Editorial Office: frontiersin.org/about/contact.

Innovative Psychometric Modeling and Methods

Author : Hong Jiao,Robert W. Lissitz
Publisher : IAP
Page : 236 pages
File Size : 43,6 Mb
Release : 2020-09-01
Category : Education
ISBN : 9781648022241

Get Book

Innovative Psychometric Modeling and Methods by Hong Jiao,Robert W. Lissitz Pdf

The general theme of this book is to present innovative psychometric modeling and methods. In particular, this book includes research and successful examples of modeling techniques for new data sources from digital assessments, such as eye-tracking data, hint uses, and process data from game-based assessments. In addition, innovative psychometric modeling approaches, such as graphical models, item tree models, network analysis, and cognitive diagnostic models, are included. Chapters 1, 2, 4 and 6 are about psychometric models and methods for learning analytics. The first two chapters focus on advanced cognitive diagnostic models for tracking learning and the improvement of attribute classification accuracy. Chapter 4 demonstrates the use of network analysis for learning analytics. Chapter 6 introduces the conjunctive root causes model for the understanding of prerequisite skills in learning. Chapters 3, 5, 8, 9 are about innovative psychometric techniques to model process data. Specifically, Chapters 3 and 5 illustrate the usage of generalized linear mixed effect models and item tree models to analyze eye-tracking data. Chapter 8 discusses the modeling approach of hint uses and response accuracy in learning environment. Chapter 9 demonstrates the identification of observable outcomes in the game-based assessments. Chapters 7 and 10 introduce innovative latent variable modeling approaches, including the graphical and generalized linear model approach and the dynamic modeling approach. In summary, the book includes theoretical, methodological, and applied research and practices that serve as the foundation for future development. These chapters provide illustrations of efforts to model and analyze multiple data sources from digital assessments. When computer-based assessments are emerging and evolving, it is important that researchers can expand and improve the methods for modeling and analyzing new data sources. This book provides a useful resource to researchers who are interested in the development of psychometric methods to solve issues in this digital assessment age.