Validation of newly developed tasks for the assessment of generic Critical Online Reasoning (COR) of university students and graduates

Publikationstyp:
Zeitschriftenaufsatz
Metadaten:
Abstract
<jats:p>In recent decades, the acquisition of information has evolved substantially and fundamentally affects students’ use of information, so that the Internet has become one of the most important sources of information for learning. However, learning with freely accessible online resources also poses challenges, such as vast amounts of partially unstructured, untrustworthy, or biased information. To successfully learn by using the Internet, students therefore require specific skills for selecting, processing, and evaluating the online information, e.g., to distinguish trustworthy from distorted or biased information and for judging its relevance with regard to the topic and task at hand. Despite the central importance of these skills, their assessment in higher education is still an emerging field. In this paper, we present the newly defined theoretical-conceptual framework Critical Online Reasoning (COR). Based on this framework, a corresponding performance assessment, Critical Online Reasoning Assessment (CORA), was newly developed and underwent first steps of validation in accordance with the Standards for Educational and Psychological Testing. We first provide an overview of the previous validation results and then expand them by including further analyses of the validity aspects “internal test structure” and “relations with other variables”. To investigate the internal test structure, we conducted variance component analyses based on the generalizability theory with a sample of 125 students and investigated the relations with other variables by means of correlation analyses. The results show correlations with external criteria as expected and confirm that the CORA scores reflect the different test performances of the participants and are not significantly biased by modalities of the assessment. With these new analyses, this study substantially contributes to previous research by providing comprehensive evidence for the validity of this new performance assessment that validly assesses the complex multifaceted construct of critical online reasoning among university students and graduates. CORA results provide unique insights into the interplay between features of online information acquisition and processing, learning environments, and the cognitive and metacognitive requirements for critically reasoning from online information in university students and young professionals.</jats:p>
Autoren
  • Marie-Theres Nagel
  • Olga Zlatkin-Troitschanskaia
  • Jennifer Fischer
DOI
10.3389/feduc.2022.914857
eISSN
2504-284X
Zeitschrift
Frontiers in Education
Online publication date
2022
Status
Published online
Herausgeber
Frontiers Media SA
Herausgeber URL
http://dx.doi.org/10.3389/feduc.2022.914857
Datum der Datenerfassung
2022
Titel
Validation of newly developed tasks for the assessment of generic Critical Online Reasoning (COR) of university students and graduates
Ausgabe der Zeitschrift
7

Datenquelle: Crossref

Andere Metadatenquellen:
Author's licence
CC-BY
Autoren
  • Marie-Theres Nagel
  • Olga Zlatkin-Troitschanskaia
  • Jennifer Fischer
Hosting institution
Universitätsbibliothek Mainz
Sammlungen
  • DFG-491381577-G
Resource version
Published version
DOI
10.3389/feduc.2022.914857
Funding acknowledgements
  • Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - Projektnummer 491381577
File(s) embargoed
false
Open access
true
ISSN
2504-284X
Zeitschrift
Frontiers in education
Schlüsselwörter
  • 370 Erziehung
  • 370 Education
Sprache
eng
Open access status
Open Access
Paginierung
914857
Datum der Veröffentlichung
2022
Public URL
https://openscience.ub.uni-mainz.de/handle/20.500.12030/8458
Herausgeber
Frontiers Media
Herausgeber URL
https://www.frontiersin.org/articles/10.3389/feduc.2022.914857/full
Datum der Datenerfassung
2022
Datum, an dem der Datensatz öffentlich gemacht wurde
2022
Zugang
Public
Titel
Validation of newly developed tasks for the assessment of generic Critical Online Reasoning (COR) of university students and graduates
Ausgabe der Zeitschrift
7

Files

validation_of_newly_developed-20221129164836112.pdf

Datenquelle: OPENSCIENCE.UB

Beziehungen:
Eigentum von

Werkzeuge