DeustoTeka Examinando por Autor "Panadero, Ernesto"

Examinando por Autor "Panadero, Ernesto"

Mostrando 1 - 10 de 10

Analysis of online rubric platforms: advancing toward erubrics
(Routledge, 2025) Panadero, Ernesto; Fernández Ortube, Alazne; Krebs, Rebecca; Roelle, Julian
Rubrics play a crucial role in shaping educational assessment, providing clear criteria for both teaching and learning. The advent of online rubric platforms has the potential to significantly enhance the effectiveness of rubrics in educational contexts, offering innovative features for assessment and feedback through the creation of erubrics. This study presents a comprehensive analysis of 19 online rubric platforms structured around five research questions (RQs) examining the general platform features, rubric design features, rubric implementation features, identifying the stronger online rubric platforms available, and investigating if the platforms support the creation and implementation of erubrics. Our analysis of the design features revealed varying levels of customisation and flexibility across platforms, crucial for effective assessment. Regarding implementation features, we found a mix of online and offline capabilities, with a limited number of platforms offering more advanced features (e.g. collaborative options). Through a detailed scoring system, we identify the platforms that lead innovation in design and implementation. Unfortunately, the vast majority of platforms do not support features for the creation of erubrics. We provide a detailed list of implementation recommendations for teachers, researchers, and platform designers (Appendix F)
Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: a meta-analytic review
(Springer, 2023-12-07) Panadero, Ernesto; Jonsson, Anders; Pinedo Castillo, Leire ; Fernández Castilla, Belén
Rubrics are widely used as instructional and learning instrument. Though they have been claimed to have positive effects on students’ learning, these effects have not been meta-analyzed. Our aim was to synthesize the effects of rubrics on academic performance, self-regulated learning, and self-efficacy. The moderator effect of the following variables was also investigated: year of publication, gender, mean age, educational level, type of educational level (compulsory vs. higher education), number of sessions, number of assessment criteria, number of performance levels, use of self and peer assessment, research design, and empirical quality of the study. Standardized mean differences (for the three outcomes) and standardized mean changes (SMC; for academic performance) were calculated from the retrieved studies. After correcting for publication bias, a moderate and positive effect was found in favor of rubrics on academic performance (g = 0.45, k = 21, m = 54, 95% CI [0.312, 0.831]; SMC = 0.38, 95% CI [0.02, 0.75], k = 12, m = 30), whereas a small pooled effect was observed for self-regulated learning (g = 0.23, k = 5, m = 17, 95% CI [-0.15, 0.60]) and for self-efficacy (g = 0.18, k = 3, m = 5, 95% CI [-0.81, 0.91]). Most of the moderator variables were not significant. Importantly, to improve the quality of future reports on the effects of rubrics, we provide an instrument to be filled out for rubric scholars in forthcoming studies.
How dominant language influences rubric reading and task performance: insights from eye-tracking research
(Springer Science and Business Media B.V., 2025-06) Panadero, Ernesto; Delgado, Pablo; Barrenetxea Mínguez, Lucía; Zamorano Sande, David; Pinedo Castillo, Leire; Fernández Ortube, Alazne
The students’ dominant language might influence how they use and process a rubric and its subsequent effect on task performance. However, our knowledge about these effects is limited. This study investigates how the dominant language of students is associated with their rubric reading patterns and their task performance in a written landscape analysis in Spanish. Participants were 80 higher education students with different dominant language (Spanish-dominant speakers, SDS; Basque-Spanish speakers, BSS) from six undergraduate programmes. We employed a randomized controlled trial in which participants used a rubric to guide their performance in a written analysis of a landscape. Participants were randomly assigned to two conditions based on the rubric order: (1) lowest to highest performance level vs (2) highest to lowest performance level. We analyzed eye-tracking data to explore reading patterns (i.e., fixation times on the rubric cells and gaze transitions between the rubric and the picture of the landscape), task performance (i.e., written landscape analysis), and self-reported cognitive load. Spanish-dominant speakers exhibited more adaptive reading patterns and performed better in the written landscape analysis with the highest-lowest performance level (PL) order rubric, compared to Basque-Spanish speakers. Additionally, fixation time on highest PL and gaze transitions between highest PL and the landscape picture were positively correlated with task performance. Our research highlights the importance of considering dominant language in rubric design and implementation, showing that strategic rubric design can enhance student performance, particularly in linguistically diverse educational settings
Impact of displaying grades vs. not displaying grades on academic performance and emotional outcomes while delivering feedback comments: a longitudinal study
(Routledge, 2025) Panadero, Ernesto; Sánchez Iglesias, Iván
This study investigates the impact of displaying grades versus not displaying grades on student performance and emotions in secondary education, while keeping feedback comments constant. Using a longitudinal design, we examined intra-individual changes in performance and emotional responses among 99 students across four classroom groups as they experienced phases of grade display and non-display. Contrary to the notion of grades solely as detrimental, our findings reveal a complex relationship. Initially, grade display decreased performance and evoked negative emotions, but these effects dissipated over time, suggesting student adaptation. Our study highlights the significant impact of feedback comments, suggesting their importance independent of grades. These results call for a sophisticated understanding of grading practices, emphasizing longitudinal research to capture the evolving effects of grades and feedback. Practical implications for educators include maintaining stable grading practices and providing preparatory guidance to mitigate initial negative impacts, contributing to optimizing educational assessment strategies
A self-feedback model (SEFEMO): secondary and higher education students’ self-assessment profiles
(Routledge, 2024) Panadero, Ernesto; Fernández Ruiz, Javier; Pinedo Castillo, Leire; Sánchez Iglesias, Iván; García-Pérez, Daniel
While self-assessment is a widely explored area in educational research, our understanding of how students assess themselves, or in other words, generate self-feedback, is quite limited. Self-assessment process has been a black box that recent research is trying to open. This study explored and integrated two data collections (secondary and higher education) that investigated students’ real actions while self-assessing, aiming to disentangle self-assessment into more precise actions. Our goal was to identify self-assessment processes and profiles to better understand what happens when students self-assess and to design and implement better interventions. By combining such data, we were able to explore the differences between secondary and higher education students, the effects of external feedback on self-assessment, and to propose a model of ideal self-assessment (SEFEMO). Using think-aloud protocols, direct observation and self-reported data, we identified six main actions (read, recall, compare, rate, assess, and redo) and four self-assessment profiles. In general, secondary and higher education students showed the same actions and very similar profiles. External feedback had a negative effect on the self-assessment actions except for the less advanced self-assessors. Based on data from more than 500 self-assessment performances, we propose a model of self-feedback.
Self-regulated learning interventions for pre-service teachers: a systematic review
(Springer, 2024-09-30) Fernández Ortube, Alazne; Panadero, Ernesto; Dignath, Charlotte
Self-regulated learning (SRL) is a key competence for pre-service teachers to develop, both for their own activities as learners and for their future activities as teachers. Therefore, it is crucial to understand how pre-service teachers can be supported in acquiring SRL competence in their initial training. To reach this aim, we conducted a systematic review of SRL interventions for pre-service teachers. Sixty-six intervention studies fulfilled the inclusion criteria. We explored three aspects of those SRL interventions, and how they moderate the interventions’ effectiveness: (1) the theoretical and practical underpinnings of SRL, (2) whether the intervention aimed to promote SRL learning and/or teaching of SRL, and (3) the intervention’s pedagogical characteristics and content related to the SRL professional competences. We found that the most effective SRL interventions (1) focused the training on one or two SRL areas (especially cognition and metacognition); (2) when targeted both, SRL learning and teaching of SRL, pre-service teachers’ SRL skills improved as well as their pedagogical skills; and (3) addressed direct and implicit SRL instruction, inside which self-assessment of learning and teaching practices appear as an effective pedagogical method. We derive implications from our findings for designing effective SRL interventions for prospective teachers.
The self-regulation for learning online (SRL-O) questionnaire
(Springer, 2023-04) Broadbent, Jaclyn; Panadero, Ernesto; Lodge, J.M.; Fuller-Tyszkiewicz, M.
The Self-Regulation for Learning Online (SRL-O) questionnaire was developed to encompass the breadth of motivational beliefs and learning strategies that are often used in online and/or blended learning contexts. No current measure meets all these needs. This study used two non-duplicate samples to provide evidence of the psychometric properties of SRL-O using exploratory factor analyses (sample 1, n = 313), and confirmatory factor analyses, convergent and content validity and reliability (sample 2, n = 321). The SRL-O has a 10-factor structure, made up of (1) online self-efficacy, (2) online intrinsic motivation, (3) online extrinsic motivation, (4) online negative achievement emotion, (5) planning and time management, (6) metacognition, (7) study environment, (8) online effort regulation, (9) online social support, and (10) online task strategies. The SRL-O was also found to have two superordinate factors (motivational beliefs and learning strategies). The SRL-O was demonstrated to be a psychometrically sound measure of online SRL for learners studying in online and blended learning contexts. There is no other online self-regulated learning questionnaire that currently covers such a wide range of motivational beliefs and learning strategies.
Shaping the assessors of tomorrow: how practicum experiences develop assessment literacy in secondary education pre-service teachers
(Elsevier Ltd, 2024-12) Pardo García, Rodrigo; García-Pérez, Daniel; Panadero, Ernesto
This study analyzes the impact of the supervised practicum on the assessment conceptions and practices of pre-service secondary education teachers, using the theoretical rationale of assessment literacy. We conducted a qualitative study with eighteen pre-service physical education teachers in Spain. The results revealed the difficulties and the variety of experiences the participants encountered during the practicum in relation to assessment. Student accountability and improving learning and teaching were the most common assessment conceptions, although the assessment tasks designed by the participants were not entirely formative. In general, the practicum experience reaffirmed their previous ideas on formative assessment.
Teachers’ well-being, emotions, and motivation during emergency remote teaching due to COVID-19
(Frontiers Media S.A., 2022-03-28) Panadero, Ernesto; Fraile Ruiz, Juan; Pinedo Castillo, Leire; Rodríguez Hernández, Carlos Felipe; Balerdi Eizmendi, Eneko; Díez Ruiz, Fernando
This study explores the effects of the shift to emergency remote teaching (ERT) on teachers’ levels of well-being, emotions, and motivation. A total of 936 Spanish teachers participated in this nationwide survey from all educational levels, thus allowing comparison among levels, which is a novelty and strength of our study. Four aspects were explored: (1) instructional adaptation to ERT; (2) well-being changes and the main challenges in this regard; (3) changes in emotions; and (4) changes in motivation and the main factors. Importantly, we explored a number of teacher characteristics (e.g., gender, age) for the three last aspects. Our results show that teachers felt the impact of ERT on their well-being, emotions, and motivation. Additionally, female teachers, teachers with students of low socioeconomic status (SES), in public schools, and primary and secondary teachers were the most affected groups. This indicates that the impact of ERT differed and some populations of teachers are more at risk of suffering burnout because of ERT.
University students’ strategies and criteria during self-assessment: instructor’s feedback, rubrics, and year level effects
(Springer Science and Business Media B.V., 2023-09) Panadero, Ernesto; García-Pérez, Daniel; Fernández-Ruiz, Javier; Fraile, Juan; Sánchez Iglesias, Iván; Brown, Gavin T. L.
This study explores the effects of feedback type, feedback occasion, and year level on student self-assessments in higher education. In total, 126 university students participated in this randomized experiment under three experimental conditions (i.e., rubric feedback, instructor’s written feedback, and rubric feedback plus instructor’s written feedback). Participants, after random assignment to feedback condition, were video-recorded performing a self-assessment on a writing task both before and after receiving feedback. The quality of self-assessment strategies decreased after feedback of all kinds, but the number of strategies increased for the combined feedback condition. The number of self-assessment criteria increased for rubric and combined conditions, while feedback helped shift criteria use from basic to advanced criteria. Student year level was not systematically related to changes in self-assessment after feedback. In general, the combination of rubric and instructor’s feedback produced the best effects.

Examinando por Autor "Panadero, Ernesto"

Resultados por página

Opciones de ordenación