Source author record

Edit Yerushalmi

Edit Yerushalmi appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

12works
1topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2021arXiv

The challenges of changing teaching assistants' grading practices: Requiring students to show evidence of understanding

Teaching assistants (TAs) are often responsible for grading in introductory physics courses at large research universities. Their grading practices can shape students' approaches to problem solving and learning. Physics education research recommends grading practices that encourage students to provide evidence of understanding via explication of the problem-solving process. However, TAs may not necessarily grade in a manner that encourages students to provide evidence of understanding in their solutions. Within the context of a semester-long TA professional development course, we investigated whether encouraging TAs to use a grading rubric that appropriately weights the problem-solving process and having them reflect upon the benefits of using such a rubric prompts TAs to require evidence of understanding in student solutions. We examined how the TAs graded realistic student solutions to introductory physics problems before they were provided a rubric, whether TAs used the rubric as intended, whether they were consistent in grading similar solutions, and how TAs' grading criteria changed after discussing the benefits of a well-designed rubric. We find that many TAs typically applied the rubric consistently when grading similar student solutions but did not require students to provide evidence of understanding. TAs' written responses, class discussions, and individual interviews suggest that the instructional activities involving the grading rubrics in this study were not sufficient to change their grading practices. Interviews and class discussions suggest that helping TAs value a rubric that appropriately weights the problem-solving process may be challenging partly due to the TAs past educational experiences and the departmental context.

preprint2016arXiv

Effect of Self Diagnosis on Subsequent Problem Solving Performance

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. The recitation classes in an introductory physics class (~200 students) were split into a control group and three experimental groups in which different levels of guidance was provided for performing the self-diagnosis activities. We have been a) investigating how students in each group performed on subsequent near and far transfer questions given as part of the exams; and b) comparing student's initial scores on their quizzes with their performance on the exams, as well as comparing student's self-diagnosis scores with their performance on the exams. We discuss some hypotheses about the students' ability to self-diagnose with different levels of scaffolding support and emphasize the importance of teaching students how to diagnosis their own mistakes. Our findings suggest that struggling with minimal support during in-class self-diagnosis can trigger out-of-class self-diagnosis. Students therefore may be motivated to make sense of the problem they may have not been able to self diagnose, whether independently or in a collaborative effort.

preprint2016arXiv

Grading Practices and Considerations of Graduate Students at the Beginning of their Teaching Assignment

Research shows that expert-like approaches to problem-solving can be promoted by encouraging students to explicate their thought processes and follow a prescribed problem-solving strategy. Since grading communicates instructors' expectations, teaching assistants' grading decisions play a crucial role in forming students' approaches to problem-solving in physics. We investigated the grading practices and considerations of 43 graduate teaching assistants (TAs). The TAs were asked to grade a set of specially designed student solutions and explain their grading decisions. We found that in a quiz context, a majority of TAs noticed but did not grade on solution features which promote expert-like approaches to problem-solving. In addition, TAs graded differently in quiz and homework contexts, partly because of how they considered time limitations in a quiz. Our findings can inform professional development programs for TAs.

preprint2016arXiv

Identifying Differences In Diagnostic Skills Between Physics Students: Developing A Rubric

Expert problem solvers are characterized by continuous evaluation of their progress towards a solution. One characteristic of expertise is self-diagnosis directed towards elaboration of the solvers' conceptual understanding, knowledge organization or strategic approach. "Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating how introductory physics students perform in such tasks. Developing a robust rubric is essential for objective evaluation of students' self-diagnosis skills. We discuss the development of a grading rubric that takes into account introductory physics students' content knowledge as well as analysis, planning and presentation skills. Using this rubric, we have found the inter-rater reliability to be better than 80%. The rubric can easily be adapted to other problems, as will be discussed in a companion paper.

preprint2016arXiv

Identifying Differences in Diagnostic Skills between Physics Students: Students' Self-Diagnostic Performance Given Alternative Scaffolding

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating the extent to which introductory physics students can diagnose their own mistakes when explicitly asked to do so with different levels of scaffolding support provided to them. In our study in an introductory physics class with more than 200 students, the recitation classes were split into three different experimental groups in which different levels of guidance were provided for performing the self-diagnosis activities. We present our findings that students' performance was far from perfect. However, differences in the scaffolding in the three experimental groups (i.e. providing a correct solution and a self-diagnosis rubric) noticeably affected the resulting diagnosis.

preprint2016arXiv

Instructional Goals and Grading Practices of Graduate Students after One Semester of Teaching Experience

Teaching assistants (TAs) are often responsible for grading student solutions. Since grading communicates instructors' expectations, TAs' grading decisions play a crucial role in forming students' approaches to problem solving (PS) in physics. We investigated the change in grading practices and considerations of 18 first-year graduate students participating in a TA professional development (PD) course. The TAs were asked to state their beliefs about the purpose of grading, to grade a set of specially designed student solutions, and to explain their grading decisions. We found that after one semester of teaching experience and participation in PD, TAs did not significantly change their goals for grading (i.e., a learning opportunity for both the student and the instructor) or their grading practice. In addition, TAs' grading practice frequently did not align with their goals. However, some TAs' perceptions of the level of explication required in a student solution did change. Our findings suggest that in order for PD to help TAs better coordinate their goals with appropriate grading practices, PD should focus on TAs' perception of sufficient reasoning in student solutions.

preprint2016arXiv

Learning from mistakes: The effect of students' written self-diagnoses on subsequent problem solving

Helping students learn to think like a physicist is an important goal of many introductory physics courses. One characteristic distinguishing more experienced physicists from novice students is that they make better use of problem solving as a learning opportunity. Experts were found to spend more time than novices in monitoring their work, reflecting upon their possibly deficient approach to solving a problem, reconsidering their choices as necessary, and extending and refining their knowledge structure. Moreover, research on worked-out examples suggests that better performing students are those who self-explain, that is, elaborate to themselves what they are learning from those examples, generate inferences, acknowledge mismatches between their own approach and that of the example, and attempt to resolve conflicts (self-repair). Indeed, physics instructors often express concern that many students do not make an effort to learn from their mistakes after the graded problems are returned to them. Here, we discuss an investigation focusing on how well introductory physics students self-diagnose their mistakes in their quiz solutions and its effect on subsequent problem solving in different interventions.

preprint2016arXiv

Self-Diagnosis, Scaffolding and Transfer in a More Conventional Introductory Physics Problem

Previously we discussed how well students in an introductory physics course diagnosed their mistakes on a quiz problem with different levels of scaffolding support. In that case, the problem they self-diagnosed was unusually difficult. We also discussed issues related to transfer, particularly the fact that the transfer problem in the midterm that corresponded to the self-diagnosed problem was a far transfer problem. Here, we discuss a related intervention in which we repeated the study methodology with the same students in the same intervention groups, using a new quiz problem which was more typical for these students and a near transfer problem. We discuss how these changes affected students' ability to self-diagnose and transfer from the self-diagnosed quiz problem to a transfer problem on the midterm exam.

preprint2016arXiv

Self-Diagnosis, Scaffolding and Transfer: A Tale of Two Problems

Helping students learn from their own mistakes can help them develop habits of mind while learning physics content. Based upon cognitive apprenticeship model, we asked students to self-diagnose their mistakes and learn from reflecting on their problem solution. Varying levels of scaffolding support were provided to students in different groups to diagnose their errors on two context-rich problems that students originally solved in recitation quizzes. Here, we discuss students' cognitive engagement in the two self-diagnosis activities and transfer tasks with different scaffolds.

preprint2016arXiv

TA-designed vs. research-oriented problem solutions

In order to study graduate teaching assistants (TAs) beliefs and values about the design of instructor problem solutions, twenty-four TAs were provided with different solutions and asked to discuss their preferences for prominent solution features. TAs preferences for solution features were examined in light of the modeling of expert-like problem solving process as recommended in the literature. Results suggest that while many of the features TAs valued align with expert-like problem solving approaches, they noticed primarily "surface features" of solutions. Moreover, self-reported preferences did not match well with the solutions TAs wrote on their own.

preprint2016arXiv

Teaching assistants' beliefs regarding example solutions in introductory physics

As part of a larger study to understand instructors' considerations regarding the learning and teaching of problem solving in an introductory physics course, we investigated beliefs of first-year graduate teaching assistants (TAs) regarding the use of example solutions in introductory physics. In particular, we examine how the goal of promoting expert-like problem solving is manifested in the considerations of graduate TAs choices of example solutions. Twenty-four first-year graduate TAs were asked to discuss their goals for presenting example solutions to students. They were also provided with different example solutions and asked to discuss their preferences for prominent solution features. TAs' awareness, preferences and actual practices related to solution features were examined in light of recommendations from the literature for the modeling of expert-like problem solving approaches. The study concludes that the goal of helping students develop an expert-like problem solving approach underlies many TAs' considerations for the use of example solutions. TAs, however, do not notice and do not use many features described in the research literature as supportive of this goal. A possible explanation for this gap between their belief and practices is that these features conflict with another powerful set of values concerned with keeping students engaged, setting adequate standards, as well as pragmatic considerations such as time requirements and the assignment of grades.

preprint2016arXiv

The group administered interactive questionnaire: An alternative to individual interviews

Individual interviews are often considered to be the gold standard for researchers to understand how people think about phenomena. However, conducting and analyzing interviews is very time consuming. This paper presents the Group Administered Interactive Questionnaire (GAIQ) as an alternative to individual interviews and discusses the pros and cons of each data collection method. Use of GAIQ will be discussed in the context of a study that seeks to understand teaching assistants' reasons for the design of problem solutions for introductory physics.