Source author record

Chandralekha Singh

Chandralekha Singh appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

136works
3topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

136 published item(s)

preprint2022arXiv

Gender Inequities Throughout STEM: Compared to Men, Women with Significantly Higher Grades Drop STEM Majors

Efforts to promote equity and inclusion using evidence-based approaches are vital to correcting long-standing societal inequities that have disadvantaged women and discouraged them from pursuing studies, including in many STEM disciplines. We used 10 years of institutional data from a large public university to investigate the grade point average trends in different STEM disciplines for men and women who declared a major and then either completed the degree or dropped the major after declaring it. We found alarming trends, such as that women who dropped majors on average earned higher grades than men, and in some STEM majors, women who dropped the majors were earning comparable grades to men who persisted in those majors. While these quantitative findings call for a deeper understanding of the reasons women and men drop a major, we provide suggestions for approaches to make learning environments more equitable and inclusive so that traditionally excluded stereotyped groups can have a higher sense of belonging and thrive.

preprint2022arXiv

Reflections on the Fifth International Conference on Women in Physics

This article describes reflections on the Fifth International Conference on Women in Physics which was a conference attended by 215 female physicists and a few male physicists from 49 different countries. The article focuses on the barriers that women face in their professional advancement in physics and the extent to which the situation is different in various countries.

preprint2022arXiv

Students' attitudes toward experimental physics in a conceptual inquiry-based introductory physics lab

There is some evidence that conceptual inquiry-based introductory physics lab curricula, such as RealTime Physics, may improve students' understanding of physics concepts. Thus, these curricula may be attractive for instructors who seek to transform their physics labs to improve student learning. However, the impact of conceptual inquiry-based lab instruction on students' attitudes and beliefs about experimental physics, as measured by the E-CLASS survey, is not yet fully understood. We present data from three curricular approaches over four semesters ($n=701$). We saw no change in E-CLASS scores in the first implementation of a conceptual inquiry-based introductory physics lab. However, the addition of questions that asked students to reflect on issues relating to experimental physics was associated with E-CLASS outcomes that are comparable to other effective approaches to lab instruction.

preprint2021arXiv

A longitudinal analysis of students' motivational characteristics in introductory physics courses: Gender differences

The lack of diversity and the under-performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under-representation and under-performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors: 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students' environments. While there has been much research on factor 1 (characteristics of instruction and learning tools), there has been less focus on factor 2 (students' characteristics, and in particular, motivational factors). Here, we focus on the baseline motivational characteristics of introductory physics students obtained from survey data to inform factor 2 of the framework. A longitudinal analysis of students' motivational characteristics in two-semester introductory physics courses was performed by administering pre- and post-surveys that evaluated students' self-efficacy, grit, fascination with physics, value associated with physics, intelligence mindset, and physics epistemology. Female students reported lower self-efficacy, fascination and value, and had a more "fixed" view of intelligence in the context of physics compared to male students. Grit was the only factor on which female students reported averages that were equal to or higher than male students throughout introductory physics courses. These gender differences can at least partly be attributed to the societal stereotypes and biases about who belongs in physics and can excel in it. The findings inform the framework and have implications for the development and implementation of effective pedagogies and learning tools to help all students learn.

preprint2021arXiv

Building a Quantum Engineering Undergraduate Program

The rapidly growing quantum information science and engineering (QISE) industry will require both quantum-aware and quantum-proficient engineers at the bachelor's level. We provide a roadmap for building a quantum engineering education program to satisfy this need. For quantum-aware engineers, we describe how to design a first quantum engineering course accessible to all STEM students. For the education and training of quantum-proficient engineers, we detail both a quantum engineering minor accessible to all STEM majors, and a quantum track directly integrated into individual engineering majors. We propose that such programs typically require only three or four newly developed courses that complement existing engineering and science classes available on most larger campuses. We describe a conceptual quantum information science course for implementation at any post-secondary institution, including community colleges and military schools. QISE presents extraordinary opportunities to work towards rectifying issues of inclusivity and equity that continue to be pervasive within engineering. We present a plan to do so and describe how quantum engineering education presents an excellent set of education research opportunities. Finally, we outline a hands-on training plan on quantum hardware, a key component of any quantum engineering program, with a variety of technologies including optics, atoms and ions, cryogenic and solid-state technologies, nanofabrication, and control and readout electronics. Our recommendations provide a flexible framework that can be tailored for academic institutions ranging from teaching and undergraduate-focused two- and four-year colleges to research-intensive universities.

preprint2021arXiv

Development and Validation of a conceptual survey instrument to evaluate introductory physics students' understanding of thermodynamics

We discuss the development and validation of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws (STPFaSL) suitable for introductory physics courses. The survey instrument uses common student difficulties with these concepts as resources in that the incorrect answers to the multiple-choice questions were guided by them. After the development and validation of the survey instrument, the final version was administered at six different institutions. It was administered to introductory physics students in various traditionally taught calculus-based and algebra-based classes in paper-pencil format before and after traditional lecture-based instruction in relevant concepts. We also administered the survey instrument to upper-level undergraduates majoring in physics and Ph.D. students for bench marking and for content validity and compared their performance with those of introductory students for whom the survey is intended. We find that although the survey instrument focuses on thermodynamics concepts covered in introductory courses, it is challenging even for advanced students. A comparison with the base line data on the validated survey instrument presented here can help instructors evaluate the effectiveness of innovative pedagogies designed to help students develop a solid grasp of these concepts.

preprint2021arXiv

The challenges of changing teaching assistants' grading practices: Requiring students to show evidence of understanding

Teaching assistants (TAs) are often responsible for grading in introductory physics courses at large research universities. Their grading practices can shape students' approaches to problem solving and learning. Physics education research recommends grading practices that encourage students to provide evidence of understanding via explication of the problem-solving process. However, TAs may not necessarily grade in a manner that encourages students to provide evidence of understanding in their solutions. Within the context of a semester-long TA professional development course, we investigated whether encouraging TAs to use a grading rubric that appropriately weights the problem-solving process and having them reflect upon the benefits of using such a rubric prompts TAs to require evidence of understanding in student solutions. We examined how the TAs graded realistic student solutions to introductory physics problems before they were provided a rubric, whether TAs used the rubric as intended, whether they were consistent in grading similar solutions, and how TAs' grading criteria changed after discussing the benefits of a well-designed rubric. We find that many TAs typically applied the rubric consistently when grading similar student solutions but did not require students to provide evidence of understanding. TAs' written responses, class discussions, and individual interviews suggest that the instructional activities involving the grading rubrics in this study were not sufficient to change their grading practices. Interviews and class discussions suggest that helping TAs value a rubric that appropriately weights the problem-solving process may be challenging partly due to the TAs past educational experiences and the departmental context.

preprint2021arXiv

Toward more accurate measurement of the impact of online instructional design on students' ability to transfer physics problem-solving skills

In two earlier studies, we developed a new method to measure students' ability to transfer physics problem solving skills to new contexts using a sequence of online learning modules, and implemented two interventions in the form of additional learning modules designed to improve transfer ability. The current paper introduces a new data analysis scheme that could improve the accuracy of the measurement by accounting for possible differences in students' goal orientation and behavior, as well as revealing the possible mechanism by which one of the two interventions improves transfer ability. Based on a two by two framework of self-regulated learning, students with a performance-avoidance oriented goal are more likely to guess on some of the assessment attempts in order to save time, resulting in an underestimation of the student populations' transfer ability. The current analysis shows that about half of the students had frequent brief initial assessment attempts, and significantly lower correct rates on certain modules, which we think is likely to have originated at least in part from students adopting a performance-avoidance strategy. We then divided the remaining population, for which we can be certain that few students adopted a performance-avoidance strategy, based on whether they interacted with one of the intervention modules designed to develop basic problem solving skills, or passed that module on their first attempt without interacting with the instructional material. By comparing to propensity score matched populations from a previous semester, we found that the improvement in subsequent transfer performance observed in a previous study mainly came from the latter population, suggesting that the intervention served as an effective reminder for students to activate existing skills, but fell short of developing those skills among those who have yet to master it.

preprint2020arXiv

A mismatch between self-efficacy and performance: Undergraduate women in engineering tend to have lower self-efficacy despite earning higher grades than men

There is a significant underrepresentation of women in many Science, Technology, Engineering, and Mathematics (STEM) majors and careers. Prior research has shown that self-efficacy can be a critical factor in student learning, and that there is a tendency for women to have lower self-efficacy than men in STEM disciplines. This study investigates gender differences in the relationship between engineering students' self-efficacy and course grades in foundational courses. By focusing on engineering students, we examined these gender differences simultaneously in four STEM disciplines (mathematics, engineering, physics, and chemistry) among the same population. Using survey data collected longitudinally at three time points and course grade data from five cohorts of engineering students at a large US-based research university, effect sizes of gender differences are calculated using Cohen's d on two measures: responses to survey items on discipline-specific self-efficacy and course grades in all first-year foundational courses and second-year mathematics courses. In engineering, physics, and mathematics courses, we find sizeable discrepancies between self-efficacy and performance, with men appearing significantly more confident than women despite small or reverse direction differences in grades. In chemistry, women earn higher grades and have higher self-efficacy. The patterns are consistent across courses within each discipline. All self-efficacy gender differences close by the fourth year except physics self-efficacy. The disconnect between self-efficacy and course grades across subjects provides useful clues for targeted interventions to promote equitable learning environments. The most extreme disconnect occurs in physics and may help explain the severe underrepresentation of women in "physics-heavy" engineering disciplines, highlighting the importance of such interventions.

preprint2020arXiv

Can students apply the concept of "which-path" information learned in the context of Mach Zehnder Interferometer to the double-slit experiment?

The ability to use concepts learned in one context to solve problems in a different context (i.e., transfer of learning) is a hallmark of expertise in physics. The majority of the studies on transfer of learning in physics have focused on introductory students. However, compared to advanced students, introductory students have significantly less prior relevant knowledge and skills which may be crucial for promoting effective transfer. Here, we examine upper-level undergraduate and graduate students' ability to transfer their learning about the concept of "which-path" information and its relation to whether or not interference is observed from the context of the Mach Zehnder Interferometer (MZI) to a new context of the double-slit experiment (DSE). Students worked through a tutorial on the MZI in which they learned to use the concept of "which-path" information to reason about interference of single photons when polarizers with various orientations are placed in one or both paths of the MZI. After working on the MZI tutorial, students were asked similar questions in the isomorphic context of the DSE before any instruction about the DSE and we examined the extent to which transfer of learning about "which-path" information occurred from the MZI to the DSE context. We find evidence suggesting that positive transfer of learning from the MZI to the DSE occurred despite the lack of an instructional intervention designed to help students recognize the similarity between the two contexts. The effectiveness of the MZI tutorial in promoting positive transfer of learning from one context to another in quantum mechanics sheds light on the expertise of the advanced physics students. Instructors of advanced physics courses can take advantage of the findings presented here which shows the difference between introductory and advanced students' ability to transfer from one context to another.

preprint2020arXiv

Case of two electrostatics problems: Can providing a diagram adversely impact introductory physics students' problem solving performance?

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a problem into a representation that is easier to exploit for solving it. One major focus while helping introductory physics students learn effective problem solving is to help them understand that drawing diagrams can facilitate problem solution. We conducted an investigation in which two different interventions were implemented during recitation quizzes in a large enrollment algebra-based introductory physics course. Students were either (i) asked to solve problems in which the diagrams were drawn for them or (ii) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed rubrics to score the problem solving performance of students in different intervention groups and investigated ten problems. We found that students who were provided diagrams never performed better and actually performed worse than the other students on three problems, one involving standing sound waves in a tube (discussed elsewhere) and two problems in electricity which we focus on here. These two problems were the only problems in electricity that involved considerations of initial and final conditions, which may partly account for why students provided with diagrams performed significantly worse than students who were not provided with diagrams. In order to explore potential reasons for this finding, we conducted interviews with students and found that some students provided with diagrams may have spent less time on the conceptual analysis and planning stage of the problem solving process. In particular, those provided with the diagram were more likely to jump into the implementation stage of problem solving early without fully analyzing and understanding the problem, which can increase the likelihood of mistakes in solutions.

preprint2020arXiv

Challenges in designing appropriate scaffolding to improve students' representational consistency: The case of a Gauss's law problem

Prior research suggest that introductory physics students have difficulty with graphing and interpreting graphs. Here, we discuss an investigation of student difficulties in translating between mathematical and graphical representations for a problem in electrostatics and the effect of increasing levels of scaffolding on students' representational consistency. Students in calculus-based introductory physics were given a typical problem that can be solved using Gauss's law involving a spherically symmetric charge distribution in which they were asked to write a mathematical expression for the electric field in various regions and then plot the electric field. In study 1, we found that students had great difficulty in plotting the electric field as a function of the distance from the center of the sphere consistent with the mathematical expressions in various regions, and interviews with students suggested possible reasons which may account for this difficulty. Therefore, in study 2, we designed two scaffolding interventions with levels of support which built on each other (i.e., the second scaffolding level built on the first) in order to help students plot their expressions consistently and compared the performance of students provided with scaffolding with a comparison group which was not given any scaffolding support. Analysis of student performance with different levels of scaffolding reveals that scaffolding from an expert perspective beyond a certain level may sometimes hinder student performance and students may not even discern the relevance of the additional support. We provide possible interpretations for these findings based on in-depth, think-aloud interviews.

preprint2020arXiv

Development, validation and in-class evaluation of a sequence of clicker questions on Larmor precession of spin in quantum mechanics

Engaging students with well-designed clicker questions is one of the commonly used research-based instructional strategy in physics courses partly because it has a relatively low barrier to implementation. Moreover, validated robust sequences of clicker questions are likely to provide better scaffolding support and guidance to help students build a good knowledge structure of physics than an individual clicker question on a particular topic. Here we discuss the development, validation and in-class implementation of a clicker question sequence (CQS) for helping advanced undergraduate students learn about Larmor precession of spin, which takes advantage of the learning goals and inquiry-based guided learning sequences in a previously validated Quantum Interactive Learning Tutorial (QuILT). The in-class evaluation of the CQS using peer instruction is discussed by comparing upper-level undergraduate student performance after traditional lecture-based instruction and after engaging with the CQS.

preprint2020arXiv

Do students benefit from drawing productive diagrams themselves while solving introductory physics problems? The case of two electrostatic problems

An appropriate diagram is a required element of a solution building process in physics problem solving and it can transform a given problem into a representation that is easier to exploit for solving the problem. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solving. We conducted an investigation in which two different interventions were implemented during recitation quizzes throughout the semester in a large enrollment, algebra-based introductory physics course. Students were either (1) asked to solve problems in which the diagrams were drawn for them or (2) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed a rubric to score the problem solving performance of students in different intervention groups. We investigated two problems involving electric field and electric force and found that students who drew productive diagrams were more successful problem solvers and that a higher level of relevant detail in a student's diagram corresponded to a better score. We also conducted think-aloud interviews with nine students who were at the time taking an equivalent introductory algebra-based physics course in order to gain insight into how drawing diagrams affects the problem solving process. These interviews supported some of the interpretations of the quantitative results. We end by discussing instructional implications of the findings.

preprint2020arXiv

Effectiveness of interactive tutorials in promoting "which-path" information reasoning in advanced quantum mechanics

We have been investigating advanced students' learning of quantum mechanics concepts and have developed interactive tutorials which strive to help students learn these concepts. Two such tutorials, focused on the Mach-Zehnder interferometer (MZI) and the double-slit experiment (DSE), help students learn how to use the concept of "which-path" information to reason about the presence or absence of interference in these two experiments in different situations. After working on a pretest that asked students to predict interference in the MZI with single photons and polarizers of various orientations placed in one or both paths of the MZI, students worked on the MZI tutorial which, among other things, guided them to reason in terms of which-path information in order to predict interference in similar situations. We investigated the extent to which students were able to use reasoning related to which-path information learned in the MZI tutorial to answer analogous questions on the DSE (before working on the DSE tutorial). After students worked on the DSE pretest they worked on a DSE tutorial in which they learned to use the concept of which-path information to answer questions about interference in the DSE with single particles with mass sent through the two slits and a monochromatic lamp placed between the slits and the screen. We investigated if this additional exposure to the concept of which-path information promoted improved learning and performance in the DSE questions with single photons and polarizers placed after one or both slits. We find evidence that both tutorials promoted which-path information reasoning and helped students use this reasoning appropriately in contexts different from the ones in which they had learned it.

preprint2020arXiv

Exploring one aspect of pedagogical content knowledge of teaching assistants using the Conceptual Survey of Electricity and Magnetism

Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account common student difficulties in their instructional design. Here, we discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to identify the most common incorrect answer choice selected by introductory physics students if they did not know the correct answer after traditional instruction. Then, we used introductory student CSEM post-test data to assess the extent to which TAs were able to identify the most common alternate conception of introductory students in each question on the CSEM. We find that the TAs were thoughtful when attempting to identify common student difficulties and they enjoyed learning about student difficulties this way. However, they struggled to identify many common difficulties of introductory students that persist after traditional instruction. We discuss specific alternate conceptions that persist after traditional instruction, the extent to which TAs were able to identify them, and results from think-aloud interviews with TAs which provided valuable information regarding why the TAs sometimes selected certain alternate conceptions as the most common but were instead very rare among introductory students. We also discuss how tasks such as the one used in this study can be used in professional development programs to engender productive discussions about the importance of being knowledgeable about student alternate conceptions in order to help students learn.

preprint2020arXiv

Exploring pedagogical content knowledge of physics instructors using the force concept inventory

The Force Concept Inventory (FCI) has been widely used to assess student understanding of introductory mechanics concepts by educators and physics education researchers. Many of the items on the FCI have strong distractor choices corresponding to students' alternate conceptions in mechanics. Instruction is unlikely to be effective if instructors do not explicitly take into account students' initial knowledge state in their instructional design. We discuss research involving the FCI to evaluate the pedagogical content knowledge of instructors of varying teaching experience. For each item on the FCI, instructors were asked to identify the most common incorrect answer choice of introductory physics students. We also discussed the responses individually with some instructors. Then we used the FCI pre-test and post-test data from a large population (~900) of introductory students to assess the pedagogical content knowledge of the physics instructors related to the FCI. While the physics instructors, on average, performance better than random guessing at identifying introductory students' difficulties with FCI content, they did not identify many common difficulties of introductory physics students. Moreover, the ability to correctly identify students' difficulties was not correlated with the teaching experience of instructors.

preprint2020arXiv

Gender inequities throughout STEM: Women with higher grades drop STEM majors while men persist

Efforts to promote equity and inclusion using evidence-based approaches are vital to correct long-standing societal inequities that have disadvantaged women and discouraged them from pursuing studies, e.g., in many STEM disciplines. We use 10 years of institutional data at a large public university to investigate trends in the majors that men and women declare, drop after declaring, and earn degrees in as well as the GPA of the students who drop or earn a degree. We find that the majors with the lowest number of students also have the highest rates of attrition. Moreover, we find alarming GPA trends, e.g., women who drop majors on average earn higher grades than men who drop those majors, and in some STEM majors, women who drop the majors were earning comparable grades to men who persist in those majors. These quantitative findings call for a better understanding of the reasons students drop a major and for making learning environments equitable and inclusive.

preprint2020arXiv

Hermione and the Secretary: How gendered task division in introductory physics labs can disrupt equitable learning

Physics labs provide a unique opportunity for students to grow their physics identity and science identity in general since they provide students with opportunity to tinker with experiments and analyze data in a low-stakes environment. However, it is important to ensure that all students are benefiting from the labs equally and have a positive growth trajectory. Through interviews and reflexive ethnographic observations, we identify and analyze two common modes of work that may disadvantage female students in introductory physics labs. Students who adopt the Secretary archetype are relegated to recording and analyzing data, and thus miss out on much of the opportunity to grow their physics and science identities by engaging fully in the experimental work. Meanwhile, students in the Hermione mode shoulder a disproportionate amount of managerial work, and also do not get adequate opportunity to engage with different aspects of the experimental work that are essential for helping them develop their physics and science identities. Using a physics identity framework, we analyze interviews and observational data to investigate how students under these modes of work may experience stunted growth in their physics and science identity trajectories in their physics lab course. This stunted growth then perpetuates and reinforces societal stereotypes and biases about who does physics. This categorization not only gives a vocabulary to discussions about equity in the lab, but can also serve as a useful touchstone for those who seek to center equity in efforts to transform physics instruction.

preprint2020arXiv

Holistic framework to help students learn effectively from research-validated self-paced learning tools

With limited time available in the classroom, e-learning tools can supplement in-class learning by providing opportunities for students to study and learn outside of class. Such tools can be especially helpful for students who lack adequate prior preparation. However, one critical issue is ensuring that students, especially those in need of additional help, engage with the tools as intended. Here we first discuss an empirical investigation in which students in a large algebra-based physics course were given opportunities to work through research-validated tutorials outside of class as self-study tools. Students were provided these optional tutorials after traditional instruction in relevant topics and were then given quizzes that included problems that were identical to the tutorial problems with regard to the physics principles involved but had different contexts. We find that students who worked through the tutorials as self-study tools struggled to transfer their learning to solve problems that used the same physics principles. On the other hand, students who worked on the tutorials in supervised, one-on-one situations performed significantly better than them. These empirical findings suggest that many introductory physics students may not engage effectively with self-paced learning tools unless they are provided additional incentives and support, e.g., to aid with self-regulation. Inspired by the empirical findings, we propose a holistic theoretical framework to help create learning environments in which students with diverse backgrounds are provided support to engage effectively with self-study tools.

preprint2020arXiv

How learning environment predicts male and female students' physics motivational beliefs in introductory physics courses

In this study, we adapt prior identity framework to investigate the effect of learning environment (including perceived recognition, peer interaction and sense of belonging) on students' physics self-efficacy, interest and identity by controlling for their self-efficacy and interest at the beginning of a calculus-based introductory physics course. We surveyed 1203 students, 35% of whom were women. We found that female students' physics self-efficacy and interest were lower than male students' at the beginning of the course, and the gender gaps in these motivational constructs became even larger by the end of the course. Analysis revealed that the decrease in students' physics self-efficacy and interest were mediated by the learning environment and ultimately affected students' physics identity. Our model shows that perceived recognition played a major role in explaining students' physics identity, and students' sense of belonging in physics played an important role in explaining the change in students' physics self-efficacy.

preprint2020arXiv

How the learning environment predicts male and female students' motivational beliefs in algebra-based introductory physics courses

Societal stereotypes and biases pertaining to who belongs in physics and who can excel in physics can impact motivational beliefs, e.g., of women and racial and ethnic minority students in physics courses. This study investigates how the learning environment predicts male and female students' motivational beliefs including physics self-efficacy, interest, and identity at the end of year long (spanning two-semester) algebra-based introductory physics courses. These were courses at a large university in the US taken primarily by biological science majors many of whom are interested in health professions. Although women are not underrepresented in these physics courses, societal stereotypes and biases internalized by female students over their lifetime can still impact their motivational beliefs about physics. Our findings show gender gap in motivational beliefs favoring men. These findings can be useful to provide support and create an equitable and inclusive learning environment to help all students excel in these courses.

preprint2020arXiv

Improving student understanding of quantum mechanics underlying the Stern-Gerlach experiment using a research-validated multiple-choice question sequence

Engaging students with well-designed multiple-choice questions during class and asking them to discuss their answers with their peers after each student has contemplated the response individually can be an effective evidence-based active-engagement pedagogy in physics courses. Moreover, validated sequences of multiple-choice questions are more likely to help students build a good knowledge structure of physics than individual multiple-choice questions on various topics. Here we discuss a framework to develop robust sequences of multiple-choice questions and then use the framework for the development, validation and implementation of a sequence of multiple-choice questions focusing on helping students learn quantum mechanics via the Stern-Gerlach experiment that takes advantage of the guided inquiry-based learning sequences in an interactive tutorial on the same topic. The extensive research in developing and validating the multiple-choice question sequence strives to make it effective for students with diverse prior preparation in upper-level undergraduate quantum physics courses. We discuss student performance on assessment task focusing on the Stern-Gerlach experiment after traditional lecture-based instruction vs. after engaging with the research-validated multiple-choice question sequence administered as clicker questions in which students had the opportunity to discuss their responses with their peers.

preprint2020arXiv

Interactive Learning Tutorial on Quantum Key Distribution

We describe the development and in-class evaluation of a Quantum Interactive Learning Tutorial (QuILT) on quantum key distribution, a context which involves an exciting application of quantum mechanics. The protocol used in the QuILT described here uses single photons with non-orthogonal polarization states to generate a random shared key over a public channel for encrypting and decrypting information. The QuILT strives to help upper-level undergraduate students learn quantum mechanics using a simple two state system. It actively engages students in the learning process and helps them build links between the formalism and the conceptual aspects of quantum physics without compromising the technical content. The in-class evaluation suggests that the validated QuILT is helpful in improving students' understanding of relevant concepts.

preprint2020arXiv

Is agreeing with a gender stereotype correlated with the performance of female students in introductory physics?

Several prior studies in introductory physics have found a gender gap on conceptual assessments such as the Force Concept Inventory (FCI) and the Conceptual Survey of Electricity and Magnetism (CSEM) with male students performing better than female students. Moreover, prior studies in the context of mathematics have also found that activation of a negative stereotype about a group can lead to deteriorated performance of the stereotyped group. Here, we describe two studies in which we investigated the impact of interventions on the gender gap on the FCI and CSEM in large introductory physics courses at a large research university. In the first study, we investigated whether asking introductory physics students to indicate their gender immediately before taking the CSEM increased the gender gap compared to students who were not asked for this information. We found no difference in performance between male and female students in the two conditions. In the second study, conducted with several thousand introductory physics students, we investigated the prevalence of the belief that men generally perform better in physics than women and the extent to which this belief is correlated with the performance of both female and male students on the FCI and the CSEM in introductory physics courses. We found that at the end of the year-long calculus-based introductory physics sequence, in which female students are significantly underrepresented, agreeing with a gender stereotype was correlated negatively with the performance of female students on the conceptual physics surveys. The fact that female students who agreed with the gender stereotype performed worse than female students who disagreed with it at the end of the year-long calculus-based physics course may partly be due to an increased stereotype threat that female students who agree with the stereotype may experience in this course.

preprint2020arXiv

Quantum interactive learning tutorial on the double-slit experiment to improve student understanding of quantum physics

Learning quantum mechanics is challenging, even for upper-level undergraduate and graduate students. Research-validated interactive tutorials that build on students' prior knowledge can be useful tools to enhance student learning. We have been investigating student difficulties with quantum mechanics pertaining to the double-slit experiment in various situations that appear to be counterintuitive and contradict classical notions of particles and waves. For example, if we send single electrons through the slits, they may behave as a "wave" in part of the experiment and as a "particle" in another part of the same experiment. Here we discuss the development and evaluation of a research-validated Quantum Interactive Learning Tutorial (QuILT) which makes use of an interactive simulation to improve student understanding of the double-slit experiment and strives to help students develop a good grasp of foundational issues in quantum mechanics. We discuss common student difficulties identified during the development and evaluation of the QuILT and analyze the data from the pretest and post test administered to the upper-level undergraduate and first-year physics graduate students before and after they worked on the QuILT to assess its effectiveness. These data suggest that on average, the QuILT was effective in helping students develop a more robust understanding of foundational concepts in quantum mechanics that defy classical intuition using the context of the double-slit experiment. Moreover, the upper-level undergraduates outperformed physics graduate students on the post test. One possible reason for this difference in performance may be the level of student engagement with the QuILT due to the grade incentive. In the undergraduate course, the post test was graded for correctness while in the graduate course, it was only graded for completeness.

preprint2020arXiv

Student difficulties with finding the corrections to the energy spectrum of the hydrogen atom for the strong and weak field Zeeman effects using degenerate perturbation theory

We discuss an investigation of student difficulties with the corrections to the energy spectrum of the hydrogen atom for the strong and weak field Zeeman effects using degenerate perturbation theory. This investigation was carried out in advanced quantum mechanics courses by administering written free-response and multiple-choice questions and conducting individual interviews with students. We discuss the common student difficulties related to these concepts which can be used as a guide for creating learning tools to help students develop a functional understanding of concepts involving the corrections to the energy spectrum due to the Zeeman effect.

preprint2020arXiv

Student difficulties with the corrections to the energy spectrum of the hydrogen atom for the intermediate field Zeeman effect

We discuss an investigation of student difficulties with the corrections to the energy spectrum of the hydrogen atom for the intermediate field Zeeman effect using the degenerate perturbation theory. The investigation was carried out in advanced quantum mechanics courses by administering free-response and multiple-choice questions and conducting individual interviews with students. We find that students share many common difficulties related to relevant physics concepts. In particular, students often struggled with mathematical sense-making in this context of quantum mechanics which requires interpretation of the implications of degeneracy in the unperturbed energy spectrum and how the Zeeman perturbation will impact the splitting of the energy levels. We discuss how the common difficulties often arise from the fact that applying linear algebra concepts correctly in this context with degeneracy in the energy spectrum is challenging for students.

preprint2020arXiv

Student understanding of Fermi energy, the Fermi-Dirac distribution and total electronic energy of a free electron gas

We investigated the difficulties that physics students in upper-level undergraduate quantum mechanics and graduate students after quantum and statistical mechanics core courses have with the Fermi energy, the Fermi-Dirac distribution and total electronic energy of a free electron gas after they had learned relevant concepts in their respective courses. These difficulties were probed by administering written conceptual and quantitative questions to undergraduate students and asking some undergraduate and graduate students to answer those questions while thinking aloud in one-on-one individual interviews. We find that advanced students had many common difficulties with these concepts after traditional lecture-based instruction. Engaging with a sequence of clicker questions improved student performance, but there remains room for improvement in their understanding of these challenging concepts.

preprint2020arXiv

Teaching assistants' performance at identifying common introductory student difficulties revealed by the conceptual survey of electricity and magnetism

We discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): the knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to (1) identify the most common incorrect answer choice of introductory physics students and (2) predict the percentage of introductory students who would answer the question correctly in a post-test. Then, we used the CSEM post-test data from approximately 400 introductory physics students (provided in the original paper describing the CSEM) to assess the extent to which the TAs were able to identify the alternate conceptions of introductory students related to electricity and magnetism. In addition, we conducted think-aloud interviews with TAs who had at least two semester of teaching experience in recitations to explore their reasoning about this task. We find that the TAs struggled to think about the difficulty of the questions from introductory students' perspective and they often underestimated the difficulty of the questions. Moreover, the TAs often expected certain incorrect answer choices to be common among introductory students when in fact those answer choices were not common.

preprint2020arXiv

The impact of stereotype threat on gender gap in introductory physics

Many prior studies have found a gender gap between male and female students' performance on conceptual assessments such as the Force Concept Inventory (FCI) and the Conceptual Survey of Electricity and Magnetism (CSEM) with male students performing better than female students. Prior studies have also found that activation of a negative stereotype about a group or stereotype threat, e.g., asking test-takers to indicate their ethnicity before taking a test, can lead to deteriorated performance of the stereotyped group. Here, we describe two studies in which we investigated the gender gap on the FCI and CSEM. In the first study, we investigated whether asking students to indicate their gender immediately before taking hte CSEM increased the gender gap compared to students who were not asked for this information. In the second study, conducted with over 1100 introductory physics students, we investigated the prevalence of the belief that men generally perform better in physics than women and the extent to which this belief is correlated with the performance of both the female and male students on the FCI.

preprint2020arXiv

The impact of students' epistemological framing on a task requiring representational consistency

The ability to flexibly transform between different representations (e.g., from mathematical to graphical representations) of the same concept is a hallmark of expertise. Prior research suggests that many introductory physics students show lack of representational consistency, e.g., they may construct two representations of the same concept in the same situation that are inconsistent with one another. In this case study, we asked students to construct two representations for the electric field for a situation involving Gauss's law with spherical symmetry (charge conducting sphere surrounded by charged conducting spherical shell). Prior research also suggests that this type of problem results in many students constructing representations that are not consistent with one another. Here we present findings from individual interviews with three students about this problem which suggest that students' lack of representational consistency may be partly attributed to the type of knowledge that the graphical and mathematical representations trigger. In the epistemic games framework terminology, the two representations students are asked to construct (mathematical vs. graphical) in the problem may contribute to their lack of representational consistency.

preprint2020arXiv

Validation and Administration of a Conceptual Survey on the Formalism and Postulates of Quantum Mechanics

We developed and validated a conceptual survey that focuses on the formalism and postulates of quantum mechanics covered in upper-level undergraduate quantum mechanics courses. The concepts included in the Quantum Mechanics Formalism and Postulate Survey (QMFPS) focus on Dirac notation, the Hilbert space, state vectors, physical observables and their corresponding Hermitian operators, compatible and incompatible observables, quantum measurement, time-dependence of quantum states and expectation values, and spin angular momenta. Here we describe the validation and administration of the survey, which has been administered to over 400 upper-level undergraduate and graduate students from six institutions. The QMFPS is valid and reliable for use as a low-stakes test to measure the effectiveness of instruction in an undergraduate quantum mechanics course that covers relevant content. The survey can also be used by instructors to identify student understanding of the formalism and postulates of quantum mechanics at the beginning and end of a graduate quantum mechanics course since graduate students are expected to have taken an undergraduate quantum mechanics course that covers the content included in the survey. We found that undergraduate students who engaged with research-validated learning tools performed better than students who did not on the QMFPS after the first semester of a junior/senior level quantum mechanics course. In addition, the performance of graduate students on QMFPS after instruction in the first semester of a core graduate-level quantum mechanics course was significantly better than the performance of undergraduate students at the end of the first semester of an undergraduate quantum mechanics course. A comparison with the base line data on the validated QMFPS presented here can aid instructors in assessing the effectiveness of their instructional approaches.

preprint2019arXiv

What's happening in traditional and inquiry-based introductory labs? An integrative analysis at a large research university

There is a growing recognition of the need to replace "cookbook"-style introductory labs with more-meaningful learning experiences. To identify the strengths and weaknesses of a mix of cookbook-style and inquiry-based labs, an introductory lab course currently being reformed was observed following a reflexive ethnographic protocol and pre and post E-CLASS surveys were administered. We analyzed data to identify shortcomings of the current labs and to determine areas for improvement.

preprint2016arXiv

A good diagram is valuable despite the choice of a mathematical approach to problem solving

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a problem into a representation that is easier to exploit for solving the problem. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solution. We conducted an investigation in which 118 students in an algebra-based introductory physics course were subjected to two different interventions during the problem solving in recitation quizzes throughout the semester. Here, we discuss the problem solving performance of students in different intervention groups for two problems involving standing waves in tubes, one which was given in a quiz and the other in a midterm exam. These problems can be solved using two different methods, one involving a diagrammatic representation and the other involving mostly mathematical manipulation of equations. In the quiz, students were either (1) asked to solve the problem in which a partial diagram was provided or (2) explicitly asked to draw a diagram. A comparison group was not given any instruction regarding diagrams. Students in group (1), who were given the partial diagram, could not use that partial diagram by itself to solve the problem. The partial diagram was simply intended as a hint for students to complete the diagram and follow the diagrammatic approach. However, we find an opposite effect, namely, that students given this diagram were less likely to draw productive diagrams and performed worse than students in the other groups. Moreover, we find that students who drew a productive diagram performed better than those who did not draw a productive diagram even if they primarily used a mathematical approach. Interviews with individual students who were asked to solve the problem provided further insight.

preprint2016arXiv

A Review of Student Difficulties in Upper-Level Quantum Mechanics

Learning advanced physics, in general, is challenging not only due to the increased mathematical sophistication but also because one must continue to build on all of the prior knowledge acquired at the introductory and intermediate levels. In addition, learning quantum mechanics can be especially challenging because the paradigms of classical mechanics and quantum mechanics are very different. Here, we review research on student reasoning difficulties in learning upper-level quantum mechanics and research on students' problem-solving and metacognitive skills in these courses. Some of these studies were multi-university investigations. The investigations suggest that there is large diversity in student performance in upper-level quantum mechanics regardless of the university, textbook, or instructor and many students in these courses have not acquired a functional understanding of the fundamental concepts. The nature of reasoning difficulties in learning quantum mechanics is analogous to reasoning difficulties found via research in introductory physics courses. The reasoning difficulties were often due to over-generalizations of concepts learned in one context to another context where they are not directly applicable. Reasoning difficulties in distinguishing between closely related concepts and in making sense of the formalism of quantum mechanics were common. We conclude with a brief summary of the research-based approached that take advantage of research on student difficulties in order to improve teaching and learning of quantum mechanics.

preprint2016arXiv

Assessing and improving student understanding of quantum mechanics

We developed a survey to probe student understanding of quantum mechanics concepts at the beginning of graduate instruction. The survey was administered to 202 graduate students in physics enrolled in first-year quantum mechanics courses from seven different universities at the beginning of the first semester. We also conducted one-on-one interviews with fifteen graduate students or advanced undergraduate students who had just finished a course in which all the content on the survey was covered. We find that students share universal difficulties about fundamental quantum mechanics concepts. The difficulties are often due to over-generalization of concepts learned in one context to other contexts where they are not directly applicable and difficulty in making sense of the abstract quantitative formalism of quantum mechanics. Instructional strategies that focus on improving student understanding of these concepts should take into account these difficulties. The results from this study can sensitize instructors of first-year graduate quantum physics to the conceptual difficulties students are likely to face.

preprint2016arXiv

Assessing Expertise in Introductory Physics Using Categorization Task

The ability to categorize problems based upon underlying principles, rather than surface features or contexts, is considered one of several proxy predictors of expertise in problem solving. With inspiration from the classic study by Chi, Feltovich, and Glaser, we assess the distribution of expertise among introductory physics students by asking three introductory physics classes, each with more than a hundred students, to categorize mechanics problems based upon similarity of solution. We compare their categorization with those of physics graduate students and faculty members. To evaluate the effect of problem context on students' ability to categorize, two sets of problems were developed for categorization. Some problems in one set included those available from the prior study by Chi et al. We find a large overlap between calculus-based introductory students and graduate students with regard to their categorizations that were assessed as "good." Our findings, which contrast with those of Chi et al., suggest that there is a wide distribution of expertise in mechanics among introductory and graduate students. Although the categorization task is conceptual, introductory students in the calculus-based course performed better than those in the algebra-based course. Qualitative trends in categorization of problems are similar between the non-Chi problems and problems available from the Chi study used in our study although the Chi problems used are more difficult on average.

preprint2016arXiv

Assessing Expertise in Quantum Mechanics using Categorization Task

We discuss the categorization of 20 quantum mechanics problems by 6 physics professors and 22 undergraduate students from two honors-level quantum mechanics courses. Professors and students were asked to categorize the problems based upon similarity of solution. We also had individual discussions with professors who categorized the problems. Faculty members' categorizations were overall rated better than those of students by three faculty members who evaluated all of the categorizations. But the categories created by faculty members were more diverse compared to the uniformity of the categories they created when asked to categorize introductory mechanics problems.

preprint2016arXiv

Assessing Student Expertise in Introductory Physics with Isomorphic Problems, Part I: Performance on Non-intuitive Problem Pair from Introductory Physics

Investigations related to expertise in problem solving and ability to transfer learning from one context to another are important for developing strategies to help students perform more expert-like tasks. Here we analyze written responses to a pair of non-intuitive isomorphic problems given to introductory physics students and discussions with a subset of students about them. Students were asked to explain their reasoning for their written responses. We call the paired problems isomorphic because they require the same physics principle to solve them. However, the initial conditions are different and the frictional force is responsible for increasing the linear speed of an object in one of the problems while it is responsible for decreasing the linear speed in the other problem. We categorize student responses and evaluate student performance within the context of their evolving expertise. We compare and contrast the patterns of student categorization for the two isomorphic problems. We discuss why certain incorrect responses were better than others and shed light on the evolution of students' expertise. We compare the performance of students who worked on both isomorphic problems with those who worked only on one of the problems to understand whether students recognized their underlying similarity and whether isomorphic pairs gave students additional insight in solving each problem.

preprint2016arXiv

Assessing Student Expertise in Introductory Physics with Isomorphic Problems, Part II: Effect of Some Potential Factors on Problem Solving and Transfer

In this companion paper, we explore the use of isomorphic problem pairs (IPPs) to assess introductory physics students' ability to solve and successfully transfer problem-solving knowledge from one context to another in mechanics. We call the paired problems "isomorphic" because they require the same physics principle to solve them. We analyze written responses and individual discussions to a range of isomorphic problems. We examine potential factors that may help or hinder transfer of problem-solving skills from one problem in a pair to the other. For some paired isomorphic problems, one context often turned out to be easier for students in that it was more often correctly solved than the other. When quantitative and conceptual questions were paired and given back to back, students who answered both questions in the IPP often performed better on the conceptual questions than those who answered the corresponding conceptual questions only. Although students often took advantage of the quantitative counterpart to answer a conceptual question of an IPP correctly, when only given the conceptual question, students seldom tried to convert it into a quantitative question, solve it and then reason about the solution conceptually. Misconceptions associated with friction in some problems were so robust that pairing them with isomorphic problems not involving friction did not help students discern their underlying similarities. Alternatively, from the knowledge in pieces perspective, the activation of the knowledge resource related to friction was so strongly and automatically triggered by the context, which is outside the conscious control of the student, that students did not look for analogies with paired problems or other aids that may be present.

preprint2016arXiv

Can Free-Response Questions Be Approximated by Multiple-Choice Equivalents?

We discuss a study to evaluate the extent to which free-response questions can be approximated by multiple-choice equivalents. Two carefully designed research-based multiple-choice questions were transformed into a free-response format and administered on the final exam in a calculus-based introductory physics course. The original multiple-choice questions were administered in another, similar introductory physics course on the final exam. Our findings suggest that carefully designed multiple-choice questions can reflect the relative performance on the free-response questions while maintaining the benefits of ease of grading and quantitative analysis, especially if the different choices in the multiple-choice questions are weighted to reflect the different levels of understanding that students display.

preprint2016arXiv

Can multiple-choice questions simulate free-response questions?

We discuss a study to evaluate the extent to which free-response questions could be approximated by multiple-choice equivalents. Two carefully designed research-based multiple-choice questions were transformed into a free-response format and administered on the final exam in a calculus-based introductory physics course. The original multiple-choice questions were administered in another similar introductory physics course on final exam. Findings suggest that carefully designed multiple-choice questions can reflect the relative performance of the free-response questions while maintaining the benefits of ease of grading and quantitative analysis, especially if the different choices in the multiple-choice questions are weighted to reflect the different levels of understanding that students display.

preprint2016arXiv

Categorization of Mechanics Problems by Students in Large Introductory Physics Courses: A Comparison with the Chi, Feltovich, and Glaser Study

With inspiration from the classic study by Chi, Feltovich, and Glaser [1], we asked introductory physics students in three introductory physics classes to categorize mechanics problems based upon similarity of solutions. To evaluate the effect of problem context on students' ability to categorize, two sets of problems were developed for categorization. Some problems in one of the problem sets that students were asked to categorize included those available from the prior study by Chi et al. Our findings, which contrast from those of Chi et al., suggest that there is a much wider distribution of expertise among introductory students.

preprint2016arXiv

Categorization of problems to assess and improve proficiency as teachers and learners

We describe how graduate students categorize introductory mechanics problems based on the similarity of their solutions. Graduate students were asked at the end of a teaching assistant training class to categorize problems from their own perspective and from the perspective of typical introductory physics students whom they were teaching. We compare their categorizations with the categorizations by introductory physics students and physics faculty who categorized the same problems. The utility of categorization as a tool for teaching assistant training and faculty development workshops is discussed.

preprint2016arXiv

Categorization of Quantum Mechanics Problems by Professors and Students

We discuss the categorization of 20 quantum mechanics problems by physics professors and undergraduate students from two honors-level quantum mechanics courses. Professors and students were asked to categorize the problems based upon similarity of solution. We also had individual discussions with professors who categorized the problems. Faculty members' categorizations were overall rated higher than those of students by three faculty members who evaluated all of the categorizations. The categories created by faculty members were more diverse compared to the categories they created for a set of introductory mechanics problems. Some faculty members noted that the categorization of introductory physics problems often involves identifying fundamental principles relevant for the problem, whereas in upper-level undergraduate quantum mechanics problems, it mainly involves identifying concepts and procedures required to solve the problem. Moreover, physics faculty members who evaluated others' categorizations expressed that the task was very challenging and they sometimes found another person's categorization to be better than their own. They also rated some concrete categories such as "hydrogen atom" or "simple harmonic oscillator" higher than other concrete categories such as "infinite square well" or "free particle".

preprint2016arXiv

Centripetal Acceleration: Often Forgotten or Misinterpreted

Acceleration is a fundamental concept in physics which is taught in mechanics at all levels. Here, we discuss some challenges in teaching this concept effectively when the path along which the object is moving has a curvature and centripetal acceleration is present. We discuss examples illustrating that both physics teachers and students have difficulty with this concept. We conclude with instructional strategies that may help students with this challenging concept.

preprint2016arXiv

Challenges in Analogical Reasoning

Learning physics requires understanding the applicability of fundamental principles in a variety of contexts that share deep features. One way to help students learn physics is via analogical reasoning. Students can be taught to make an analogy between situations that are more familiar or easier to understand and another situation where the same physics principle is involved but that is more difficult to handle. Here, we examine introductory physics students' ability to use analogies in solving problems involving Newton's second law. Students enrolled in an algebra-based introductory physics course were given a solved problem involving tension in a rope and were then asked to solve another problem for which the physics is very similar but involved a frictional force. They were asked to point out the similarities between the two problems and then use the analogy to solve the friction problem.

preprint2016arXiv

Cognitive Issues in Learning Advanced Physics: An Example from Quantum Mechanics

We are investigating cognitive issues in learning quantum mechanics in order to develop effective teaching and learning tools. The analysis of cognitive issues is particularly important for bridging the gap between the quantitative and conceptual aspects of quantum mechanics and for ensuring that the learning tools help students build a robust knowledge structure. We discuss the cognitive aspects of quantum mechanics that are similar or different from those of introductory physics and their implications for developing strategies to help students develop a good grasp of quantum mechanics.

preprint2016arXiv

Connecting Three Pivotal Concepts in K-12 Science State Standards and Maps of Conceptual Growth to Research in Physics Education

This paper describes three conceptual areas in physics that are particularly important targets for educational interventions in K-12 science. These conceptual areas are force and motion, conservation of energy, and geometrical optics, which were prominent in the US national and four US state standards that we examined. The four US state standards that were analyzed to explore the extent to which the K-12 science standards differ in different states were selected to include states in different geographic regions and of different sizes. The three conceptual areas that were common to all the four state standards are conceptual building blocks for other science concepts covered in the K-12 curriculum. Since these three areas have been found to be ripe with deep student misconceptions that are resilient to conventional physics instruction, the nature of difficulties in these areas is described in some depth, along with pointers towards approaches that have met with some success in each conceptual area.

preprint2016arXiv

Core Graduate Courses: A Missed Learning Opportunity?

An important goal of graduate physics core courses is to help students develop expertise in problem solving and improve their reasoning and meta-cognitive skills. We explore the conceptual difficulties of physics graduate students by administering conceptual problems on topics covered in undergraduate physics courses before and after instruction in related first year core graduate courses. Here, we focus on physics graduate students' difficulties manifested by their performance on two qualitative problems involving diagrammatic representation of vector fields. Some graduate students had great difficulty in recognizing whether the diagrams of the vector fields had divergence and/or curl but they had no difficulty computing the divergence and curl of the vector fields mathematically. We also conducted individual discussions with various faculty members who regularly teach first year graduate physics core courses about the goals of these courses and the performance of graduate students on the conceptual problems after related instruction in core courses.

preprint2016arXiv

Coupling Conceptual and Quantitative Problems to Develop Expertise in Introductory Physics Students

We discuss the effect of administering conceptual and quantitative isomorphic problem pairs (CQIPP) back to back vs. asking students to solve only one of the problems in the CQIPP in introductory physics courses. Students who answered both questions in a CQIPP often performed better on the conceptual questions than those who answered the corresponding conceptual questions only. Although students often took advantage of the quantitative counterpart to answer a conceptual question of a CQIPP correctly, when only given the conceptual question, students seldom tried to convert it into a quantitative question, solve it and then reason about the solution conceptually. Even in individual interviews, when students who were only given conceptual questions had difficulty and the interviewer explicitly encouraged them to convert the conceptual question into the corresponding quantitative problem by choosing appropriate variables, a majority of students were reluctant and preferred to guess the answer to the conceptual question based upon their gut feeling.

preprint2016arXiv

Developing a Magnetism Conceptual Survey and Assessing Gender Differences in Student Understanding of Magnetism

We discuss the development of a research-based conceptual multiple-choice survey related to magnetism. We also discuss the use of the survey to investigate gender differences in students' difficulties with concepts related to magnetism. We find that while there was no gender difference on the pre-test, female students performed significantly worse than male students when the survey was given as a post-test in traditionally taught calculus-based introductory physics courses (similar results in both the regular and honors versions of the course). In the algebra-based courses, the performance of the female students and the male students has no statistical difference in the pre-test or the post-test.

preprint2016arXiv

Development and Evaluation of a Quantum Interactive Learning Tutorial on Larmor Precession Of Spin

We conducted research on student difficulties and developed and evaluated a quantum interactive learning tutorial (QuILT) on Larmor precession of spin to help students learn about time-dependence of expectation values in quantum mechanics. The QuILT builds on students' prior knowledge and strives to help them develop a good knowledge structure of relevant concepts. It adapts visualization tools to help students develop intuition about these topics and focuses on helping them integrate qualitative and quantitative understanding. Here, we summarize the development and preliminary evaluation.

preprint2016arXiv

Development and Evaluation of a Tutorial to Improve Students' Understanding of a Lock-in amplifier

A lock-in amplifier is a versatile instrument frequently used in physics research. However, many students struggle with the basic operating principles of a lock-in amplifier which can lead to a variety of difficulties. To improve students' understanding, we have been developing and evaluating a research-based tutorial which makes use of a computer simulation of a lock-in amplifier. The tutorial is based on a field-tested approach in which students realize their difficulties after predicting the outcome of simulated experiments involving a lock-in amplifier and check their predictions using the simulated lock-in amplifier. Then, the tutorial provides guidance and strives to help students develop a coherent understanding of the basics of a lock-in amplifier. The tutorial development involved interviews with physics faculty members and graduate students and iteration of many versions of the tutorial with professors and graduate students. The student difficulties with lock-in amplifiers and the development and assessment of the research-based tutorial to help students develop a functional understanding of this device are discussed.

preprint2016arXiv

Development of an interactive tutorial on quantum key distribution

We describe the development of a Quantum Interactive Learning Tutorial (QuILT) on quantum key distribution, a context which involves a practical application of quantum mechanics. The QuILT helps upper-level undergraduate students learn quantum mechanics using a simple two state system and was developed based upon the findings of cognitive research and physics education research. One protocol used in the QuILT involves generating a random shared key over a public channel for encrypting and decrypting information using single photons with non-orthogonal polarization states, and another protocol makes use of two entangled spin-1/2 particles. The QuILT uses a guided approach and focuses on helping students build links between the formalism and conceptual aspects of quantum physics without compromising the technical content. We also discuss findings from a preliminary in-class evaluation.

preprint2016arXiv

Effect of Misconception on Transfer in Problem Solving

We examine the effect of misconceptions about friction on students' ability to solve problems and transfer from one context to another. We analyze written responses to paired isomorphic problems given to introductory physics students and discussions with a subset of students. Misconceptions associated with friction in problems were sometimes so robust that pairing them with isomorphic problems not involving friction did not help students fully discern their underlying similarities.

preprint2016arXiv

Effect of Scaffolding on Helping Introductory Physics Students Solve Quantitative Problems Involving Strong Alternative Conceptions

It is well-known that introductory physics students often have alternative conceptions that are inconsistent with established physical principles and concepts. Invoking alternative conceptions in quantitative problem-solving process can derail the entire process. In order to help students solve quantitative problems involving strong alternative conceptions correctly, appropriate scaffolding support can be helpful. The goal of this study is to examine how different scaffolding supports involving analogical problem solving influence introductory physics students' performance on a target quantitative problem in a situation where many students' solution process is derailed due to alternative conceptions. Three different scaffolding supports were designed and implemented in calculus-based and algebra-based introductory physics courses to evaluate the level of scaffolding needed to help students learn from an analogical problem that is similar in the underlying principles but for which the problem solving process is not derailed by alternative conceptions. We found that for the quantitative problem involving strong alternative conceptions, simply guiding students to work through the solution of the analogical problem first was not enough to help most students discern the similarity between the two problems. However, if additional scaffolding supports that directly helped students examine and repair their knowledge elements involving alternative conceptions were provided, students were more likely to discern the underlying similarities between the problems and avoid getting derailed by alternative conceptions when solving the targeted problem. We also found that some scaffolding supports were more effective in the calculus-based course than in the algebra-based course. This finding emphasizes the fact that appropriate scaffolding support must be determined via research in order to be effective.

preprint2016arXiv

Effect of Self Diagnosis on Subsequent Problem Solving Performance

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. The recitation classes in an introductory physics class (~200 students) were split into a control group and three experimental groups in which different levels of guidance was provided for performing the self-diagnosis activities. We have been a) investigating how students in each group performed on subsequent near and far transfer questions given as part of the exams; and b) comparing student's initial scores on their quizzes with their performance on the exams, as well as comparing student's self-diagnosis scores with their performance on the exams. We discuss some hypotheses about the students' ability to self-diagnose with different levels of scaffolding support and emphasize the importance of teaching students how to diagnosis their own mistakes. Our findings suggest that struggling with minimal support during in-class self-diagnosis can trigger out-of-class self-diagnosis. Students therefore may be motivated to make sense of the problem they may have not been able to self diagnose, whether independently or in a collaborative effort.

preprint2016arXiv

Grading Practices and Considerations of Graduate Students at the Beginning of their Teaching Assignment

Research shows that expert-like approaches to problem-solving can be promoted by encouraging students to explicate their thought processes and follow a prescribed problem-solving strategy. Since grading communicates instructors' expectations, teaching assistants' grading decisions play a crucial role in forming students' approaches to problem-solving in physics. We investigated the grading practices and considerations of 43 graduate teaching assistants (TAs). The TAs were asked to grade a set of specially designed student solutions and explain their grading decisions. We found that in a quiz context, a majority of TAs noticed but did not grade on solution features which promote expert-like approaches to problem-solving. In addition, TAs graded differently in quiz and homework contexts, partly because of how they considered time limitations in a quiz. Our findings can inform professional development programs for TAs.

preprint2016arXiv

Helping students learn effective problem solving strategies by reflecting with peers

We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework and discussed why solutions of some students employed better problem solving strategies than others. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. The traditional group recitation quiz questions were similar to the homework questions selected for "peer reflection" in the PR group recitations. As one measure of the impact of this intervention, we investigated how likely students were to draw diagrams to help with problem solving. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

preprint2016arXiv

Helping Students Learn Quantum Mechanics for Quantum Computing

Quantum information science and technology is a rapidly growing interdisciplinary field drawing researchers from science and engineering fields. Traditional instruction in quantum mechanics is insufficient to prepare students for research in quantum computing because there is a lack of emphasis in the current curriculum on quantum formalism and dynamics. We are investigating the difficulties students have with quantum mechanics and are developing and evaluating quantum interactive learning tutorials (QuILTs) to reduce the difficulties. Our investigation includes interviews with individual students and the development and administration of free-response and multiple-choice tests. We discuss the implications of our research and development project on helping students learn quantum mechanics relevant for quantum computing.

preprint2016arXiv

Identifying Differences In Diagnostic Skills Between Physics Students: Developing A Rubric

Expert problem solvers are characterized by continuous evaluation of their progress towards a solution. One characteristic of expertise is self-diagnosis directed towards elaboration of the solvers' conceptual understanding, knowledge organization or strategic approach. "Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating how introductory physics students perform in such tasks. Developing a robust rubric is essential for objective evaluation of students' self-diagnosis skills. We discuss the development of a grading rubric that takes into account introductory physics students' content knowledge as well as analysis, planning and presentation skills. Using this rubric, we have found the inter-rater reliability to be better than 80%. The rubric can easily be adapted to other problems, as will be discussed in a companion paper.

preprint2016arXiv

Identifying Differences in Diagnostic Skills between Physics Students: Students' Self-Diagnostic Performance Given Alternative Scaffolding

"Self-diagnosis tasks" aim at fostering diagnostic behavior by explicitly requiring students to present diagnosis as part of the activity of reviewing their problem solutions. We have been investigating the extent to which introductory physics students can diagnose their own mistakes when explicitly asked to do so with different levels of scaffolding support provided to them. In our study in an introductory physics class with more than 200 students, the recitation classes were split into three different experimental groups in which different levels of guidance were provided for performing the self-diagnosis activities. We present our findings that students' performance was far from perfect. However, differences in the scaffolding in the three experimental groups (i.e. providing a correct solution and a self-diagnosis rubric) noticeably affected the resulting diagnosis.

preprint2016arXiv

Impact of guided reflection with peers on the development of effective problem solving strategies and physics learning

Students must learn effective problem solving strategies in order to develop expertise in physics. Effective problem solving strategies include a conceptual analysis of the problem followed by planning of the solution, and then implementation, evaluation and reflection upon the process. Research suggests that converting a problem from the initial verbal representation to other suitable representation, e.g., diagrammatic representation, during the initial conceptual analysis can facilitate further analysis of the problem.6 But without guidance, many introductory physics students solve problems using superficial clues and cues and do not perceive problem solving as an opportunity for learning. Here, we describe a study which suggests that engaging students in reflection with peers about effective problem solving strategies while effective approaches are modeled for them and prompt feedback is provided may enhance desirable skills.

preprint2016arXiv

Impact of peer interaction on conceptual test performance

We analyze the effectiveness of working in pairs on the Conceptual Survey of Electricity and Magnetism test in a calculus-based introductory physics course. Students who collaborated with a peer showed significantly larger normalized gain on individual testing than those who did not collaborate. We did not find statistically significant differences between the performance of students who were given an opportunity to formulate their own response before the peer discussions, compared to those who were not. Peer collaboration also shows evidence for co-construction of knowledge. Discussions with individual students show that students themselves value peer interaction. We discuss the effect of pairing students with different individual achievements.

preprint2016arXiv

Improving performance in quantum mechanics with explicit incentives to correct mistakes

An earlier investigation found that the performance of advanced students in a quantum mechanics course did not automatically improve from midterm to final exam on identical problems even when they were provided the correct solutions and their own graded exams. Here, we describe a study, which extended over four years, in which upper-level undergraduate students in a quantum physics course were given four identical problems in both the midterm exam and final exam. Approximately half of the students were given explicit incentives to correct their mistakes in the midterm exam. In particular, they could get back up to 50\% of the points lost on each midterm exam problem. The solutions to the midterm exam problems were provided to all students in both groups but those who corrected their mistakes were provided the solution after they submitted their corrections to the instructor. The performance on the same problems on the final exam suggests that students who were given incentives to correct their mistakes significantly outperformed those who were not given an incentive. The incentive to correct the mistakes had greater impact on the final exam performance of students who had not performed well on the midterm exam.

preprint2016arXiv

Improving student understanding of addition of angular momentum in quantum mechanics

We describe the difficulties advanced undergraduate and graduate students have with concepts related to addition of angular momentum in quantum mechanics. We also describe the development and implementation of a research-based learning tool, a Quantum Interactive Learning Tutorial (QuILT), to reduce these difficulties. The preliminary evaluation shows that the QuILT related to the basics of the addition of angular momentum is helpful in improving students' understanding of these concepts.

preprint2016arXiv

Improving Student Understanding of Coulomb's Law and Gauss's Law

We discuss the development and evaluation of five research-based tutorials on Coulomb's law, superposition, symmetry and Gauss's Law to help students in the calculus-based introductory physics courses learn these concepts. We discuss the performance of students on the pre-/post-tests given before and after the tutorials in three calculus-based introductory physics courses. We also discuss the performance of students who used the tutorials and those who did not use it on a multiple-choice test which employs concepts covered in the tutorials.

preprint2016arXiv

Improving Students' Conceptual Understanding of Conductors and Insulators

We examine the difficulties that introductory physics students, undergraduate physics majors, and physics graduate students have with concepts related to conductors and insulators covered in introductory physics by giving written tests and interviewing a subset of students. We find that even graduate students have serious difficulties with these concepts. We develop tutorials related to these topics and evaluate their effectiveness by comparing the performance on written pre-/post-tests and interviews of students who received traditional instruction vs. those who learned using tutorials.

preprint2016arXiv

Improving Students' Understanding of Lock-in Amplifiers

A lock-in amplifier is a versatile instrument frequently used in physics research. However, many students struggle with the basic operating principles of a lock-in amplifier which can lead to a variety of difficulties. To improve students' understanding, we have been developing and evaluating a research-based tutorial which makes use of a computer simulation of a lock-in amplifier. The tutorial is based on a field-tested approach in which students realize their difficulties after predicting the outcome of simulated experiments involving a lock-in amplifier and check their predictions using the simulated lock-in amplifier. Then, the tutorial guides and helps students develop a coherent understanding of the basics of a lock-in amplifier. The tutorial development involved interviews with physics faculty members and graduate students and iteration of many versions of the tutorial with professors and graduate students. The student difficulties and the development and assessment of the research-based tutorial are discussed.

preprint2016arXiv

Improving Students' Understanding of Lock-In Amplifiers

The lock-in amplifier is a versatile instrument frequently used in physics research. However, many students struggle with the basic operating principles of a lock-in amplifier which can lead to a variety of difficulties. To improve students' understanding, we have been developing and evaluating a research-based tutorial which makes use of a computer simulation of a lock-in amplifier. The tutorial allows students to realize their conceptual difficulties by comparing their predictions about how a lock-in amplifier will behave with the outcome of simulated experiments. After being confronted with discrepancies between their predictions and the lock-in amplifier results, the tutorial targets the common difficulties that students have and leads them to develop a deeper understanding of the principles of lock-in amplification.

preprint2016arXiv

Improving Students' Understanding of Quantum Measurement

We describe the difficulties advanced undergraduate and graduate students have with quantum measurement. To reduce these difficulties, we have developed research-based learning tools such as the Quantum Interactive Learning Tutorial (QuILT) and peer instruction tools. A preliminary evaluation shows that these learning tools are effective in improving students' understanding of concepts related to quantum measurement.

preprint2016arXiv

Improving Students' Understanding of Quantum Measurement Part 1: Investigation of Difficulties

We describe the difficulties that advanced undergraduate and graduate students have with quantum measurement within the standard interpretation of quantum mechanics. We explore the possible origins of these difficulties by analyzing student responses to questions from both surveys and interviews. Results from this research are applied to develop research-based learning tutorials to improve students' understanding of quantum measurement.

preprint2016arXiv

Improving Students' Understanding of Quantum Measurement Part 2: Development of Research-based Learning Tools

We describe the development and implementation of research-based learning tools such as the Quantum Interactive Learning Tutorials (QuILTs) and peer instruction tools to reduce students' common difficulties with issues related to measurement in quantum mechanics. A preliminary evaluation shows that these learning tools are effective in improving students' understanding of concepts related to quantum measurement.

preprint2016arXiv

Improving Students' Understanding of Quantum Mechanics by Using Peer Instruction Tools

Quantum mechanics is a challenging subject, even for advanced undergraduate and graduate students. Here, we discuss the development and evaluation of research-based concept tests for peer instruction as a formative assessment tool in quantum mechanics (QM) courses. The preliminary evaluations show that these tools are effective in helping students develop a good grasp of quantum mechanics.

preprint2016arXiv

Improving Students' Understanding of Quantum Mechanics via the Stern-Gerlach Experiment

The Stern-Gerlach experiment has played a central role in the discovery of spin angular momentum. It can also play a pivotal role in teaching the formalism of quantum mechanics using a concrete example involving a finite-dimensional Hilbert space. Using this context, students can learn about how to prepare a specific quantum state starting from an arbitrary state, issues related to the time evolution of the wave function, and quantum measurement. It can also be exploited to teach students about the distinction between the physical space where one performs the experiment and the Hilbert space where the state of the system lies and how the information about the state of the system in the Hilbert space can be exploited to interpret the possible outcomes of the experiment in the physical space. Students can learn the advantages of choosing an appropriate basis to make suitable predictions about the outcomes of experiments with different arrangements of Stern-Gerlach devices. This experiment can also help students understand that an ensemble of identically prepared systems, e.g., one in a linear superposition of two stationary states, is not the same as a mixture, e.g., in which half of the systems are in one stationary state and the other half are in the other stationary state. Here, we discuss investigation of students' difficulties about the Stern-Gerlach experiment by giving written tests and interviewing advanced undergraduate and graduate students in quantum mechanics courses. We also discuss preliminary data from two quantum mechanics courses that suggest that a Quantum Interactive Learning Tutorial (QuILT) related to the Stern-Gerlach experiment is helpful in improving students' understanding of these concepts.

preprint2016arXiv

Increasing interest and awareness about teaching in science undergraduates

We discuss the development, implementation, and assessment of a course for science undergraduates designed to help them develop an awareness and a deeper appreciation of the intellectual demands of physics teaching. The course focused on increasing student enthusiasm and confidence in teaching by providing well supported teaching opportunities and exposure to physics education research. The course assessment methods include 1) pre/post-tests measures of attitude and expectations about science teaching, 2) self and peer evaluation of student teaching, 3) content-based pre/post-tests given to students who received instruction from the student teachers, and 4) audio-taped focus group discussions in the absence of the instructor and TA to evaluate student perspective on different aspects of the course and its impact.

preprint2016arXiv

Instructional Goals and Grading Practices of Graduate Students after One Semester of Teaching Experience

Teaching assistants (TAs) are often responsible for grading student solutions. Since grading communicates instructors' expectations, TAs' grading decisions play a crucial role in forming students' approaches to problem solving (PS) in physics. We investigated the change in grading practices and considerations of 18 first-year graduate students participating in a TA professional development (PD) course. The TAs were asked to state their beliefs about the purpose of grading, to grade a set of specially designed student solutions, and to explain their grading decisions. We found that after one semester of teaching experience and participation in PD, TAs did not significantly change their goals for grading (i.e., a learning opportunity for both the student and the instructor) or their grading practice. In addition, TAs' grading practice frequently did not align with their goals. However, some TAs' perceptions of the level of explication required in a student solution did change. Our findings suggest that in order for PD to help TAs better coordinate their goals with appropriate grading practices, PD should focus on TAs' perception of sufficient reasoning in student solutions.

preprint2016arXiv

Interactive learning tutorials on quantum mechanics

We discuss the development and evaluation of quantum interactive learning tutorials (QuILTs) which are suitable for undergraduate courses in quantum mechanics. QuILTs are based on the investigation of student difficulties in learning quantum physics. They exploit computer-based visualization tools and help students build links between the formal and conceptual aspects of quantum physics without compromising the technical content. They can be used both as supplements to lectures or as a self-study tool.

preprint2016arXiv

Interactive tutorial to improve student understanding of single photon experiments involving a Mach-Zehnder Interferometer

We have developed and evaluated a Quantum Interactive Learning Tutorial (QuILT) on a Mach-Zehnder Interferometer with single photons to expose upper-level students in quantum mechanics courses to contemporary quantum optics applications. The QuILT strives to help students develop the ability to apply fundamental quantum principles to physical situations in quantum optics and explore the differences between classical and quantum ideas. The QuILT adapts visualization tools to help students build physical intuition about counter-intuitive quantum optics phenomena with single photons including a quantum eraser setup and focuses on helping them integrate qualitative and quantitative understanding. We discuss findings from in-class evaluations.

preprint2016arXiv

Interactive video tutorials for enhancing problem solving, reasoning, and meta-cognitive skills of introductory physics students

We discuss the development of interactive video tutorial-based problems to help introductory physics students learn effective problem solving heuristics. The video tutorials present problem solving strategies using concrete examples in an interactive environment. They force students to follow a systematic approach to problem solving and students are required to solve sub-problems (research-guided multiple choice questions) to show their level of understanding at every stage of prob lem solving. The tutorials are designed to provide scaffolding support at every stage of problem solving as needed and help students view the problem solving process as an opportunity for knowledge and skill acquisition rather than a "plug and chug" chore. A focus on helping students learn first to analyse a problem qualitatively, and then to plan a solution in terms of the relevant physics principles, can be useful for developing their reasoning skills. The reflection stage of problem solving can help students develop meta-cognitive skills because they must focus on what they have learned by solving the problem and how it helps them extend and organize their knowledge. Preliminary evaluations show that a majority of students who are unable to solve the tutorial problems without help can solve similar problems after working through the video tutorial. Further evaluation to assess the development of useful skills in tutorial learners vs. control group is underway.

preprint2016arXiv

Introduction to physics teaching for science and engineering undergraduates

Recruiting and retaining highly qualified physics and physical science teachers is critical for maintaining America's global competitiveness. Unfortunately, only one third of the high school teachers in physics have a degree in physics and an even smaller number of physical science teachers in middle school have a good grasp of the scientific content they teach. Moreover, teachers often lack adequate pedagogical content knowledge to teach science effectively. Here, we discuss the development, implementation, and assessment of a course for science and engineering undergraduates designed to increase awareness and help them develop an interest and a deeper appreciation of the intellectual demands of physics teaching. The course focused on increasing student enthusiasm and confidence in teaching by providing well supported teaching opportunities and exposure to physics education research. The course assessment methods include 1) pre/post-test measures of attitude and expectations about science teaching, 2) self and peer evaluation of student teaching, 3) content-based pre/post-tests given to students who received instruction from the student teachers, and 4) audio-taped focus group discussions in the absence of the instructor and TA to evaluate student perspective on different aspects of the course and its impact.

preprint2016arXiv

Investigating transfer of learning in advanced quantum mechanics

Research suggests that students often have difficulty transferring their learning from one context to another. We examine upper-level undergraduate and graduate students' facility with questions about the interference pattern in the double-slit experiment (DSE) with single photons and polarizers of various orientations placed in front of one or both slits. Before answering these types of questions, students had worked through a tutorial on the Mach-Zehnder Interferometer (MZI) in which they learned about interference of single photons when polarizers of various orientations are placed in the two paths of the MZI. After working on the MZI tutorial, students were asked similar questions in the isomorphic context of the DSE. We discuss the extent to which they were able to transfer what they learned in the context of the MZI to analogous problems in the isomorphic context of the DSE.

preprint2016arXiv

Learning from mistakes: The effect of students' written self-diagnoses on subsequent problem solving

Helping students learn to think like a physicist is an important goal of many introductory physics courses. One characteristic distinguishing more experienced physicists from novice students is that they make better use of problem solving as a learning opportunity. Experts were found to spend more time than novices in monitoring their work, reflecting upon their possibly deficient approach to solving a problem, reconsidering their choices as necessary, and extending and refining their knowledge structure. Moreover, research on worked-out examples suggests that better performing students are those who self-explain, that is, elaborate to themselves what they are learning from those examples, generate inferences, acknowledge mismatches between their own approach and that of the example, and attempt to resolve conflicts (self-repair). Indeed, physics instructors often express concern that many students do not make an effort to learn from their mistakes after the graded problems are returned to them. Here, we discuss an investigation focusing on how well introductory physics students self-diagnose their mistakes in their quiz solutions and its effect on subsequent problem solving in different interventions.

preprint2016arXiv

Performance of Graduate Students at Identifying Introductory Physics Students' Difficulties Related to Kinematics Graphs

The Test of Understanding Graphs in Kinematics (TUG-K) is a multiple choice test developed by Beichner to assess students' understanding of kinematics graphs. Many of the items on the TUG-K have strong distractor choices which correspond to introductory students' common difficulties with kinematics graphs. Instruction is unlikely to be effective if instructors do not know these common difficulties and take them into account in their instructional design. We evaluate the performance of first year physics graduate students at identifying introductory students' common difficulties related to kinematics graphs. In particular, for each item on the TUG-K, the graduate students were asked to identify which incorrect answer choice they thought would be most commonly selected by introductory physics students if they did not know the correct answer after instruction in relevant concepts. We used the introductory student data from Beichner's original paper to assess graduate students' knowledge of introductory students' difficulties. Furthermore, we selected the four questions on the TUG-K on which the graduate student performance was the poorest for a more detailed analysis which included think-aloud interviews. We present results which can partly account for the poor graduate student performance on these questions and also inform instruction in professional development courses.

preprint2016arXiv

Problem Solving and Learning

One finding of cognitive research is that people do not automatically acquire usable knowledge by spending lots of time on task. Because students' knowledge hierarchy is more fragmented, "knowledge chunks" are smaller than those of experts. The limited capacity of short term memory makes the cognitive load high during problem solving tasks, leaving few cognitive resources available for metacognition. The abstract nature of the laws of physics and the chain of reasoning required to draw meaningful inferences makes these issues critical. In order to help students, it is crucial to consider the difficulty of a problem from the perspective of students. We are developing and evaluating interactive problem-solving tutorials to help students in the introductory physics courses learn effective problem-solving strategies while solidifying physics concepts. The self-paced tutorials can provide guidance and support for a variety of problem solving techniques, and opportunity for knowledge and skill acquisition.

preprint2016arXiv

Reflection and Self-Monitoring in Quantum Mechanics

An assumed attribute of expert physicists is that they learn readily from their own mistakes. Experts are unlikely to make the same mistakes when asked to solve a problem a second time, especially if they have had access to a correct solution. Here, we discuss a case study in which fourteen advanced undergraduate physics students taking an honors-level quantum mechanics course were given the same four problems in both a midterm and final exam. The solutions to the midterm problems were provided to students. The performance on the final exam shows that while some advanced students performed equally well or improved compared to their performance on the midterm exam on the questions administered a second time, a comparable number performed less well on the final exam than on the midterm exam. The wide distribution of students' performance on problems administered a second time suggests that most advanced students do not automatically exploit their mistakes as an opportunity for learning, and for repairing, extending, and organizing their knowledge structure. Interviews with a subset of students revealed attitudes towards problem-solving and gave insight into their approach to learning.

preprint2016arXiv

Rethinking Tools for Training Teaching Assistants

The ability to categorize problems is a measure of expertise in a domain. In order to help students learn effectively, instructors and teaching assistants (TAs) should have pedagogical content knowledge. They must be aware of the prior knowledge of students they are teaching, consider the difficulty of the problems from students' perspective and design instruction that builds on what students already know. Here, we discuss the response of graduate students enrolled in a TA training course to categorization tasks in which they were asked to group problems based upon similarity of solution first from their own perspective, and later from the perspective of introductory physics students. Many graduate students performed an expert-like categorization of introductory physics problems. However, when asked to categorize the same problems from the perspective of introductory students, many graduate students expressed dismay, claiming that the task was impossible, pointless and had no relevance to their TA duties. We will discuss how categorization can be a useful tool for scaffolding and improving pedagogical content knowledge of teaching assistants and instructors.

preprint2016arXiv

Self-Diagnosis, Scaffolding and Transfer in a More Conventional Introductory Physics Problem

Previously we discussed how well students in an introductory physics course diagnosed their mistakes on a quiz problem with different levels of scaffolding support. In that case, the problem they self-diagnosed was unusually difficult. We also discussed issues related to transfer, particularly the fact that the transfer problem in the midterm that corresponded to the self-diagnosed problem was a far transfer problem. Here, we discuss a related intervention in which we repeated the study methodology with the same students in the same intervention groups, using a new quiz problem which was more typical for these students and a near transfer problem. We discuss how these changes affected students' ability to self-diagnose and transfer from the self-diagnosed quiz problem to a transfer problem on the midterm exam.

preprint2016arXiv

Self-Diagnosis, Scaffolding and Transfer: A Tale of Two Problems

Helping students learn from their own mistakes can help them develop habits of mind while learning physics content. Based upon cognitive apprenticeship model, we asked students to self-diagnose their mistakes and learn from reflecting on their problem solution. Varying levels of scaffolding support were provided to students in different groups to diagnose their errors on two context-rich problems that students originally solved in recitation quizzes. Here, we discuss students' cognitive engagement in the two self-diagnosis activities and transfer tasks with different scaffolds.

preprint2016arXiv

Should Students be Provided Diagrams or Asked to Draw Them While Solving Introductory Physics Problems?

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a given problem into a representation that is easier to exploit for solving it. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solution. We conducted an investigation in which 111 students in an algebra-based introductory physics course were subjected to two different interventions during recitation quizzes throughout the semester. They were either (1) asked to solve problems in which the diagrams were drawn for them or (2) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed a rubric to score the problem-solving performance of students in different intervention groups. Here, we present some surprising results for problems which involve considerations of initial and final conditions.

preprint2016arXiv

Stereotype threat? Effects of inquiring about test takers' gender on conceptual test performance in physics

It has been found that activation of a stereotype, for example by indicating one's gender before a test, typically alters performance in a way consistent with the stereotype, an effect called "stereotype threat". On a standardized conceptual physics assessment, we found that asking test takers to indicate their gender right before taking the test did not deteriorate performance compared to an equivalent group who did not provide gender information. Although a statistically significant gender gap was present on the standardized test whether or not students indicated their gender, no gender gap was observed on the multiple-choice final exam students took, which included both quantitative and conceptual questions on similar topics.

preprint2016arXiv

Student difficulties in translating between mathematical and graphical representations in introductory physics

We investigate introductory physics students' difficulties in translating between mathematical and graphical representations and the effect of scaffolding on students' performance. We gave a typical problem that can be solved using Gauss's law involving a spherically symmetric charge distribution (a conducting sphere concentric with a conducting spherical shell) to 95 calculus-based introductory physics students. We asked students to write a mathematical expression for the electric field in various regions and asked them to graph the electric field. We knew from previous experience that students have great difficulty in graphing the electric field. Therefore, we implemented two scaffolding interventions to help them. Students who received the scaffolding support were either (1) asked to plot the electric field in each region first (before having to plot it as a function of distance from the center of the sphere) or (2) asked to plot the electric field in each region after explicitly evaluating the electric field at the beginning, mid and end points of each region. The comparison group was only asked to plot the electric field at the end of the problem. We found that students benefited the most from intervention (1) and that intervention (2), although intended to aid students, had an adverse effect. Also, recorded interviews were conducted with a few students in order to understand how students were impacted by the aforementioned interventions.

preprint2016arXiv

Student understanding of quantum mechanics at the beginning of graduate instruction

A survey was developed to probe student understanding of quantum mechanics at the beginning of graduate instruction. The survey was administered to 202 physics graduate students enrolled in first-year quantum mechanics courses from seven universities at the beginning of the first semester. We also conducted one-on-one interviews with fifteen graduate or advanced undergraduate students who had just completed a course in which all the content on the survey was covered. Although students from some universities performed better on average than others, we found that students share universal difficulties understanding the concepts of quantum mechanics. The difficulties were often due to over-generalizations of concepts learned in one context to other contexts where they are not directly applicable. Difficulties in distinguishing between closely related concepts and making sense of the formalism of quantum mechanics were common. The results of this study can sensitize instructors of first-year graduate quantum physics to some of the difficulties students are likely to face.

preprint2016arXiv

Student understanding of Symmetry and Gauss' law

Helping students learn why Gauss' law can or cannot be easily applied to determine the strength of the electric field at various points for a particular charge distribution, and then helping them learn to determine the shape of the Gaussian surfaces if sufficient symmetry exists can develop their reasoning and problem solving skills. We investigate the difficulties that students in calculus-based introductory physics courses have with the concepts of symmetry, electric field and electric flux that are pivotal to Gauss' law of electricity. Determination of the electric field using Gauss' law requires discerning the symmetry of a particular charge distribution and being able to predict the direction of the electric field everywhere if a high symmetry exists. It requires a good grasp of how to add the electric field vectors using the principle of superposition, and the concepts of area vector and electric flux. We administered free response and multiple-choice questions and conducted interviews with individual students using a think-aloud protocol to elucidate the difficulties students have with the concepts of symmetry, electric field and electric flux. Here, we discuss student responses to some questions on a multiple-choice test administered to them. The test can be used as a teaching and assessment tool.

preprint2016arXiv

Student understanding of symmetry and Gauss's law of electricity

We investigate the difficulties that students in calculus-based introductory physics courses have with the concepts of symmetry, electric field, and electric flux which are important for applying Gauss's law. The determination of the electric field using Gauss's law requires determining the symmetry of a particular charge distribution and predicting the direction of the electric field everywhere if a high symmetry exists. Effective application of Gauss's law implicitly requires understanding the principle of superposition for electric fields. Helping students learn when Gauss's law can be readily applied to determine the strength of the electric field, and then helping them learn to determine the appropriate shape of Gaussian surfaces if sufficient symmetry exists, can help develop their reasoning and problem-solving skills. We administered free-response and multiple-choice questions and conducted interviews with individual students using a think-aloud protocol to elucidate the difficulties that students have with the concepts of symmetry, electric field, and electric flux. We also developed a multiple-choice test that targets these conceptual issues to obtain quantitative information about their difficulties and administered it to 541 students in the introductory calculus-based physics courses and to upper-level undergraduates in an electricity and magnetism course and to graduate students enrolled in a TA seminar course. We find that undergraduate students have many common difficulties with these concepts.

preprint2016arXiv

Students' Difficulties with Equations involving Circuit Elements

We discuss an investigation exploring students' difficulties with equations involving resistance, capacitance and inductance. We find that introductory physics students have great difficulty understanding, e.g., how the resistance of an ohmic resistor can be written in terms of the potential difference across it and the current through it, but it does not change when the potential difference across the resistor is varied. Similar confusions arose in problems relating to capacitors and inductors. We discuss these difficulties with equations in the context of introductory physics students' performance on questions about circuit elements both in the free-response and multiple-choice formats.

preprint2016arXiv

Students' Understanding of Stern Gerlach Experiment

The Stern Gerlach experiment has played a central role in the discovery of spin angular momentum and it has also played a pivotal role in elucidating foundational issues in quantum mechanics. Here, we discuss investigation of students' difficulties related to the Stern Gerlach experiment by giving written tests and interviewing advanced undergraduate and graduate students in quantum mechanics. We also discuss preliminary data that suggest that the Quantum Interactive Learning Tutorial (QuILT) related to the Stern Gerlach experiment is helpful in improving students' understanding of these concepts.

preprint2016arXiv

Surveying college introductory physics students' attitudes and approaches to problem solving

Students' attitudes and approaches to problem solving in physics can greatly impact their actual problem solving practices and also influence their motivation to learn and ultimately the development of expertise. We developed and validated an attitudes and approaches to problem solving (AAPS) survey and administered it to students in the introductory physics courses in a typical large research university in the US. Here, we discuss the development and validation of the survey and analysis of the student responses to the survey questions in introductory physics courses. The introductory physics students' responses to the survey questions were also compared with those of physics faculty members and physics PhD students. We find that introductory students are in general less expert-like than the physics faculty members and PhD students. Moreover, on some AAPS survey questions, the responses of students and faculty have unexpected trends. Those trends were interpreted via in

preprint2016arXiv

Surveying Graduate Students' Attitudes and Approaches to Problem Solving

Students' attitudes and approaches to problem solving in physics can profoundly influence their motivation to learn and development of expertise. We developed and validated an Attitudes and Approaches to Problem Solving survey by expanding the Attitudes towards Problem Solving survey of Marx and Cummings and administered it to physics graduate students. Comparison of their responses to the survey questions about problem solving in their own graduate level courses vs. problem solving in the introductory physics courses provides insight into their expertise in introductory and graduate level physics. The physics graduate students' responses to the survey questions were also compared with those of introductory physics and astronomy students and physics faculty. We find that, even for problem solving in introductory physics, graduate students' responses to some survey questions are less expert-like than those of the physics faculty. Comparison of survey responses of graduate students and introductory students for problem solving in introductory physics suggests that graduate students' responses are in general more expert-like than those of introductory students. However, survey responses suggest that graduate-level problem solving by graduate students on several measures has remarkably similar trends to introductory-level problem solving by introductory students.

preprint2016arXiv

Surveying Instructors' Attitudes and Approaches to Teaching Quantum Mechanics

Understanding instructor attitudes and approaches to teaching quantum mechanics can be helpful in developing research-based learning tools. Here we discuss the findings from a survey in which 13 instructors reflected on issues related to quantum mechanics teaching. Topics included opinions about the goals of a quantum mechanics course, general challenges in teaching the subject, student preparation for the course, comparison between their own learning of quantum mechanics vs. how they teach it and the extent to which contemporary topics are incorporated into the syllabus.

preprint2016arXiv

Surveying Students' Understanding of Quantum Mechanics

Development of conceptual multiple-choice tests related to a particular physics topic is important for designing research-based learning tools to reduce the difficulties. We explore the difficulties that the advanced undergraduate and graduate students have with non-relativistic quantum mechanics of one particle in one spatial dimension. We developed a research-based conceptual multiple-choice survey that targets these issues to obtain information about the common difficulties and administered it to more than a hundred students from seven different institutions. The issues targeted in the survey include the set of possible wavefunctions, bound and scattering states, quantum measurement, expectation values, the role of the Hamiltonian, time-dependence of wavefunction and time-dependence of expectation value. We find that the advanced undergraduate and graduate students have many common difficulties with these concepts and that research-based tutorials and peer-instruction tools can significantly reduce these difficulties. The survey can be administered to assess the effectiveness of various intructional strategies.

preprint2016arXiv

Surveying students' understanding of quantum mechanics in one spatial dimension

We explore the difficulties that advanced undergraduate and graduate students have with non-relativistic quantum mechanics of a single particle in one spatial dimension. To investigate these difficulties we developed a conceptual survey and administered it to more than 200 students at 10 institutions. The issues targeted in the survey include the set of possible wavefunctions, bound and scattering states, quantum measurement, expectation values, the role of the Hamiltonian, and the time-dependence of the wavefunction and expectation values. We find that undergraduate and graduate students have many common difficulties with these concepts and that research-based tutorials and peer-instruction tools can significantly reduce these difficulties. The findings also suggest that graduate quantum mechanics courses may not be effective at helping students to develop a better conceptual understanding of these topics, partly because such courses mainly focus on quantitative assessments.

preprint2016arXiv

Surveying Turkish high school and university student attitudes and approaches to physics problem solving

Student attitudes and approaches to problem solving can impact how well they learn physics. Prior research in the US using a validated Attitude and Approaches to Problem Solving (AAPS) survey suggests that there are major differences between students in introductory physics and astronomy courses and physics experts in terms of their attitudes and approaches to physics problem solving. Here we discuss the validation, administration and analysis of data for the Turkish version of the AAPS survey for high school and university students in Turkey. After the validation and administration of the Turkish version of the survey, the analysis of the data was conducted by grouping the data by grade level, school type, and gender. While there are no statistically significant differences between the averages of various groups on the survey, overall, the university students in Turkey were more expert-like than vocational high school students. On an item by item basis, there are statistically differences between the averages of the groups on many items. For example, on average, the university students demonstrated less expert-like attitudes about the role of equations and formulas in problem solving, in solving difficult problems, and in knowing when the solution is not correct, whereas they displayed more expert-like attitudes and approaches on items related to meta-cognition in physics problem solving. A principal component analysis on the data yields item clusters into which the student responses on various survey items can be grouped. A comparison of the responses of the Turkish and American university students enrolled in algebra-based introductory physics courses shows that on more than half of the items, the responses of these two groups were statistically significantly different with the US students on average responding to the items in more expert-like manner.

preprint2016arXiv

TA-designed vs. research-oriented problem solutions

In order to study graduate teaching assistants (TAs) beliefs and values about the design of instructor problem solutions, twenty-four TAs were provided with different solutions and asked to discuss their preferences for prominent solution features. TAs preferences for solution features were examined in light of the modeling of expert-like problem solving process as recommended in the literature. Results suggest that while many of the features TAs valued align with expert-like problem solving approaches, they noticed primarily "surface features" of solutions. Moreover, self-reported preferences did not match well with the solutions TAs wrote on their own.

preprint2016arXiv

Teaching assistants' beliefs regarding example solutions in introductory physics

As part of a larger study to understand instructors' considerations regarding the learning and teaching of problem solving in an introductory physics course, we investigated beliefs of first-year graduate teaching assistants (TAs) regarding the use of example solutions in introductory physics. In particular, we examine how the goal of promoting expert-like problem solving is manifested in the considerations of graduate TAs choices of example solutions. Twenty-four first-year graduate TAs were asked to discuss their goals for presenting example solutions to students. They were also provided with different example solutions and asked to discuss their preferences for prominent solution features. TAs' awareness, preferences and actual practices related to solution features were examined in light of recommendations from the literature for the modeling of expert-like problem solving approaches. The study concludes that the goal of helping students develop an expert-like problem solving approach underlies many TAs' considerations for the use of example solutions. TAs, however, do not notice and do not use many features described in the research literature as supportive of this goal. A possible explanation for this gap between their belief and practices is that these features conflict with another powerful set of values concerned with keeping students engaged, setting adequate standards, as well as pragmatic considerations such as time requirements and the assignment of grades.

preprint2016arXiv

The challenge of engaging all students via self-paced interactive e-learning tutorials for introductory physics

As research-based self-paced e-learning tools become increasingly available, a critical issue educators encounter is implementing strategies to ensure that all students engage with them as intended. Here, we discuss the effectiveness of research-based e-learning tutorials as self-paced learning tools in large enrollment brick and mortar introductory physics courses. These interactive tutorials were developed via research in physics education and were found to be effective for a diverse group of introductory physics students in one-on-one implementation. Instructors encouraged the use of these self-paced tools in a self-paced learning environment by telling students that they would be helpful for solving the assigned homework problems and that the underlying physics principles in the tutorial problems would be similar to those in the in-class quizzes (which we call paired problems). We find that many students, who struggled in the courses in which these adaptive e-learning tutorials were assigned as a self-study tool, performed poorly on the paired problems. In contrast, a majority of student volunteers in one-on-one implementation greatly benefited from the tutorials and performed well on the paired problems. This suggests that many students enrolled in introductory physics courses did not effectively engage with the self-paced tutorials outside of class and may have only used them superficially. The findings suggest that many students in need of out-of-class remediation via self-paced learning tools may have difficulty motivating themselves and may lack the self-regulation and time-management skills to engage effectively with tools specially designed to help them learn at their own pace. We conclude by proposing a theoretical framework to help students with diverse prior preparations engage effectively with self-study tools.

preprint2016arXiv

The group administered interactive questionnaire: An alternative to individual interviews

Individual interviews are often considered to be the gold standard for researchers to understand how people think about phenomena. However, conducting and analyzing interviews is very time consuming. This paper presents the Group Administered Interactive Questionnaire (GAIQ) as an alternative to individual interviews and discusses the pros and cons of each data collection method. Use of GAIQ will be discussed in the context of a study that seeks to understand teaching assistants' reasons for the design of problem solutions for introductory physics.

preprint2016arXiv

To use or no to use diagrams: The effect of drawing a diagram in solving introductory physics problems

Drawing appropriate diagrams is a useful problem solving heuristic that can transform a give problem into a representation that is easier to exploit for solving it. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing a diagram facilitates problem solution. We conducted an investigation in which 111 students in an algebra-based introductory physics course were subjected to two different interventions during recitation quizzes throughout the semester. They were either (1) asked to solve problems in which the diagrams were drawn for them or (2) explicitly told to draw a diagram. A comparison group was not given any instruction regarding diagrams. We developed a rubric to score the problem-solving performance of students in different intervention groups. We investigated two problems involving electric field and electric force and found that students who draw expert-like diagrams are more successful problem solvers and that a higher level of detail in a student's diagram corresponds to a better score.

preprint2016arXiv

Transfer of Learning in Quantum Mechanics

We investigate the difficulties that undergraduate students in quantum mechanics courses have in transferring learning from previous courses or within the same course from one context to another by administering written tests and conducting individual interviews. Quantum mechanics is abstract and its paradigm is very different from the classical one. A good grasp of the principles of quantum mechanics requires creating and organizing a knowledge structure consistent with the quantum postulates. Previously learned concepts such as the principle of superposition and probability can be useful in quantum mechanics if students are given opportunity to build associations between new and prior knowledge. We also discuss the need for better alignment between quantum mechanics and modern physics courses taken previously because semi-classical models can impede internalization of the quantum paradigm in more advanced courses.

preprint2016arXiv

Using an Isomorphic Problem Pair to Learn Introductory Physics: Transferring from a Two-step Problem to a Three-step Problem

In this study, we examine introductory physics students' ability to perform analogical reasoning between two isomorphic problems which employ the same underlying physics principles but have different surface features. Three hundred and eighty two students from a calculus-based and an algebra-based introductory physics course were asked to learn from a solved problem provided and take advantage of what they learned from it to solve another isomorphic problem (which we call the quiz problem). The solved problem provided has two sub-problems while the quiz problem has three sub-problems, which is known to be challenging for introductory students from previous research. In addition to the solved problem, students also received extra scaffolding supports that were intended to help them discern and exploit the underlying similarities of the isomorphic solved and quiz problems. The results suggest that students had great difficulty in transferring what they learned from a 2-step problem to a 3-step problem. Although most students were able to learn from the solved problem to some extent with the scaffolding provided and invoke the relevant principles in the quiz problem, they were not necessarily able to apply the principles correctly. We also conducted think-aloud interviews with 6 introductory students in order to understand in-depth the difficulties they had and explore strategies to provide better scaffolding. The interviews suggest that students often superficially mapped the principles employed in the solved problem to the quiz problem without necessarily understanding the governing conditions underlying each principle and examining the applicability of the principle in the new situation in an in-depth manner. Findings suggest that more scaffolding is needed to help students in transferring from a two-step problem to a three step problem and applying the physics principles appropriately.

preprint2016arXiv

Using Analogical Problem Solving with Different Scaffolding Supports to Learn about Friction

Prior research suggests that many students believe that the magnitude of the static frictional force is always equal to its maximum value. Here, we examine introductory students' ability to learn from analogical reasoning (with different scaffolding supports provided) between two problems that are similar in terms of the physics principle involved but one problem involves static friction, which often triggers the misleading notion. To help students process through the analogy deeply and contemplate whether the static frictional force was at its maximum value, students in different recitation classrooms received different scaffolding support. We discuss students' performance in different groups.

preprint2016arXiv

Using Analogies to Learn Introductory Physics

Identifying the relevant physics principles is a central component of problem solving. A major goal of most introductory physics courses is to help students discern the deep similarities between problems based upon the physics principles so that they can transfer what they learned by solving one problem to solve another problem which involves the same principle. We conducted an investigation in which 251 calculus- and algebra-based introductory physics students were asked explicitly in the recitation quiz to learn from a solved problem and then solve another problem that has different surface features but the same underlying physics principles. We find that many students were able to discern the deep similarities between the problems. When the solved problem was provided, students were likely to invoke the correct principles; however, more scaffolding is needed to help students apply these principles correctly.

preprint2016arXiv

Using Analogy to Solve a Three-Step Physics Problem

In a companion paper, we discuss students' ability to take advantage of what they learn from a solved problem and transfer their learning to solve a quiz problem that has different surface features but the same underlying physics principles. Here, we discuss students' ability to perform analogical reasoning between another pair of problems. Both the problems can be solved using the same physics principles. However, the solved problem provided was a two- step problem (which can be solved by decomposing it into two sub-problems) while the quiz problem was a three-step problem. We find that it is challenging for students to extend what they learned from a two-step problem to solve a three-step problem.

preprint2016arXiv

Using Categorization of Problems as an Instructional Tool to Help Introductory Students Learn Physics

The ability to categorize problems based upon underlying principles, rather than contexts, is considered a hallmark of expertise in physics problem solving. With inspiration from a classic study by Chi, Feltovich, and Glaser, we compared the categorization of 25 introductory mechanics problems based upon similarity of solution by students in large calculus-based introductory courses with physics faculty and Ph.D. students. Here, we summarize the study and suggest that a categorization task, especially when conducted with students working with peers in small groups, can be an effective pedagogical tool to help students in introductory physics courses learn to discern the underlying similarity between problems with diverse contexts but the same underlying physics principles.

preprint2016arXiv

Using Isomorphic Problems to Learn Introductory Physics

In this study, we examine introductory physics students' ability to perform analogical reasoning between two isomorphic problems which employ the same underlying physics principles but have different surface features. Three hundred and sixty two students from a calculus-based and an algebra-based introductory physics course were given a quiz in the recitation in which they had to first learn from a solved problem provided and take advantage of what they learned from it to solve another problem (which we call the quiz problem) which was isomorphic. Previous research suggests that the multiple-concept quiz problem is challenging for introductory students. Students in different recitation classes received different interventions in order to help them discern and exploit the underlying similarities of the isomorphic solved and quiz problems. We also conducted think-aloud interviews with four introductory students in order to understand in-depth the difficulties they had and explore strategies to provide better scaffolding. We found that most students were able to learn from the solved problem to some extent with the scaffolding provided and invoke the relevant principles in the quiz problem. However, they were not necessarily able to apply the principles correctly. Research suggests that more scaffolding is needed to help students in applying these principles appropriately. We outline a few possible strategies for future investigation.

preprint2016arXiv

Using Reflection with Peers to Help Students Learn Effective Problem Solving Strategies

We describe a study in which introductory physics students engage in reflection with peers about problem solving. The recitations for an introductory physics course with 200 students were broken into the "Peer Reflection" (PR) group and the traditional group. Each week in recitation, students in the PR group reflected in small teams on selected problems from the homework. The graduate and undergraduate teaching assistants (TAs) in the PR group recitations provided guidance and coaching to help students learn effective problem solving heuristics. In the recitations for the traditional group, students had the opportunity to ask the graduate TA questions about the homework before they took a weekly quiz. On the final exam with only multiple-choice questions, the PR group drew diagrams on more problems than the traditional group, even when there was no external reward for doing so. Since there was no partial credit for drawing the diagrams on the scratch books, students did not draw diagrams simply to get credit for the effort shown and must value the use of diagrams for solving problems if they drew them. We also find that, regardless of whether the students belonged to the traditional or PR groups, those who drew more diagrams for the multiple-choice questions outperformed those who did not draw them.

preprint2016arXiv

What Can Learn from PER: Physics Education Research?

I believe that most teachers develop a belief in a set of pedagogical practices. As we teach, we try different ways to teach topics and then judge how successful the methods were. After several years, we have a compilation of techniques in our teaching toolbox. New teachers are at a disadvantage because they have fewer prior experiences to draw upon. Luckily, there is a group of physicists and physics educators who are researching how students learn physics, and have been able to show evidence of effective education practices in physics. They field of study is called PER: Physics Education Research. I asked Chandralekha Singh, one of the leaders in PER, to summarize some of the most relevant PER findings and her response follows.

preprint2016arXiv

When physical intuition fails

We analyze the problem solving strategies of physics professors in a case where their physical intuition fails. A non-intuitive introductory-level problem was identified and posed to twenty physics professors. The problem placed the professors in a situation often encountered by students, and their response highlights the importance of intuition and experience in problem solving. While professors had difficulty in solving the problem under the time constraint, they initially employed a systematic approach, e.g., visualizing the problem, considering various conservation laws, and examining limiting cases. After finding that familiar techniques were not fruitful, they made incorrect predictions based on one of two equally important factors. By contrast, other more familiar problems that require the consideration of two important principles (e.g., conservation of both energy and momentum for a ballistic pendulum) are quickly solved by the same professors. The responses of students who were given the same problem reflected no overarching strategies or systematic approaches, and a much wider variety of incorrect responses were given. This investigation highlights the importance of teaching effective problem solving heuristics, and suggests that instructors assess the difficulty of a problem from the perspective of beginning students.

preprint2016arXiv

Women in physics in the United States: recruitment and retention

Initiatives to increase the number, persistence, and success of women in physics in the US reach pre-teen girls through senior women. Programs exist at both the local and national levels. In addition, researchers have investigated issues related to gender equity in physics and physics education. Anecdotal evidence suggests increased media coverage of the underrepresentation of women in science. All of these efforts are both motivated and made more effective by the collection and presentation of data on the presence, persistence, and promise of women in physics.

preprint2015arXiv

A Framework for Understanding the Patterns of Student Reasoning Difficulties in Quantum Mechanics

Compared with introductory physics, relatively little is known about the development of expertise in advanced physics courses, especially in the case of quantum mechanics. Here, we describe a framework for understanding the patterns of student reasoning difficulties and how students develop expertise in quantum mechanics. The framework posits that the challenges many students face in developing expertise in quantum mechanics are analogous to the challenges introductory students face in developing expertise in introductory classical mechanics. This framework incorporates both the diversity in upper-level students' prior preparation, goals, and motivation in general (i.e., the facts that even in upper-level courses, students may be inadequately prepared, have unclear goals, and have insufficient motivation to excel) as well as the "paradigm shift" from classical mechanics to quantum mechanics. The framework is based on empirical investigations demonstrating that the patterns of reasoning, problem-solving, and self-monitoring difficulties in quantum mechanics bear a striking resemblance to those found in introductory classical mechanics. Examples from research in quantum mechanics and introductory classical mechanics are discussed to illustrate how the patterns of difficulties are analogous as students learn to unpack the respective principles and grasp the formalism in each knowledge domain during the development of expertise. Embracing such a framework and contemplating the parallels between the difficulties in these two knowledge domains can enable researchers to leverage the extensive literature for introductory physics education research to guide the design of teaching and learning tools for helping students develop expertise in quantum mechanics.

preprint2015arXiv

Analogous Patterns of Student Reasoning Difficulties in Introductory Physics and Upper-Level Quantum Mechanics

Very little is known about how the nature of expertise in introductory and advanced courses compares in knowledge-rich domains such as physics. We develop a framework to compare the similarities and differences between learning and patterns of student difficulties in introductory physics and quantum mechanics. Based upon our framework, we argue that the qualitative patterns of student reasoning difficulties in introductory physics bear a striking resemblance to those found for upper-level quantum mechanics. The framework can guide the design of teaching and learning tools.

preprint2015arXiv

Developing an Interactive Tutorial on a Mach-Zehnder Interferometer with Single Photons

We are developing a Quantum Interactive Learning Tutorial (QuILT) on a Mach-Zehnder Interferometer with single photons to expose upper-level students in quantum mechanics courses to contemporary applications. The QuILT strives to help students develop the ability to apply fundamental quantum principles to physical situations and explore differences between classical and quantum ideas. The QuILT adapts visualization tools to help students build physical intuition about quantum phenomena and focuses on helping them integrate qualitative and quantitative understanding. We also discuss findings from a preliminary in-class evaluation.

preprint2015arXiv

Developing an Interactive Tutorial on a Quantum Eraser

We are developing a quantum interactive learning tutorial (QuILT) on a quantum eraser for students in upperlevel quantum mechanics. The QuILT exposes students to contemporary topics in quantum mechanics and uses a guided approach to learning. It adapts existing visualization tools to help students build physical intuition about quantum phenomena and strives to help them develop the ability to apply quantum principles in physical situations. The quantum eraser apparatus in the gedanken (thought) experiments and simulations that students learn from in the QuILT uses a MachZehnder Interferometer with single photons. We also discuss findings from a preliminary in-class evaluation.

preprint2015arXiv

Developing and evaluating a tutorial on the double-slit experiment

Learning quantum mechanics is challenging, even for upper-level undergraduate and graduate students. Interactive tutorials which build on students' prior knowledge can be useful tools to enhance student learning. We have been investigating student difficulties with the quantum mechanics pertaining to the double-slit experiment in various situations. Here we discuss the development and evaluation of a Quantum Interactive Learning Tutorial (QuILT) which makes use of an interactive simulation to improve student understanding. We summarize common difficulties and discuss the extent to which the QuILT is effective in addressing them in two types of courses.

preprint2015arXiv

Investigating Student Difficulties with Dirac Notation

Quantum mechanics is challenging even for advanced undergraduate and graduate students. Dirac notation is a convenient notation used extensively in quantum mechanics. We have been investigating the difficulties that the advanced undergraduate and graduate students have with Dirac notation. We administered written free response and multiple-choice questions to students and also conducted semi-structured individual interviews with 23 students using a think-aloud protocol to obtain a better understanding of the rationale behind their responses. We find that many students struggle with Dirac notation and they are not consistent in using this notation across various questions in a given test. In particular, whether they answer questions involving Dirac notation correctly or not is context dependent.

preprint2015arXiv

Investigating Student Difficulties with Time dependence of Expectation Values in Quantum Mechanics

Quantum mechanics is challenging even for advanced undergraduate and graduate students. In the Schrödinger representation, the wave function evolves in time according to the time dependent Schrödinger equation. The time dependence of the wave function gives rise to time dependence of the expectation value of observables. We have been exploring the difficulties that advanced undergraduate and graduate students have with time dependence of expectation values in quantum mechanics. We have developed and administered conceptual free response and multiple-choice questions to students to investigate these difficulties. We also interviewed 23 students individually using a think-aloud protocol to obtain a better understanding of the rationale behind students' written responses. We find that many students struggle with time dependence of expectation values of observables. We discuss some findings.

preprint2015arXiv

Student difficulties with quantum states while translating state vectors in Dirac notation to wave functions in position and momentum representations

We administered written free-response and multiple-choice questions and conducted individual interviews to investigate the difficulties that upper-level undergraduate and graduate students have with quantum states while translating state vectors in Dirac notation to wave functions in position and momentum representations. We find that students share common difficulties with translating a state vector written in Dirac notation to the wave function in position or momentum representation.

preprint2015arXiv

Student difficulties with the probability distribution for measuring energy and position in quantum mechanics

We have been investigating the difficulties that students in upper-level undergraduate courses have in determining the probability distribution for measuring energy and position as a function of time when the initial wave function is explicitly given. We administered written free-response and multiple-choice questions to investigate these difficulties. We find that students have common difficulties with these concepts. We discuss some of the findings.

preprint2015arXiv

The effect of giving explicit incentives to correct mistakes on subsequent problem solving in quantum mechanics

One attribute of experts is that they are likely to learn from their own mistakes. Experts are unlikely to make the same mistakes when asked to solve a problem a second time, especially if they had access to a correct solution. Here, we discuss a study spanning several years in which advanced undergraduate physics students in a quantum mechanics course were given incentives to correct their mistakes in the midterm exam and they could get back up to 50% of the points lost on each midterm exam problem. The solutions to the midterm exam problems were provided to all students in both groups but those who corrected their mistakes were provided the solution after they submitted their corrections to the instructor. The performance on the final exam on the same problems suggests that students who were given incentives to correct their mistakes significantly outperformed those who were not given an incentive. The incentive to correct mistakes had the greatest impact on the final exam performance of students who performed poorly on the midterm exam.

preprint2013arXiv

Exploring Pedagogical Content Knowledge of Physics Instructors and Teaching Assistants Using the Force Concept Inventory

The Force Concept Inventory (FCI) has been widely used to assess student understanding of introductory mechanics concepts by a variety of educators and physics education researchers. One reason for this extensive use is that many of the items on the FCI have strong distractor choices that correspond to students' alternate conceptions in mechanics. Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account students' initial knowledge state in their instructional design. Here, we discuss research involving the FCI to evaluate the pedagogical content knowledge of both instructors and teaching assistants (TAs) of varying teaching experience. For each item on the FCI, the instructors and TAs were asked to identify the most common incorrect answer choice of introductory physics students. We also discussed the responses individually with a few instructors. Then, we used the FCI pre-test and post-test data from a large population (~900) of introductory physics students to assess the pedagogical content knowledge of physics instructors and TAs. We find that while both physics instructors and TAs, on average, performed better than random guessing at identifying introductory students' difficulties with FCI content, they did not identify many common difficulties that introductory physics students have, even after traditional instruction. Moreover, the ability to correctly identify students' difficulties was not correlated with the teaching experience of the physics instructors.

preprint2013arXiv

Exploring Pedagogical Content Knowledge of Teaching Assistants Using the Test of Understanding Graphs in Kinematics

The Test of Understanding Graphs in Kinematics (TUG-K) is a multiple choice test developed by Beichner in 1994 to assess students' understanding of kinematics graphs. Many of the items on the TUG-K have strong distractor choices which correspond to students' common difficulties with kinematics graphs. Instruction is unlikely to be effective if instructors do not know the common difficulties of introductory physics students and explicitly take them into account in their instructional design. We evaluate the pedagogical content knowledge of first year physics graduate students enrolled in a teaching assistant (TA) training course related to topics covered in the TUG-K. In particular, for each item on the TUG-K, the graduate students were asked to identify which incorrect answer choice they thought would be most commonly selected by introductory physics students if they did not know the correct answer after instruction in relevant concepts. We used the graduate student data and the data from Beichner's original paper for introductory physics students to assess the relevant pedagogical content knowledge (PCK) of the graduate students. We find that, although the graduate students, on average, performed better than random guessing at identifying introductory student difficulties on the TUG-K, they did not identify many common difficulties that introductory students have with graphs in kinematics even after traditional instruction. In addition, we find that the ability of graduate students to identify the difficulties of introductory students is context dependent.