Source author record

Marcos D. Caballero

Marcos D. Caballero appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

34works
3topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

34 published item(s)

preprint2021arXiv

Predictive and explanatory models might miss informative features in educational data

We encounter variables with little variation often in educational data mining (EDM) due to the demographics of higher education and the questions we ask. Yet, little work has examined how to analyze such data. Therefore, we conducted a simulation study using logistic regression, penalized regression, and random forest. We systematically varied the fraction of positive outcomes, feature imbalances, and odds ratios. We find the algorithms treat features with the same odds ratios differently based on the features' imbalance and the outcome imbalance. While none of the algorithms fully solved how to handle imbalanced data, penalized approaches such as Firth and Log-F reduced the difference between the built-in odds ratio and value determined by the algorithm. Our results suggest that EDM studies might contain false negatives when determining which variables are related to an outcome. We then apply our findings to a graduate admissions data set. We end by proposing recommendations that researchers should consider penalized regression for data sets on the order of hundreds of cases and should include more context about their data in publications such as the outcome and feature imbalances.

preprint2020arXiv

Predicting time to graduation at a large enrollment American university

The time it takes a student to graduate with a university degree is mitigated by a variety of factors such as their background, the academic performance at university, and their integration into the social communities of the university they attend. Different universities have different populations, student services, instruction styles, and degree programs, however, they all collect institutional data. This study presents data for 160,933 students attending a large American research university. The data includes performance, enrollment, demographics, and preparation features. Discrete time hazard models for the time-to-graduation are presented in the context of Tinto's Theory of Drop Out. Additionally, a novel machine learning method: gradient boosted trees, is applied and compared to the typical maximum likelihood method. We demonstrate that enrollment factors (such as changing a major) lead to greater increases in model predictive performance of when a student graduates than performance factors (such as grades) or preparation (such as high school GPA).

preprint2020arXiv

Thematic Analysis of 18 Years of PERC Proceedings using Natural Language Processing

We have used an unsupervised machine learning method called Latent Dirichlet Allocation (LDA) to thematically analyze all papers published in the Physics Education Research Conference Proceedings between 2001 and 2018. By looking at co-occurrences of words across the data corpus, this technique has allowed us to identify ten distinct themes or "topics" that have seen varying levels of prevalence in Physics Education Research (PER) over time and to rate the distribution of these topics within each paper. Our analysis suggests that although all identified topics have seen sustained interest over time, PER has also seen several waves of increased interest in certain topics, beginning with initial interest in qualitative, theory-building studies of student understanding, which has given way to a focus on problem solving in the late 2010s. Since 2010 the field has seen a shift towards more sociocultural views of teaching and learning with a particular focus on communities of practice, student identities, and institutional change. Based on these results, we suggest that unsupervised text analysis techniques like LDA may hold promise for providing quantitative, independent, and replicable analyses of educational research literature.

preprint2019arXiv

Computational Essays: An Avenue for Scientific Creativity in Physics

Computation holds great potential for introducing new opportunities for creativity and exploration into the physics curriculum. At the University of Oslo we have begun development of a new class of assignment called computational essays to help facilitate creative, open-ended computational physics projects. Computational essays are a type of essay or narrative that combine text and code to express an idea or make an argument, usually written in computational notebooks. During a pilot implementation of computational essays in an introductory electricity and magnetism course, students reported that computational essays facilitated creative investigation at a variety of levels within their physics course. They also reported finding this creativity as being both challenging and motivating. Based on these reflections, we argue that computational essays are a useful tool for leveraging the creative affordances of programming in physics education.

preprint2019arXiv

Physics Computational Literacy: An Exploratory Case Study Using Computational Essays

Computation is becoming an increasingly important part of physics education. However, there are currently few theories of learning that can be used to help explain and predict the unique challenges and affordances associated with computation in physics. In this study, we adapt the existing theory of computational literacy, which posits that computational learning can be divided into material, cognitive, and social aspects, to the context of undergraduate physics. Based on an exploratory study of undergraduate physics computational literacy, using a newly-developed teaching tool known as a computational essay, we have identified a variety of student practices, knowledge, and beliefs across these three aspects of computational literacy. We illustrate these categories with data collected from students who engaged in an initial implementation of computational essays in an introductory electricity and magnetism class. We conclude by arguing that this framework can be used to theoretically diagnose student difficulties with computation, distinguish educational approaches that focus on material vs. cognitive aspects of computational literacy, and highlight the benefits and limitations of open-ended projects like computational essays to student learning.

preprint2019arXiv

Using machine learning to understand physics graduate school admissions

Among all of the first-year graduate students enrolled in doctoral-granting physics departments, the percentage of female and racial minority students has remained unchanged for the past 20 years. The current graduate program admissions process can create challenges for achieving diversity goals in physics. In this paper, we will investigate how the various aspects of a prospective student's application to a physics doctoral program affect the likelihood the applicant will be admitted. Admissions data was collected from a large, Midwestern public research university that has a decentralized admissions process and included applicants' undergraduate GPAs and institutions, research interests, and GRE scores. Because the collected data varied in scale, we used supervised machine learning algorithms to create models that predict who was admitted into the PhD program. We find that using only the applicant's undergraduate GPA and physics GRE score, we are able to predict with 75% accuracy who will be admitted to the program.

preprint2018arXiv

Denoting and Comparing Leadership Attributes and Behaviors in Group Work

Projects and Practices in Physics (P$^3$) is an introductory physics class at Michigan State University that replaces lectures with a problem based learning environment. To promote the development of group based practices, students all receive group and individual feedback at the end of each week. The groups are comprised of four students, one of which often takes on the role of being the group's "leader." Developing leadership based skills is a specific learning goal of the P$^3$ learning environment and the goal of this research is to examine what leadership-specific actions/traits students in P$^3$ demonstrate while working in their group. The initial phase of this study examined multiple pieces of literature to identify possible characteristics and behaviors that may present themselves in potential leaders -- creating a codebook. This phase of the study applies the codebook to in-class data to compare two tutor-labeled leaders and their leadership styles.

preprint2018arXiv

Examining the relationship between student performance and video interactions

In this work, we attempted to predict student performance on a suite of laboratory assessments using students' interactions with associated instructional videos. The students' performance is measured by a graded presentation for each of four laboratory presentations in an introductory mechanics course. Each lab assessment was associated with between one and three videos of instructional content. Using video clickstream data, we define summary features (number of pauses, seeks) and contextual information (fraction of time played, in-semester order). These features serve as inputs to a logistic regression (LR) model that aims to predict student performance on the laboratory assessments. Our findings show that LR models are unable to predict student performance. Adding contextual information did not change the model performance. We compare our findings to findings from other studies and explore caveats to the null-result such as representation of the features, the possibility of underfitting, and the complexity of the assessment.

preprint2018arXiv

The difficulties associated with integrating computation into undergraduate physics

From a department being resistant to change to students not buying into the new computational activities, the challenges that are faced with integrating computation into the physics undergraduate curriculum are varied. The Partnership for Integration of Computation into Undergraduate Physics (PICUP) aims to expand the role of computation in the undergraduate physics curriculum. The research presented in this paper is part of a larger project examining the role of the PICUP workshop in facilitating both the integration of computation into classrooms and developing a supportive community to support this integration. An important part of providing the necessary supports for integration is understanding and categorizing the problems members of this community of integrators face when integrating computation in their courses. Through individual and group interviews, we discuss the barriers to integration that new and experienced community members of PICUP have experienced in the past or perceive could exist in the future.

preprint2016arXiv

Characterizing College Science Assessments: The Three-Dimensional Learning Assessment Protocol

Many calls to improve science education in college and university settings have focused on improving instructor pedagogy. Meanwhile, science education at the K-12 level is undergoing significant changes as a result of the emphasis on scientific and engineering practices, crosscutting concepts, and disciplinary core ideas. This framework of "three-dimensional learning" is based on the literature about how people learn science and how we can help students put their knowledge to use. Recently, similar changes are underway in higher education by incorporating three-dimensional learning into college science courses. As these transformations move forward, it will become important to assess three-dimensional learning both to align assessments with the learning environment, and to assess the extent of the transformations. In this paper we introduce the Three-Dimensional Learning Assessment Protocol (3D-LAP), which is designed to characterize and support the development of assessment tasks in biology, chemistry, and physics that align with transformation efforts. We describe the development process used by our interdisciplinary team, discuss the validity and reliability of the protocol, and provide evidence that the protocol can distinguish between assessments that have the potential to elicit evidence of three-dimensional learning and those that do not.

preprint2015arXiv

A Case Study: Novel Group Interactions through Introductory Computational Physics

With the advent of high-level programming languages capable of quickly rendering three-dimensional simulations, the inclusion of computers as a learning tool in the classroom has become more prevalent. Although work has begun to study the patterns seen in implementing and assessing computation in introductory physics, more insight is needed to understand the observed effects of blending computation with physics in a group setting. In a newly adopted format of introductory calculus-based mechanics, called Projects and Practices in Physics, groups of students work on short modeling projects -- which make use of a novel inquiry-based approach -- to develop their understanding of both physics content and practice. Preliminary analyses of observational data of groups engaging with computation, coupled with synchronized computer screencast, has revealed a unique group interaction afforded by the practices specific to computational physics -- problem debugging.

preprint2015arXiv

Computation across the curriculum: What skills are needed?

Computation, the use of a computer to solve, simulate, or visualize a physical problem, has revolutionized how physics research is done. Computation is used widely to model systems, to simulate experiments, and to analyze data. Yet, in most undergraduate programs, students have little formal opportunity to engage with computation and, thus, are left to their own to develop their computational expertise. As part of a larger project to study how computation is incorporated in some undergraduate physics programs (and how it might be incorporated further), we convened a mini-conference and conducted a series of interviews with industry professionals, academic faculty, and employed bachelor's graduates who make use of computation in their everyday work. We present preliminary results that speak to how participants developed the requisite skills to do professional computational work and what skills they perceive are necessary to conduct such work.

preprint2015arXiv

Developing the Next Generation of Physics Assessments

Science education at all levels is currently undergoing dramatic changes to its curricula and developing assessments for these new curricula is paramount. We have used the basis of many of these new changes (scientific practices, crosscutting concepts, and core ideas) to develop sets of criteria that can be used to guide assessment development for this new curriculum. We present a case study that uses the criteria we have developed to revise a traditional physics assessment item into an assessment item that is much more aligned with the goals of current transformation efforts. Assessment items developed using this criteria can be used to assess student learning of both the concepts and process of science.

preprint2015arXiv

Unpacking Students' Use of Mathematics in Upper-division Physics

In their study of physics beyond the first year of University -- termed upper-division in the US, many of students' primary learning opportunities come from working long, complex back-of-the-book style problems, and from trying to develop an understanding of the underlying physics through solving such problems. Some of the research at the upper-division focuses on how students use mathematics in these problems, and what challenges students encounter along the way. There are a number of different and diverse research studies on students' use of mathematics in the upper-division. These typically utilize one of two broad approaches, with some researchers primarily seeking out and addressing challenges students face, and others working chiefly to unpack students' in-the-moment reasoning. In this paper, we present and discuss both approaches, and then review research efforts that strive to connect these two approaches in order to make sense of students' use of mathematics as well as to uncover particular challenges that students encounter. These recent efforts represent a small step towards synthesizing the two approaches, which we argue is necessary to more meaningfully impact student learning at the upper-division. We close our review and discussion with suggested refinements for future research questions for the physics education research community to consider while it works to understand how students use math in upper-division courses.

preprint2014arXiv

Analytic Framework for Students' Use of Mathematics in Upper-Division Physics

Many students in upper-division physics courses struggle with the mathematically sophisticated tools and techniques that are required for advanced physics content. We have developed an analytical framework to assist instructors and researchers in characterizing students' difficulties with specific mathematical tools when solving the long and complex problems that are characteristic of upper-division. In this paper, we present this framework, including its motivation and development. We also describe an application of the framework to investigations of student difficulties with direct integration in electricity and magnetism (i.e., Coulomb's Law) and approximation methods in classical mechanics (i.e., Taylor series). These investigations provide examples of the types of difficulties encountered by advanced physics students, as well as the utility of the framework for both researchers and instructors.

preprint2014arXiv

Development and Uses of Upper-division Conceptual Assessment

The use of validated conceptual assessments alongside more standard course exams has become standard practice for the introductory courses in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, and institutions. Researchers at the University of Colorado Boulder have developed several similar assessments designed to target the more advanced physics content of upper-division classical mechanics, electrostatics, quantum mechanics, and electrodynamics. Here, we synthesize the existing research on our upper-division assessments and discuss some of the barriers and challenges associated with developing, validating, and implementing these assessments as well as some of the strategies we have used to overcome these barriers.

preprint2014arXiv

Engaging Physics Faculty in Course Transformation

Research has shown that it is challenging to change departmental culture to support the adoption of transformed teaching practices. Michigan State University is working to transform its introductory physics courses by engaging faculty in discussions about the scientific practices and core ideas of the discipline, and to use those discussions to drive change to both assessments and classroom instruction. Here we discuss our model of change, its implementation in the Physics and Astronomy department, the challenges encountered along the way and how we've mitigated those challenges, and tools to measure the impact of this change.

preprint2014arXiv

Just Math: A new epistemic frame

A goal of PER is to understand how students use math in physics contexts. To investigate how students use math, we need to identify transitions between conceptual sense-making about physical systems and using mathematics to describe and to make predictions about those systems. We reviewed video of students solving a variety of physics problems in small groups through the lens of epistemic frames (e-frames). In this paper, we present a new e-frame, which we are calling "Just Math", that is similar to the Worksheet e-frame, but is characterized by brief, low-level, math-focused utterances between students. Future work will focus on analyzing the transitions into and out of this e-frame so that we may develop a more coherent understanding of students' use of math in physics.

preprint2014arXiv

Peer Evaluation of Video Lab Reports in an Introductory Physics MOOC

Assessing student performance becomes challenging when course enrollment becomes very large (~10^4 students). As part of a Massive Open Online Course (MOOC) in introductory physics offered by Georgia Tech in 2013, students submitted video reports on mechanics labs. Peer evaluation of these reports provided the primary method for evaluating student laboratory work. This paper describes the methods developed and used to guide students in evaluating each other's video lab reports. We also discuss how students' peer evaluation behavior changed with different interventions provided in the course.

preprint2014arXiv

Rubric Design for Separating the Roles of Open-Ended Assessments

End-of-course assessments play important roles in the ongoing attempt to improve instruction in physics courses. Comparison of students' performance on assessments before and after instruction gives a measure of student learning. In addition, analysis of students' answers to assessment items provides insight into students' difficulties with specific concepts and practices. While open-ended assessments scored with detailed rubrics provide useful information about student reasoning to researchers, end users need to score students' responses so that they may obtain meaningful feedback on their instruction. One solution that satisfies end users and researchers is a grading rubric that separates scoring student work and uncovering student difficulties. We have constructed a separable rubric for the Colorado Classical Mechanics/Math Methods Instrument that has been used by untrained graders to score the assessment reliably, and by researchers to unpack common student difficulties. Here we present rubric development, measures of inter-rater reliability, and some uncovered student difficulties.

preprint2013arXiv

A Model for Incorporating Computation Without Changing the Course: An example from middle-division classical mechanics

Much of the research done by modern physicists would be impossible without the use of computation. And yet, while computation is a crucial tool of practicing physicists, physics curricula do not generally reflect its importance and utility. To more tightly connect undergraduate preparation with professional practice, we integrated computational instruction into middle-division classical mechanics at the University of Colorado Boulder. Our model for integration works within the constraints of faculty who do not specialize in computation teaching standard physics courses by placing a strong emphasis on {an adaptable curriculum}. Our model includes the construction of computational learning goals, the design of computational activities consistent with those goals, and the assessment of students' computational fluency. We present critiques of our model as we work to develop an effective and sustainable model for computational instruction in the undergraduate curriculum

preprint2013arXiv

Assessing Student Learning in Middle-Division Classical Mechanics/Math Methods

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level Classical Mechanics and Math Methods course (CM 1) at CU Boulder, we are developing a tool to assess student learning of CM 1 concepts in the upper-division. The Colorado Classical Mechanics/Math Methods Instrument (CCMI) builds on faculty-consensus learning goals and systematic observations of student difficulties. The result is a 9-question open-ended post-test that probes student learning in the first half of a two-semester classical mechanics / math methods sequence. In this paper, we describe the design and development of this instrument, its validation, and measurements made in classes at CU Boulder.

preprint2013arXiv

Bridging Physics and Biology Teaching through Modeling

As the frontiers of biology become increasingly interdisciplinary, the physics education community has engaged in ongoing efforts to make physics classes more relevant to life sciences majors. These efforts are complicated by the many apparent differences between these fields, including the types of systems that each studies, the behavior of those systems, the kinds of measurements that each makes, and the role of mathematics in each field. Nonetheless, physics and biology are both sciences that rely on observations and measurements to construct models of the natural world. In the present theoretical article, we propose that efforts to bridge the teaching of these two disciplines must emphasize shared scientific practices, particularly scientific modeling. We define modeling using language common to both disciplines and highlight how an understanding of the modeling process can help reconcile apparent differences between the teaching of physics and biology. We elaborate how models can be used for explanatory, predictive, and functional purposes and present common models from each discipline demonstrating key modeling principles. By framing interdisciplinary teaching in the context of modeling, we aim to bridge physics and biology teaching and to equip students with modeling competencies applicable across any scientific discipline.

preprint2013arXiv

How can we improve problem-solving in undergraduate biology? Applying lessons from 30 years of physics education research

If students are to successfully grapple with authentic, complex biological problems as scientists and citizens, they need practice solving such problems during their undergraduate years. Physics education researchers have investigated student problem solving for the last three decades. Although physics and biology problems differ in structure and content, the instructional purposes align closely: explaining patterns and processes in the natural world and making predictions about physical and biological systems. In this paper, we discuss how research-supported approaches developed by physics education researchers can be adopted by biologists to enhance student problem-solving skills. First, we compare the problems that biology students are typically asked to solve with authentic, complex problems. We then describe the development of research-validated physics curricula emphasizing process skills in problem solving. We show that solving authentic, complex biology problems requires many of the same skills that practicing physicists and biologists use in representing problems, seeking relationships, making predictions, and verifying or checking solutions. We assert that acquiring these skills can help biology students become competent problem solvers. Finally, we propose how biology scholars can apply lessons from physics education in their classrooms and inspire new studies in biology education research. (To appear in Cell Biology Education - Life Sciences Education)

preprint2013arXiv

Integrating Numerical Computation into the Modeling Instruction Curriculum

We describe a way to introduce physics high school students with no background in programming to computational problem-solving experiences. Our approach builds on the great strides made by the Modeling Instruction reform curriculum. This approach emphasizes the practices of "Developing and using models" and "Computational thinking" highlighted by the NRC K-12 science standards framework. We taught 9th-grade students in a Modeling-Instruction-based physics course to construct computational models using the VPython programming environment. Numerical computation within the Modeling Instruction curriculum provides coherence among the curriculum's different force and motion models, links the various representations which the curriculum employs, and extends the curriculum to include real-world problems that are inaccessible to a purely analytic approach.

preprint2013arXiv

The Initial State of Students Taking an Introductory Physics MOOC

As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participation over the first five weeks of the eleven-week course.

preprint2012arXiv

ACER: A Framework on the Use of Mathematics in Upper-division Physics

At the University of Colorado Boulder, as part of our broader efforts to transform middle- and upper-division physics courses, we research students' difficulties with particular concepts, methods, and tools in classical mechanics, electromagnetism, and quantum mechanics. Unsurprisingly, a number of difficulties are related to students' use of mathematical tools (e.g., approximation methods). Previous work has documented a number of challenges that students must overcome to use mathematical tools fluently in introductory physics (e.g., mapping meaning onto mathematical symbols). We have developed a theoretical framework to facilitate connecting students' difficulties to challenges with specific mathematical and physical concepts. In this paper, we motivate the need for this framework and demonstrate its utility for both researchers and course instructors by applying it to frame results from interview data on students' use of Taylor approximations.

preprint2012arXiv

Comparing large lecture mechanics curricula using the Force Concept Inventory: A five thousand student study

The performance of over 5000 students in introductory calculus-based mechanics courses at the Georgia Institute of Technology was assessed using the Force Concept Inventory (FCI). Results from two different curricula were compared: a traditional mechanics curriculum and the Matter & Interactions (M&I) curriculum. Post-instruction FCI averages were significantly higher for the traditional curriculum than for the M&I curriculum; the differences between curricula persist after accounting for factors such as pre-instruction FCI scores, grade point averages, and SAT scores. FCI performance on categories of items organized by concepts was also compared; traditional averages were significantly higher in each concept. We examined differences in student preparation between the curricula and found that the relative fraction of homework and lecture topics devoted to FCI force and motion concepts correlated with the observed performance differences. Limitations of concept inventories as instruments for evaluating curricular reforms are discussed.

preprint2012arXiv

Implementing and assessing computational modeling in introductory mechanics

Students taking introductory physics are rarely exposed to computational modeling. In a one-semester large lecture introductory calculus-based mechanics course at Georgia Tech, students learned to solve physics problems using the VPython programming environment. During the term 1357 students in this course solved a suite of fourteen computational modeling homework questions delivered using an online commercial course management system. Their proficiency with computational modeling was evaluated in a proctored environment using a novel central force problem. The majority of students (60.4%) successfully completed the evaluation. Analysis of erroneous student-submitted programs indicated that a small set of student errors explained why most programs failed. We discuss the design and implementation of the computational modeling homework and evaluation, the results from the evaluation and the implications for instruction in computational modeling in introductory STEM courses.

preprint2012arXiv

Understanding Student Computational Thinking with Computational Modeling

Recently, the National Research Council's framework for next generation science standards highlighted "computational thinking" as one of its "fundamental practices". 9th Grade students taking a physics course that employed the Modeling Instruction curriculum were taught to construct computational models of physical systems. Student computational thinking was assessed using a proctored programming assignment, written essay, and a series of think-aloud interviews, where the students produced and discussed a computational model of a baseball in motion via a high-level programming environment (VPython). Roughly a third of the students in the study were successful in completing the programming assignment. Student success on this assessment was tied to how students synthesized their knowledge of physics and computation. On the essay and interview assessments, students displayed unique views of the relationship between force and motion; those who spoke of this relationship in causal (rather than observational) terms tended to have more success in the programming exercise.

preprint2012arXiv

Upper-division Student Understanding of Coulomb's Law: Difficulties with Continuous Charge Distributions

Utilizing the integral expression of Coulomb's Law to determine the electric potential from a continuous charge distribution is a canonical exercise in Electricity and Magnetism (E&M). In this study, we use both think-aloud interviews and responses to traditional exam questions to investigate student difficulties with this topic at the upper-division level. Leveraging a theoretical framework for the use of mathematics in physics, we discuss how students activate, construct, execute and reflect on the integral form of Coulomb's Law when solving problems with continuous charge distributions. We present evidence that junior-level E&M students have difficulty mapping physical systems onto the mathematical expression for the Coulomb potential. Common challenges include difficulty expressing the difference vector in appropriate coordinates as well as determining expressions for the differential charge element and limits of integration for a specific charge distribution. We discuss possible implications of these findings for future research directions and instructional strategies.

preprint2011arXiv

Extending and Evaluating and Novel Course Reform of introductory Mechanics

The research presented in this thesis was motivated by the need to improve introductory physics courses. Introductory physics courses are generally the first courses in which students learn to create models to solve complex problems. However, many students taking introductory physics courses fail to acquire a command of the concepts, methods and tools presented in these courses. The reforms proposed by this thesis focus on altering the content of introductory courses rather than content delivery methods as most reforms do. This thesis explores how the performance on a widely used test of conceptual understanding in mechanics compares between students taking a course with updated and modified content and students taking a traditional course. Better performance by traditional students was found to stem from their additional practice on the types of items which appeared on the test. The results of this work brought into question the role of the introductory physics course for non-majors. One aspect of this new role is the teaching of new methods such as computation (the use of a computer to solve numerically, simulate and visualize physical problems). This thesis explores the potential benefits for students who learn computation as part of physics course. After students worked through a suite of computational homework problems, many were able to model a new physical situation with which they had no experience. The failure of some students to model this new situation might have stemmed from their unfavorable attitudes towards learning computation. In this thesis, we present the development of a new tool for characterizing students' attitudes. Preliminary measurements indicated significant differences between successful and unsuccessful students.

preprint2011arXiv

Fostering Computational Thinking

Students taking introductory physics are rarely exposed to computational modeling. In a one-semester large lecture introductory calculus-based mechanics course at Georgia Tech, students learned to solve physics problems using the VPython programming environment. During the term 1357 students in this course solved a suite of fourteen computational modeling homework questions delivered using an online commercial course management system. Their proficiency with computational modeling was evaluated in a proctored environment using a novel central force problem. The majority of students (60.4%) successfully completed the evaluation. Analysis of erroneous student-submitted programs indicated that a small set of student errors explained why most programs failed. We discuss the design and implementation of the computational modeling homework and evaluation, the results from the evaluation and the implications for instruction in computational modeling in introductory STEM courses.

preprint2009arXiv

A Tale of Two Curricula: The performance of two thousand students in introductory electromagnetism

The performance of over 2000 students in introductory calculus-based electromagnetism (E&M) courses at four large research universities was measured using the Brief Electricity and Magnetism Assessment (BEMA). Two different curricula were used at these universities: a traditional E&M curriculum and the Matter & Interactions (M&I) curriculum. At each university, post-instruction BEMA test averages were significantly higher for the M&I curriculum than for the traditional curriculum. The differences in post-test averages cannot be explained by differences in variables such as pre-instruction BEMA scores, grade point average, or SAT scores. BEMA performance on categories of items organized by subtopic was also compared at one of the universities; M&I averages were significantly higher in each topic. The results suggest that the M&I curriculum is more effective than the traditional curriculum at teaching E&M concepts to students, possibly because the learning progression in M&I reorganizes and augments the traditional sequence of topics, for example, by increasing early emphasis on the vector field concept and by emphasizing the effects of fields on matter at the microscopic level.