Researcher profile

John Stewart

John Stewart contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 17 - UnverifiedVerification L1Unclaimed author
4works
0followers
2topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

4 published item(s)

preprint2020arXiv

Exploring the Structure of Misconceptions in the Force and Motion Conceptual Evaluation with Modified Module Analysis

Investigating student learning and understanding of conceptual physics is a primary research area within Physics Education Research (PER). Multiple quantitative methods have been employed to analyze commonly used mechanics conceptual inventories: the Force Concept Inventory (FCI) and the Force and Motion Conceptual Evaluation (FMCE). Recently, researchers have applied network analytic techniques to explore the structure of the incorrect responses to the FCI identifying communities of incorrect responses which could be mapped on to common misconceptions. In this study, the method used to analyze the FCI, Modified Module Analysis (MMA), was applied to a large sample of FMCE pretest and post-test responses ($N_{pre}=3956$, $N_{post}=3719$). The communities of incorrect responses identified were consistent with the item groups described in previous works. As in the work with the FCI, the network was simplified by only retaining nodes selected by a substantial number of students. Retaining nodes selected by 20\% of the students produced communities associated with only four misconceptions. The incorrect response communities identified for men and women were substantially different, as was the change in these communities from pretest to post-test. The 20% threshold was far more restrictive than the 4% threshold applied to the FCI in the prior work which generated similar structures. Retaining nodes selected by 5% or 10% of students generated a large number of complex communities. The communities identified at the 10\% threshold were generally associated with common misconceptions producing a far richer set of incorrect communities than the FCI; this may indicate that the FMCE is a superior instrument for characterizing the breadth of student misconceptions about Newtonian mechanics.

preprint2020arXiv

Extending Machine Learning to Predict Unbalanced Physics Course Outcomes

Machine learning algorithms have recently been used to classify students as those likely to receive an A or B or students likely to receive a C, D, or F in a physics class. The performance metrics used in that study become unreliable when the outcome variable is substantially unbalanced. This study seeks to further explored the classification of students who will receive a C, D, and F and extend those methods to predicting whether a student will receive a D or F. The sample used for this work ($N=7184$) is substantially unbalanced with only 12\% of the students receiving a D or F. Applying the same methods as the previous study produced a classifier that was very inaccurate, classifying only 20\% of the D or F cases correctly. This study will focus on the random forest machine learning algorithm. By adjusting the random forest decision threshold, the correct classification rate of the D or F outcome rose to 46\%. This study also investigated the previous finding that demographic variables such as gender, underrepresented minority status, and first generation status had low variable importance for predicting class outcomes. Downsampling revealed that this was not the result of the underrepresentation of these students. An optimized classification model was constructed which predicted the D and F outcome with 46\% accuracy and C, D, and F outcome with 69\% accuracy; the accuracy of prediction of these outcomes is called "sensitivity" in the machine learning literature. Substantial variation was detected when this classification model was applied to predict the C, D, or F outcome for underrepresented demographic groups with 61\% sensitivity for women, 67\% for underrepresented minority students, and 78\% for first-generation students. Similar variation was observed for the D and F outcome.

preprint2020arXiv

Extending Modified Module Analysis to Include Correct Responses: An Analysis of the Force Concept Inventory

Brewe, Bruun, and Bearden first applied network analysis to understand patterns of incorrect conceptual physics reasoning in multiple-choice instruments introducing the Module Analysis for Multiple-Choice Responses (MAMCR) algorithm. Wells {\it et al.} proposed an extension to the algorithm which allowed the analysis of large datasets called Modified Module Analysis (MMA). This method analyzed the network structure of the correlation matrix of the responses to a multiple-choice instrument. Both MAMCR and MMA could only be applied to networks of incorrect responses. In this study, an extension of MMA is explored which allows the analysis of networks involving both correct and incorrect responses. The extension analyzes the network structure of the partial correlation matrix instead of the correlation matrix. The new algorithm, called MMA-P, was applied to the FCI and recovered much of the structure identified by MMA. The algorithm also identified sets of correct answers requiring similar physical reasoning reported in previous studies. Beyond groups of all correct and all incorrect responses, some groups of responses which mixed correct and incorrect responses were also identified. Some of these mixed response groups were produced when a correct response was selected for incorrect reasons; some of the groups helped to explain the gender unfairness previously reported for the FCI.

preprint2019arXiv

The Pulsar Search Collaboratory: Current Status and Future Prospects

The Pulsar Search Collaboratory (PSC) is a collaboration between the Green Bank Observatory and West Virginia University, funded by the National Science Foundation. The PSC program is currently expanding nationwide and engages high school students, teachers, and undergraduate mentors in real-world research by searching for pulsars in data collected with the 100-m Green Bank Telescope. In the process, students learn about observational radio astronomy, radio frequency interference, pulsar timing, and data analysis procedures. The primary goals of the PSC are to stimulate student interest in Science, Technology, Engineering, and Mathematics (STEM) careers, to prepare teachers in implementing authentic research with students by training them within a professional scientific community, and to promote student use of information technologies through online activities and workshops. In this paper, we provide an overview of pulsar science and the data analysis students undertake, as well as a general overview of the program. We then discuss evaluation data collected from participants through a series of survey questions to determine if the program's initial goals were met. The program had a positive impact on the students according to multiple measures, in particular, on their understanding of the nature of scientific inquiry and motivation to pursue STEM career paths.