Discipline-based education researchers have a natural laboratory—classrooms, programs, colleges, and universities. Studies that administer treatments to multiple sections, in multiple years, or at multiple institutions are particularly compelling for two reasons: first, the sample sizes increase, and second, the implementation of the treatments can be intentionally designed and carefully monitored, potentially negating the need for additional control variables. However, when studies are implemented in this way, the observations on students are not completely independent; rather, students are clustered in sections, terms, years, or other factors. Here, I demonstrate why this clustering can be problematic in regression analysis. Fortunately, nonindependence of sampling can often be accounted for with random effects in multilevel regression models. Using several examples, including an extended example with R code, this paper illustrates why and how to implement random effects in multilevel modeling. It also provides resources to promote implementation of analyses that control for the nonindependence inherent in many quasi-random sampling designs.

Scientists are shaped by their unique life experiences and bring these perspectives to their research. Diversity in life and cultural experiences among scientists, therefore, broadens research directions and, ultimately, scientific discoveries. Deaf individuals, for example, have successfully contributed their unique perspectives to scientific inquiry. However, deaf individuals still face challenges in university science education. Most deaf students in science, technology, engineering, and mathematics (STEM) disciplines interact with faculty who have little to no experience working with deaf individuals and who often have preconceptions or simply a lack of knowledge about deaf individuals. In addition to a lack of communication access, deaf students may also feel unwelcome in STEM, as do other underrepresented groups. In this essay, we review evidence from the literature and, where data are lacking, contribute the expert opinions of the authors, most of whom are deaf scientists themselves, to identify strategies to best support deaf students in university STEM education. We describe the journey of a hypothetical deaf student and methods for faculty to create a welcoming environment. We describe and provide recommendations for classroom seating and layout, accommodations, teaching strategies, and research mentoring. We also discuss the importance of including deaf scientists in research about deaf individuals.

The benefits of student-centered active-learning approaches are well established, but this evidence has not directly translated into instructors adopting these evidence-based methods in higher education. To date, promoting and sustaining pedagogical change through different initiatives has proven difficult, but research on pedagogical change is advancing. To this end, we examine pedagogical behaviors through a cultural evolutionary model that stresses the global nature of the issue, the generational time that change requires, and complications introduced by academic career trajectories. We first provide an introduction to cultural evolutionary theory before describing our model, which focuses on how cultural transmission processes and selection events at different career phases shape not only who teaches in higher education, but also how they choose to teach. We leverage our model to make suggestions for expediting change in higher education. This includes reforming pedagogy in departments that produce PhD students with the greatest chance of obtaining tenure-track positions.

The BioHealth Capital Region (Maryland, Virginia, and Washington, DC; BHCR) is flush with colleges and universities training students in science, technology, engineering, and mathematics disciplines and has one of the most highly educated workforces in the United States. However, current educational approaches and business recruitment tactics are not drawing sufficient talent to sustain the bioscience workforce pipeline. Surveys conducted by the Mid-Atlantic Biology Research and Career Network identified a disconnect between stakeholders who are key to educating, training, and hiring college and university graduates, resulting in several impediments to workforce development in the BHCR: 1) students are underinformed or unaware of bioscience opportunities before entering college and remain so at graduation; 2) students are not job ready at the time of graduation; 3) students are mentored to pursue education beyond what is needed and are therefore overqualified (by degree) for most of the available jobs in the region; 4) undergraduate programs generally lack any focus on workforce development; and 5) few industry–academic partnerships with undergraduate institutions exist in the region. The reality is that these issues are neither surprising nor restricted to the BHCR. Recommendations are presented to facilitate improvement in the preparation of graduates for today’s bioscience industries throughout the United States.

Understanding genetic mechanisms affords the ability to provide causal explanations for genetic phenomena. These mechanisms are difficult to teach and learn. It has been shown that students sometimes conceive of genes as traits or as trait-bearing particles. We termed these “nonmechanistic” conceptions of genetic phenomena because they do not allow the space required for a mechanism to exist in the learner’s mind. In this study, we investigated how ninth- and 12th-grade students’ conceptions of genetic phenomena affect their ability to learn the underlying mechanisms. We found that ninth- and 12th-grade students with nonmechanistic conceptions are less successful at learning the mechanisms leading from gene to trait than students with mechanistic conceptions. Our results suggest that nonmechanistic conceptions of a phenomenon may create a barrier to learning the underlying mechanism. These findings suggest that an initial description of a phenomenon should hint at a mechanism even if the mechanism would be learned only later.

This study investigates how the domain-specific language of molecular life science is mediated by the comparative contexts of chemistry and biology education. We study upper secondary chemistry and biology textbook sections on protein synthesis to reveal the conceptual demography of concepts central to the communication of this subject. The term “conceptual demography” refers to the frequency, distribution, and internal relationships between technical terms mediating a potential conceptual meaning of a phenomenon. Data were collected through a content analysis approach inspired by text summarization and text mining techniques. Chemistry textbooks were found to present protein synthesis using a mechanistic approach, whereas biology textbooks use a conceptual approach. The chemistry texts make no clear distinction between core terms and peripheral terms but use them equally frequently and give equal attention to all relationships, whereas biology textbooks focus on core terms and mention and relate them to each other more frequently than peripheral terms. Moreover, chemistry textbooks typically segment the text, focusing on a couple of technical terms at a time, whereas biology textbooks focus on overarching structures of the protein synthesis. We argue that it might be fruitful for students to learn protein synthesis from both contexts to build a meaningful understanding.

Real-world processes are complex and require ideas from multiple disciplines to be explained. However, many science courses offer limited opportunities for students to synthesize scientific ideas into coherent explanations. In this study, we investigated how students constructed causal explanations of complex phenomena to better understand the ways they approach this practice. We interviewed 12 undergraduate science majors and asked them to explain real-world phenomena. From these interviews, we developed a characterization framework that described the reasoning patterns we found. In this framework, we identified three explanatory frames that differentiated the kinds of explanations students provided: a colloquial frame, wherein participants activated conceptual resources based on personal experience using everyday language; an emerging mechanistic frame, wherein participants used scientific concepts in semicoherent ways; and a causal mechanistic frame, wherein participants cohesively drew upon scientific conceptual resources to construct mechanistic explanations. Overall, the causal mechanistic frame was the least prevalent frame invoked by students. Instead, many drew on an emerging mechanistic frame and struggled to identify and apply scientific concepts to real-world scenarios. We advocate for incorporating opportunities to reason about real-world phenomena into undergraduate science curricula to provide students with experience integrating scientific concepts to explain real-world phenomena.

We sought to test a hypothesis that systemic blind spots in active learning are a barrier both for instructors—who cannot see what every student is actually thinking on each concept in each class—and for students—who often cannot tell precisely whether their thinking is right or wrong, let alone exactly how to fix it. We tested a strategy for eliminating these blind spots by having students answer open-ended, conceptual problems using a Web-based platform, and measured the effects on student attrition, engagement, and performance. In 4 years of testing both in class and using an online platform, this approach revealed (and provided specific resolution lessons for) more than 200 distinct conceptual errors, dramatically increased average student engagement, and reduced student attrition by approximately fourfold compared with the original lecture course format (down from 48.3% to 11.4%), especially for women undergraduates (down from 73.1% to 7.4%). Median exam scores increased from 53% to 72–80%, and the bottom half of students boosted their scores to the range in which the top half had scored before the pedagogical switch. By contrast, in our control year with the same active-learning content (but without this “zero blind spots” approach), these gains were not observed.

Student learning in biology may be impaired by instructional environments that emphasize technical methodology over analysis. We hypothesized that time gained by experimenting with accurate computer simulations could be used to engage students in analytical, creative learning. The effects of treatments that combined a week of simulated lab instruction with a week of standard lab instruction in different order (E-to-S and S-to-E) were examined using a controlled experimental design with random assignment of lab sections and hierarchical linear modeling analysis to account for possible clustering within sections. Data from a large sample of students (N = 515) revealed a significant increase (1.59 SD) in posttest scores for both treatment groups over the control. We posit as a plausible explanation the reinforcement of psychomotor learning due to strong engagement of cognitive processes facilitated by the computer simulation. This study supports a wider use of computer simulations as learning tools in laboratory courses.

Higher education faces the challenge of high student attrition, which is especially disconcerting if associated with low participation rates, as is the case in South Africa. Recently, the use of learning analytics has increased, enabling institutions to make data-informed decisions to improve teaching, learning, and student success. Most of the literature thus far has focused on “at-risk” students. The aim of this paper is twofold: to use learning analytics to define a different group of students, termed the “murky middle” (MM), early enough in the academic year to provide scope for targeted interventions; and to describe the learning strategies of successful students to guide the design of interventions aimed at improving the prospects of success for all students, especially those of the MM. We found that it was possible to identify the MM using demographic data that are available at the start of the academic year. The students in the subgroup were cleanly defined by their grade 12 results for physical sciences. We were also able to describe the learning strategies that are associated with success in first-year biology. This information is useful for curricular design, classroom practice, and student advising and should be incorporated in professional development programs for lecturers and student advisors.

Introducing group work in college science classrooms can lead to noticeable gains in student achievement, reasoning ability, and motivation. To realize these gains, students must all contribute. Strategies like assigning roles, group contracts, anonymous peer evaluations, and peer ratings all encourage student participation. In a class using these strategies, we conducted in-depth interviews to uncover student perceptions of group work in general and the utility of these support strategies. Students in both high- and low-performance groups still complained of unequal contributions while praising the social support provided by groups. Students who scored highly on tests were more likely to recognize the benefits of group work, regardless of their groups’ overall performance levels, while lower-scoring students perceived group work as time-consuming “busy work” with little cognitive benefit. Comments from anonymous peer evaluations differed only subtly between high- and low-performance groups. Numerical ratings on these evaluations did correlate with overall group performance. However, students in lower-performance groups assigned harsh ratings to their low-scoring members, while students in higher-performance groups were more generous in their ratings for low-scoring members. We discuss implications of relying on support strategies for promoting productive group work.

Practice exams are a type of deliberate practice that have been shown to improve student course performance. Deliberate practice differs from other types of practice, because it is targeted, mentally challenging, can be repeated, and requires feedback. Providing frequent instructor feedback to students, particularly in large classes, can be prohibitive. A possible solution is to have students grade practice exams using an instructor-generated rubric, receiving points only for completion. Students can either grade their own or a peer’s work. We investigated whether peer or self-grading had a differential impact on completion of practice exam assignments, performance on practice exams or course exams, or student grading accuracy. We also investigated whether student characteristics mattered. We found that 90% of students took all practice exams or only missed one and that there was no difference on practice or course exam performance between the peer and self-graders. However, in the peer-grading treatment, students with lower incoming grade point averages and students identified as economically or educationally disadvantaged were less accurate and more lenient graders than other students. As there is no clear benefit of peer grading over self-grading, we suggest that either format can solve the challenge instructors face in giving frequent personalized feedback to many students.

Although development of critical thinking skills has emerged as an important issue in undergraduate education, implementation of pedagogies targeting these skills across different science, technology, engineering, and mathematics disciplines has proved challenging. Our goal was to assess the impact of targeted interventions in 1) an introductory cell and molecular biology course, 2) an intermediate-level evolutionary ecology course, and 3) an upper-level biochemistry course. Each instructor used Web-based videos to flip some aspect of the course in order to implement active-learning exercises during class meetings. Activities included process-oriented guided-inquiry learning, model building, case studies, clicker-based think–pair–share strategies, and targeted critical thinking exercises. The proportion of time spent in active-learning activities relative to lecture varied among the courses, with increased active learning in intermediate/upper-level courses. Critical thinking was assessed via a pre/posttest design using the Critical Thinking Assessment Test. Students also assessed their own learning through a self-reported survey. Students in flipped courses exhibited gains in critical thinking, with the largest objective gains in intermediate and upper-level courses. Results from this study suggest that implementing active-learning strategies in the flipped classroom may benefit critical thinking and provide initial evidence suggesting that underrepresented and first-year students may experience a greater benefit.

A flipped-classroom environment generally strives to create more in-class time for activities that enhance student learning, while shifting some content delivery to outside the classroom through the use of short didactic videos. We compared a flipped-classroom setting with the traditional (“control”) setting for an accelerated lower-division general biology course. Student self-reporting and video analytics functions showed ample and variable video viewing among individual students. Student learning was evaluated through quizzes administered after a set of concepts were covered (post 1) and at the end of the course (post 2). Students in the flipped sections had significantly higher quiz scores than students in the control sections for both post 1 and post 2. Analyses of variance analyzing the effect of and interactions between type of instruction, in-class activities, time, and Bloom’s level of the quiz questions found significant differences in the overall model and all the factors, except for the presence and level of activities. Significant differences between students in the flipped and control sections were observed for low-level Bloom’s questions only. Thus, the positive effect of the flipped-classroom approach on student learning may be due to improvements in recall of basic concepts and a better understanding of biology vocabulary in their first biology course.

This paper attends to challenges for postsecondary science education improvement initiatives, notably understanding and responding to the realities guiding educators’ teaching practices. We explored 16 postsecondary biology educators’ instructional planning, providing novel insights into why educators select certain strategies over others, including lecturing. Our findings point to an array of factors that educators consider, factors that we believe push against the lecture versus active-learning dichotomy that we hear in some improvement rhetoric. We recommend professional development experiences (including peer evaluations of teaching) wherein educators and other proponents for teaching improvements explicitly explore rationales for teaching, including educators’ considerations of the nature of the discipline (content and concepts and skills and processes) and students’ needs. Educators with less experience with content were more likely to seek out additional instructional resources during planning, including other educators. Given this, teaching improvement proponents may want to offer professional development activities that sync with periodic and planned teaching assignments that take educators out of their disciplinary knowledge comfort zone. Disciplinary colleagues might serve as exemplars of planning and implementing teaching strategies that both convey foundational content and processes and engage students via evidence-based practices.

Mounting evidence of the efficacy of active learning has prompted educators to consider adoption of these practices in college-level classrooms. One tenet of active learning is that most, if not all, students have the ability to learn. Instructors’ perspectives on learning, however, may or may not be aligned with this. One belief held by some educators is that intelligence is fixed, that is, some students are more intelligent and have a higher ability to learn than others. Instructors with a fixed mindset may not be convinced that their investment in developing active-learning materials will be as fruitful as the education evidence suggests, because these instructors may not believe that most students can grow in their learning. Here, we explored the relationship between fixed mindsets and the adoption of active-learning strategies. We found that instructors with higher fixed mindsets were less persuaded that active-learning strategies were a good idea and less likely to implement the teaching practices. Our research suggests that development initiatives should explicitly address educators’ lay theories of intelligence (fixed or growth mindset) to support successful implementation of active learning.

Graduate students hold a critical role in responding to national calls for increased adoption of evidence-based teaching (EBT) in undergraduate classrooms, as they not only serve as teaching assistants, but also represent the pool from which future faculty will emerge. Through interviews with 32 biology graduate students from 25 institutions nationwide, we sought to understand the progress these graduate students are making in adopting EBT through qualitative exploration of their perceptions of and experiences with both EBT and instructional professional development. Initial inductive content analysis of interview transcripts guided the holistic placement of participants within stages of Rogers’s diffusions of innovations model, which we use as a theoretical framework to describe the progress of EBT adoption. We found that most graduate students in our sample are aware of and value EBT, but only 37.5% have implemented EBT. Many who were progressing toward EBT adoption had sought out supplementary instructional experiences beyond the requirements of their programs, and 72% perceived an institutional lack of support for teaching-related professional development opportunities. These data indicate that, while many graduate students are already engaged with the movement to adopt EBT, graduate training programs should emphasize increasing access to quality training in EBT strategies.

MD–PhD training takes, on average, 8 years to complete and involves two transitions, an MD-preclinical to PhD-research phase and a PhD-research to MD-clinical phase. There is a paucity of research about MD–PhD students’ experiences during each transition. This study examined transition experiences reported by 48 MD–PhD students who had experienced at least one of these transitions during their training. We purposefully sampled medical schools across the United States to recruit participants. Semistructured interviews were audio-recorded and transcribed for analysis; items focused on academic and social experiences within and outside their programs. Using a phenomenological approach and analytic induction, we examined students’ transition experiences during their MD–PhD programs. Five broad themes emerged centering on multiple needs: mentoring, facilitating integration with students in each phase, integrating the curriculum to foster mastery of skills needed for each phase, awareness of cultural differences between MD and PhD training, and support. None of the respondents attributed their transition experiences to gender or race/ethnicity. Students emphasized the need for mentoring by MD–PhD faculty and better institutional and program supports to mitigate feelings of isolation and help students relearn knowledge for clinical clerkships and ease re-entry into the hospital culture, which differs substantially from the research culture.

Writing is a critical skill for graduate students, but few studies in the literature describe how it is supported in the training of biomedical graduate students. The Initiative for Maximizing Student Development program at Loma Linda University aims to develop this important skill in its students through an integrated, structured writing intervention. Specifically, the program hired a writing specialist who taught writing seminars, facilitated writing and publishing workshops, and mentored students in one-on-one writing conferences. Doctoral students in the program, primarily underrepresented minority students with some not having English as a first language, all exhibited writing apprehension and blocking behaviors. The percentage of students graduating, publishing, and entering science careers, all of which require writing, is high. To yield insight into how this intervention worked, we conducted in-depth interviews of six of the earliest graduates, derived themes, analyzed data from pre- and post-assessments, and described their publication records. Participating students increased their writing confidence, adopted productive writing strategies, decreased writing anxiety and blocking behaviors, and published successfully.

An evidence-based research mentor training (RMT) curricular series has been shown to improve the knowledge and skills of research mentors across disciplines and career stages. A train-the-trainer model was used in the context of several targeted approaches aimed at sustainability to support national dissemination of RMT and expand the network of facilitators prepared to implement the curricula. These infrastructure elements included 1) an expansion initiative to increase the number of trained facilitators able to deliver train-the-trainer workshops nationwide; 2) adaptation of RMT curricula for multiple audiences and career stages to increase accessibility; 3) implementation resources to support facilitators and help them overcome implementation barriers; and 4) standardized evaluation of training. This approach to dissemination and implementation has resulted in the preparation of nearly 600 trained facilitators, a large percentage of whom have implemented mentor training for more than 4000 graduate student, junior faculty, and senior faculty mentors. Implications for and challenges to building and sustaining the national dissemination of RMT are discussed.

It is widely recognized that the United States needs to attract and retain more people in science, technology, engineering, and mathematics (STEM) careers. Intensive undergraduate research experiences (UREs) are one of the few strategies shown to improve longitudinal student interest and persistence in STEM-related career pathways; however, less is known about the underlying process linking activities to positive outcomes. The tripartite integration model of social influences (TIMSI) provides a framework for understanding the social influence processes by which students integrate into STEM careers and culture. The current study used a longitudinal design and latent growth curve modeling to examine and predict the development of scientific research career persistence intentions over the course of an intensive summer URE. The latent growth curve analysis showed that student persistence intentions declined and rebounded over the course of the summer. Furthermore, the positive impact of faculty mentor role modeling on growth trajectories was mediated through internalization of science community values. In addition, project ownership was found to buffer students from the typical trend of declining and rebounding persistence intentions. The TIMSI framework illuminates the contextual features and underlying psychological processes that link UREs to student integration into STEM careers and culture.