Concept inventories, consisting of multiple-choice questions designed around common student misconceptions, are designed to reveal student thinking. However, students often have complex, heterogeneous ideas about scientific concepts. Constructed-response assessments, in which students must create their own answer, may better reveal students’ thinking, but are time- and resource-intensive to evaluate. This report describes the initial meeting of a National Science Foundation–funded cross-institutional collaboration of interdisciplinary science, technology, engineering, and mathematics (STEM) education researchers interested in exploring the use of automated text analysis to evaluate constructed-response assessments. Participants at the meeting shared existing work on lexical analysis and concept inventories, participated in technology demonstrations and workshops, and discussed research goals. We are seeking interested collaborators to join our research community.

Assessment of undergraduate research (UR) programs using participant surveys has produced a wealth of information about design, implementation, and perceived benefits of UR programs. However, measurement of student participation university wide, and the potential contribution of research experience to student success, also require the study of extrinsic measures. In this essay, institutional data on student credit-hour generation and grade point average (GPA) from the University of Georgia are used to approach these questions. Institutional data provide a measure of annual enrollment in UR classes in diverse disciplines. This operational definition allows accurate and retrospective analysis, but does not measure all modes of engagement in UR. Cumulative GPA is proposed as a quantitative extrinsic measure of student success. Initial results show that extended participation in research for more than a single semester is correlated with an increase in GPA, even after using SAT to control for the initial ability level of the students. While the authors acknowledge that correlation does not prove causality, continued efforts to measure the impact of UR programs on student outcomes using GPA or an alternate extrinsic measure is needed for development of evidence-based programmatic recommendations.

Using an action research model, biology faculty examined, implemented, and evaluated learner-centered instructional strategies to reach the goal of increasing the level of student achievement in the introductory biology course BIO 181: Unity of Life I, which was characterized by both high enrollments and a high DFW rate. Outcomes included the creation and implementation of an assessment tool for biology content knowledge and attitudes, development and implementation of a common syllabus, modification of the course to include learner-centered instructional strategies, and the collection and analysis of data to evaluate the success of the modifications. The redesigned course resulted in greater student success, as measured by grades (reduced %DFW and increased %AB) as well as by achievement in the course assessment tool. In addition, the redesigned course led to increased student satisfaction and greater consistency among different sections. These findings have important implications for both students and institutions, as the significantly lower DFW rate means that fewer students have to retake the course.

We tested the hypothesis that highly structured course designs, which implement reading quizzes and/or extensive in-class active-learning activities and weekly practice exams, can lower failure rates in an introductory biology course for majors, compared with low-structure course designs that are based on lecturing and a few high-risk assessments. We controlled for 1) instructor effects by analyzing data from quarters when the same instructor taught the course, 2) exam equivalence with new assessments called the Weighted Bloom's Index and Predicted Exam Score, and 3) student equivalence using a regression-based Predicted Grade. We also tested the hypothesis that points from reading quizzes, clicker questions, and other “practice” assessments in highly structured courses inflate grades and confound comparisons with low-structure course designs. We found no evidence that points from active-learning exercises inflate grades or reduce the impact of exams on final grades. When we controlled for variation in student ability, failure rates were lower in a moderately structured course design and were dramatically lower in a highly structured course design. This result supports the hypothesis that active-learning exercises can make students more skilled learners and help bridge the gap between poorly prepared students and their better-prepared peers.

We implemented a “how to study” workshop for small groups of students (6–12) for N = 93 consenting students, randomly assigned from a large introductory biology class. The goal of this workshop was to teach students self-regulating techniques with visualization-based exercises as a foundation for learning and critical thinking in two areas: information processing and self-testing. During the workshop, students worked individually or in groups and received immediate feedback on their progress. Here, we describe two individual workshop exercises, report their immediate results, describe students’ reactions (based on the workshop instructors’ experience and student feedback), and report student performance on workshop-related questions on the final exam. Students rated the workshop activities highly and performed significantly better on workshop-related final exam questions than the control groups. This was the case for both lower- and higher-order thinking questions. Student achievement (i.e., grade point average) was significantly correlated with overall final exam performance but not with workshop outcomes. This long-term (10 wk) retention of a self-testing effect across question levels and student achievement is a promising endorsement for future large-scale implementation and further evaluation of this “how to study” workshop as a study support for introductory biology (and other science) students.

Most students participating in science undergraduate research (UR) plan to attend either medical school or graduate school. This study examines possible differences between premed and non–premed students in their influences to do research and expectations of research. Questionnaire responses from 55 premed students and 80 non–premed students were analyzed. No differences existed in the expectations of research between the two groups, but attitudes toward science and intrinsic motivation to learn more about science were significantly higher for non–premed students. Follow-up interviews with 11 of the students, including a case study with one premed student, provided explanation for the observed differences. Premed students, while not motivated to learn more about science, were motivated to help people, which is why most of them are pursuing medicine. They viewed research as a way to help them become doctors and to rule out the possibility of research as a career. Non–premed students participated in research to learn more about a specific science topic and gain experience that may be helpful in graduate school research. The difference in the reasons students want to do UR may be used to tailor UR experiences for students planning to go to graduate school or medical school.

One of the best opportunities that undergraduates have to learn to write like a scientist is to write a thesis after participating in faculty-mentored undergraduate research. But developing writing skills doesn't happen automatically, and there are significant challenges associated with offering writing courses and with individualized mentoring. We present a hybrid model in which students have the structural support of a course plus the personalized benefits of working one-on-one with faculty. To optimize these one-on-one interactions, the course uses BioTAP, the Biology Thesis Assessment Protocol, to structure engagement in scientific peer review. By assessing theses written by students who took this course and comparable students who did not, we found that our approach not only improved student writing but also helped faculty members across the department—not only those teaching the course—to work more effectively and efficiently with student writers. Students who enrolled in this course were more likely to earn highest honors than students who only worked one-on-one with faculty. Further, students in the course scored significantly better on all higher-order writing and critical-thinking skills assessed.

In recognition of the entry into the era of personalized medicine, a new set of genetics and genomics competencies for nurses was introduced in 2006. Since then, there have been a number of reports about the critical importance of these competencies for nursing practices and about the challenges of addressing these competencies in the preservice (basic science) nursing curriculum. At least one suggestion has been made to infuse genetics and genomics throughout the basic science curriculum for prenursing students. Based on this call and a review of the competencies, this study sought to assess the impact of incorporation of genetics and genomics content into a prenursing microbiology course. Broadly, two areas that address the competencies were incorporated into the course: 1) the biological basis and implications of genetic diversity and 2) the technological aspects of assessing genetic diversity in bacteria and viruses. These areas address how genetics and genomics contribute to healthcare, including diagnostics and selection of treatment. Analysis of learning gains suggests that genetics and genomics content can be learned as effectively as microbiology content in this setting. Future studies are needed to explore the most effective ways to introduce genetics and genomics technology into the prenursing curriculum.

Zebra finch song behavior is sexually dimorphic: males sing and females do not. The neural system underlying this behavior is sexually dimorphic, and this sex difference is easy to quantify. During development, the zebra finch song system can be altered by steroid hormones, specifically estradiol, which actually masculinizes it. Because of the ease of quantification and experimental manipulation, the zebra finch song system has great potential for use in undergraduate labs. Unfortunately, the underlying costs prohibit use of this system in undergraduate labs. Further, the time required to perform a developmental study renders such undertakings unrealistic within a single academic term. We have overcome these barriers by creating digital tools, including an image library of song nuclei from zebra finch brains. Students using this library replicate and extend a published experiment examining the dose of estradiol required to masculinize the female zebra finch brain. We have used this library for several terms, and students not only obtain significant experimental results but also make gains in understanding content, experimental controls, and inferential statistics (analysis of variance and post hoc tests). We have provided free access to these digital tools at the following website: http://mdcune.psych.ucla.edu/modules/birdsong.