|
|
|||||||
Articles |
Division of Biology, Kansas State University, Manhattan, KS 66506
Submitted September 20, 2006; Revised February 7, 2008; Accepted February 11, 2008
Monitoring Editor: Marshall Sundberg
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
The K-State introductory biology course, Principles of Biology, is taught to approximately 1500 students each year and serves both majors and nonmajors. It was created in 1968 and used the then-current audio-tutorial (A-T) format (Postlethwait, 1970). In this format, students listened to audiotaped lectures and instructions and carried out labs on their own, with assistance, if desired, from graduate teaching assistants and faculty members staffing the classroom ("A-T lab"). The advantages of this system were that students could work at their own pace; there was an integration of the lecture and laboratory components of the course; and students were able to come to the A-T lab at times of their own choosing during the week. The disadvantages included a lack of student-faculty continuity (which was ameliorated to some extent by incorporating weekly recitations taught by faculty members); lack of a mechanism to encourage student attendance; and a feeling of isolation for students, who sat alone in carrels listening to tapes. The expected contact time for students was 5 h per week: two 2-h blocks in the A-T lab and a 1-h recitation.
Faced with the need to do an equipment upgrade and recognizing that the A-T format was no longer state-of-the-art pedagogy, the K-State Division of Biology completely restructured the course in 1997. Our entire faculty provided input and we chose to use a studio format, as pioneered at Rensselaer Polytechnic Institute for physics instruction (Wilson, 1994; Pipes and Wilson, 1996). The studio model features integration of elements of lecture and laboratory, interactive computer software, teamwork, multiple learning modalities, an investigation-driven approach, and instructors as facilitators rather than lecturers. Students are required to take more responsibility for their own learning than in a traditional lecture.
We chose the studio model over a traditional lecture/lab format or a modernized version of A-T that used computers instead of tape recorders to deliver the content because we wanted to create the most effective learning environment for the course, and also retain the engagement of most biology faculty members in teaching it. The transition took 3 yr of planning and was supported with funding from internal and external sources. Features of the A-T and studio models as used at K-State are compared in Table 1.
|
| STUDIO BIOLOGY COURSE |
|---|
|
|
|---|
|
| ASSESSMENT MEASURES |
|---|
|
|
|---|
Student Performance on Exam Questions Used in Both the A-T and Studio Formats
To compare student learning in the former A-T and current studio formats, we reviewed historical records of student performance on common and similar exam questions used for multiple semesters in both formats of the course. We selected 15 objectives that have consistently been part of the course content and identified all questions that addressed these objectives. These questions were not necessarily identical (though in some cases they were) but were similar and covered the same material. Some of these questions also covered the same objectives as those in our pre- and postassessment tests (see below). Table 3 shows student performance on all 15 objectives and overall, comparing A-T and studio. The overall mean performance of A-T students and studio students did not differ significantly (p = 0.63). Only two objectives (characteristics of diffusion and definition of a population) showed significant differences between A-T and studio, with student performance on these objectives being higher in the studio format.
|
Another issue that should be considered in evaluating the course final grade data is the fact that students take this course for a variety of reasons, including the fulfillment of a distribution requirement. Thus the population of students enrolled in the course is also fairly heterogeneous. The final grade data are shown in Table 4. The mean grades are very close; 2.15 for A-T and 2.12 for studio. However, the grade distributions differ significantly; the majority of this difference is in the proportion of students earning D's (higher in the studio years) and F's (lower in the studio years). We do not know the reason for this difference; two possibilities are 1) that the more favorable student-faculty ratio in the studio format allows some marginal students to pass the course with a D who might have otherwise failed; and 2) that students in recent years might be more likely to withdraw and retake a course that they believe they will fail. The second possibility can be directly examined. We analyzed the patterns of student withdrawal over 14 yr of Principles of Biology, including the last eight semesters of the A-T version of the course and all semesters of the studio version for which withdrawal data were available. These data are illustrated in Figure 1. Figure 1A shows the withdrawal data for each semester and 1B shows the analysis broken out by three groups of semesters: the last eight semesters of the A-T format, the first eight semesters of the studio format, and the last 12 semesters of the studio format. The pattern is complex but the following conclusions can be made. 1) Withdrawal rates (formal withdrawal from the course between week 5 and 10 of the semester; students receive a "W" on their transcript) averaged
8% over the last eight semesters of the A-T version of the course. 2) Withdrawal rates during the first eight semesters of studio were
10%. 3) Withdrawal rates in the subsequent 12 semesters of studio were
5%. The difference between the median withdrawal rates in A-T and most recent studio semesters is significant at the P < 0.005 level in an unpaired t test. These data are thus more consistent with the first hypothesis above, indicating that fewer marginal students are withdrawing from the studio course, and are possibly passing the course with a D.
|
|
Student respondents did not differ over the three semesters in which surveys were administered in terms of college enrolled, previous biology experience, prior enrollment in the course, chemistry or physics background, or reason for taking the course. There was also no difference in the grade expected by students in the presurvey (approximately 90% expected to receive an A or B); this had changed by the postsurvey, in which students had much more realistic expectations, with a significantly smaller percentage expecting A's in the studio format. (Actual final grade distributions were discussed.) Significant differences were found in self-reported learning and interests, with 64% of A-T students agreeing with the statement "I learned a lot in this course" versus 49% (1998) and 58% (1999) of studio students indicating moderate or strong agreement. There also was a lower percentage of students who reported that they were likely to read more biology-related topics and who indicated that their interest in biology had increased in the Spring 1998 and 1999 (studio) semesters as compared with the Spring 1997 (A-T) semester. To elucidate possible factors, in addition to course format, that influenced student attitudes, postsurvey responses were adjusted for students' initial levels of skills and interests as measured on the postsurvey. Significant differences between students enrolled in the course in the A-T and studio formats were found only for their self-reported skills in "doing experiments" and "working with others," in which the studio students rated themselves higher; and "writing lab reports," in which the A-T students rated themselves higher. Perhaps not surprisingly, students' major was a factor that significantly impacted skills and interests, with students majoring in biology and related areas reporting more skill and interest in these areas in both course formats. The major also was a factor in impacting student comfort with the course, whether in the A-T or studio format. Student motivation as inferred from the statement "I really want to take this course" and student ability as inferred from ACT composite scores also significantly impacted student learning, interest, and skill development.
In the time that has passed since these student attitude surveys were conducted, there is considerably less angst associated with the studio format. One of the areas that students continue to grumble about is the required attendance for studio sessions. However, this reinforces the idea that students are expected to be participants in their own learning in the studio and seems to be necessary for many college freshmen (or seniors). Many are at first uncomfortable with the course format, but this changes as the semester proceeds, and we have had a number of students express disappointment on learning that other biology courses are not taught in the studio format. A few students simply mark the time to complete the course and never really become engaged. It is possible that such students account for a portion of the D's and F's observed.
Faculty Attitudes. Faculty attitudes toward the A-T and studio format were surveyed during the last semester of A-T and the first four semesters in which the studio was taught. An instrument dealing with Principles of Biology in the A-T format was administered to all biology faculty in spring 1997, with a similar survey with questions pertinent to the studio format administered to those who taught in the new format in fall 1997, spring 1998, fall 1998, and spring 1999. Response rates were good in spring and fall 1997 and then fell off quickly with time, presumably because some faculty members had been asked to complete the survey twice or more. It was not possible to know how many individual faculty members were represented in the responses collected. Faculty members were in general strongly receptive of the change. Not surprisingly, most felt that the course was an effective learning experience for students in both formats. Some faculty members had concerns about the change, which required them to be knowledgeable about the entire content of the course (e.g., a plant biologist would have to teach some classes about animal biology, and vice versa). In the A-T format, faculty members had the option of working in the A-T lab only during selected portions of the semester; such an arrangement is not available under the studio format. Other concerns included learning to use instructional technology and anticipation of an increased time commitment to the course. As time has gone by, these fears have largely been alleviated by faculty retirements, hiring of a younger group of faculty more comfortable with technology, and extensive support for faculty in the form of weekly staff meetings, staff notes, and an online site providing access to studio Web and print materials.
Student Performance in Subsequent Biology Courses
Of those students who take Principles of Biology as part of a science or prehealth profession major at K-State, nearly all go on to take one of three other biology courses: Organismic Biology, Structure and Function of the Human Body, or General Microbiology. We obtained data from the university registrar on student performance in these classes for students who completed one of these three classes in fall or spring 1998. There were three groups of students in these classes: those who took Principles of Biology in the A-T format; those who took it in the studio format; and those who took the course elsewhere (generally at a community college). The average grades of these three groups of students were compared with and without adjustment for ACT scores (data not shown). There was no significant effect of the Principles of Biology course format on performance in the three subsequent courses, particularly when the grades were adjusted for ACT score. Interestingly, there was a difference seen for students who did not take the introductory biology course at K-State; their grades in Organismic Biology (the next course in our core sequence) were generally lower, even when ACT scores were taken into account (data not shown).
Student Learning in the Studio Format
Assessment tests based on multiple-choice questions similar to those used in exams have been used in Principles of Biology for several years to gauge student learning. We report here data from four regular semesters (Fall 2002–2003 and Spring 2003–2004) and one summer session (2004). The same test was given at both the beginning (pretest) and end (posttest) of the semester. The test was not given for credit; the pretest was on the first day of class; the posttest was given on the last day of class. The tests consisted of 16 questions, two from each of the content modules of the course. The questions were based on objectives used in both the A-T and studio versions of the course. Questions were chosen such that the test has approximately equal numbers of easy (most students who have taken any previous biology course should know the answers) questions and more difficult (most students should not know the answers before taking the course) questions.
The "gain in learning" (g) metric has been used by others to measure student learning and is determined as the difference between the posttest score and the pretest score divided by the difference between the highest possible score and the pretest score (Hake, 1998; Cummings et al., 1999; Roy, 2003; Sundberg, 2003). Hake (1998) found that the average gain in learning for students in traditional courses in Physics was g = 0.23. In Table 5, we report results from these pre- and posttests. The gain in learning varied greatly from question to question, with consistently low values for quantitative and complex topics such as dilutions and photosynthesis and high values for concepts such as the ultimate source of energy in ecosystems and details of structures. The overall gain in learning for all questions and all semesters was a mean of 0.47 with a SD of 0.04.
|
|
We also compared student learning in introductory biology in the K-State studio format with that for a comparable course taught in a traditional lecture/lab format at Fort Hays State University (KS), another public institution in our state serving a comparable student population. Identical assessment tests were given in Spring 2007 at the start and end of the semester to students at both institutions. Data are shown in Table 7. To keep the sample sizes similar, a representative (median) K-State section was chosen; g-values for K-State sections ranged from 0.401 to 0.524 that semester. Initial test scores for these classes were similar and were not significantly different; this indicates a similar level of preparation of students in the classes at the two institutions. The amount learned (g-value) was significantly different, and higher for the K-State studio-format class. Similar results (no significant difference in presemester test scores, and significant difference in g-values) were obtained when any Spring 2007 section of Principles of Biology was used as the comparison group (data not shown). These results, while limited by the fact that they reflect different courses at different institutions, suggest that introductory biology education in the studio format may result in greater learning and retention compared with introductory biology education in a traditional lecture/lab format.
|
| DISCUSSION |
|---|
|
|
|---|
In 1997, we began a restructuring of Principles of Biology to use the then-novel studio format. It was our hope that the student-instructor interaction, active learning, and multiple learning modalities integral to the studio format would provide a superior learning environment for the course. The analysis of student performance on exam questions and student grades in the A-T and studio formats, and the qualitative assessment data on student attitudes and responses to the course in the two formats reported above, support the idea that the change in format did no harm, despite the reduction in contact hours per week (5 h per week in A-T versus 4 in studio). Another factor that should be considered in interpreting these data are that the course in the last year of the A-T format was in a mature form, the product of many years of modification. The student attitude data for the course in studio format were gathered very early in the implementation of the course, which continues to evolve as we formatively use feedback from students and faculty to modify content and delivery, and add components to enhance student learning. The latter include a series of learning objective–based study guides and weekly review sessions. Our self-published studio manual is in its ninth revision. We have used three different texts since conversion to the studio format. This format lends itself readily to minor modifications as new materials become available.
Published evaluations of studio physics at Rensselaer Polytechnic Institute have yielded mixed results in terms of effectiveness. Quantitative measures of student learning showed no improvement of the studio approach over lecture/lab (Cooper, 1998; Cummings et al., 1999). Student comments identified the fact that responsibility for learning is shifted from the teacher to the student as both strengths and weaknesses of the studio format (Cooper, 1998). This parallels our experience with students, some of whom greatly enjoy the biology studio and others who would prefer someone to lecture to them.
Roy (2003) compared student learning in a studio format versus interactive lecture demonstration for genetics and evolution and found that studio resulted in higher learning gains. Traver et al. (2001) analyzed student performance in a studio offering of biochemistry and although they did not measure learning gains directly, found significant pretest–posttest improvement. Student attitude surveys reported that most students responded favorably to components of the studio environment including use of technology and collaborative learning, and reported gains in self-efficacy that were related to knowledge gain as measured by posttest performance.
How does studio biology compare with the conventional lecture/lab format and the A-T format in promoting student learning? The gain in learning values reported in Tables 5 through 7 for studio biology and other lecture/lab courses suggests that the studio may be superior in producing student learning and retention. While the current data set is limited and we do not have (and cannot obtain) comparable data for the course in the A-T format, the findings of the relative similarity of A-T and conventional courses in promoting student learning (Kulik et al., 1979) suggest that the studio would also be superior to A-T, even though this learning might not necessarily have translated into higher grades in the studio format (Table 4). As was discussed above, the student population is heterogeneous and their reasons for taking the course are diverse.
The studio conversion process was in essence a large educational experiment that is still ongoing. It was an expensive and time-consuming undertaking, and had to be all-or-nothing because of the reconstruction of the classroom in which the course is taught. We believe that the student learning gains that we have consistently observed in the studio format indicate that this effort was a success. This project led the way for development of additional mediated instructional environments at K-State, including a studio version of physics. The studio biology course provides a model that might be considered for introductory biology at other institutions across the country, as there are now more options available to make the process less expensive and easier to implement. These include having students provide their own laptop computers and making use of software packages, laboratory exercises, and assessment instruments developed by others and available online. A partial listing of such resources is provided by Handelsman et al. (2004).
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
Brickman, P. (2006). The case of the Druid Dracula: A directed "clicker" case study on DNA fingerprinting. J. Coll. Sci. Teach. 36, 48–53.
Cooper, M. A. (1998). An evaluation of the initial implementation of the CUPLE studio physics course. In: The Changing Role of Physics Departments in Modern Universities: Proceedings of ICUPE, ed. E. F. Redish and J. S. Rigden, College Park, MD: American Institute of Physics.
Cummings, K., Marx, J., Thornton, R., and Kuhl, D. (1999). Evaluating innovation in studio physics. Am. J. Phys. 67, S38–S44.
Ebert-May, D., Brewer, C, and Allred, S. (1997). Innovation in large lectures—teaching for active learning. BioScience 47, 601–607.[CrossRef]
Fleming, N. D., and Mills, C. (1992). Not another inventory, rather a catalyst for reflection. To Improve the Academy 11, 137–155.
Hake, R. (1998). Interactive-engagement versus traditional methods: a six thousand-student survey of mechanics test data for introductory physics courses. Am. J. Phys. 66, 64–74.
Handelsman, J., et al. (2004). Scientific teaching. Science 304, 521–522.
Klionsky, D. J. (1998). A cooperative learning approach to teaching introductory biology. J. Coll. Sci. Teach. 27, 334–338.
Kulik, J. A., Kulik, C.-L. C., and Cohen, P. A. (1979). Research on audio-tutorial instruction: a meta-analysis of comparative studies. Res. Higher Ed. 11, 321–341.[CrossRef]
Pipes, B., and Wilson, J. (1996). A multimedia model for undergraduate education. Technol. in Soc. 18, 387–401.[CrossRef]
Postlethwait, S. N. (1970). The audio-tutorial system. Am. Biol. Teach. 32, 31–33.
Requirements for K-State (2008). Admissions requirements. http://consider.k-state.edu/admissions/admissionsrequirements.html (Accessed 4 February 2008).
Roy, H. (2003). Studio vs. interactive lecture demonstration—effects on student learning. Bioscene 29, 3–6.
Sundberg, M. D. (2003). Strategies to help students change naïve alternative conceptions about evolution and natural selection. Reports of the National Center for Science Education 23(2), 23–26.
Sundberg, M. D., Armstrong, J. E., and Wischusen, E. W. (2005). A reappraisal of the status of introductory biology laboratory education in U. S. colleges and universities. Am Biol. Teach. 67, 525–529.[CrossRef]
Traver, H. A., Kalsher, M. J., Diwan, J. J., and Warden, J. (2001). Student reactions and learning: evaluation of a biochemistry course that uses web technology and student collaboration. Biochem. Mol. Biol. Ed. 29, 50–53.[CrossRef]
Wilson, J. (1994). The CUPLE physics studio. Phys. Teach. 32, 518–523.[CrossRef]
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | ARCHIVE | SEARCH | TABLE OF CONTENTS |