|
|
|||||||
Other Articles |

,
*Department of Horticulture and
Laboratory of Genetics, University of Wisconsin–Madison, Madison, WI 53706
Submitted July 26, 2007; Revised October 9, 2007; Accepted October 22, 2007
Monitoring Editor: Robin Wright
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
There is literature to support the introduction of primer design in undergraduate labs and workshops (Kim, 2000; and Shachack et al., 2005); however, few measure student performance and learning gains during or after implementation of these new materials. Therefore, we purposefully aligned the learning goals with exercise questions to assess the effectiveness of our primer design materials in meeting the specific learning goals of the lab. We expected that our Primer Design Exercise would enhance student understanding and provide a basis for troubleshooting results from the lab. After doing this exercise, one student exclaimed, "Wow, I've been doing PCR in my lab for a year now and I never knew how it worked." This statement highlighted the need to heighten student exposure to the theory behind lab experiments and the keys for a successful PCR reaction (such as understanding the necessary reagents and appropriate concentrations) instead of simply providing a protocol. The Primer Design Exercise also provided additional opportunities for students to gain experience with bioinformatics tools fulfilling an increasing need for the incorporation of bioinformatics into undergraduate biology classes (Honts, 2003; National Research Council, 2003).
This article highlights the process of designing and implementing an active-learning exercise about designing DNA primers for PCR using scientific teaching methods in order to achieve broad and specific learning goals (Handelsman et al., 2004, 2007). During and after implementation, we assessed students' perceptions and performance, which are presented below. We have evidence that this exercise helped students meet the specific learning goals of quality primer design, understanding primer directionality, and using bioinformatics to determine primer annealing specificity. Our experience indicates that these primer design materials can be used broadly to introduce students to the importance of quality biological reagents for DNA amplification and how to utilize bioinformatics databases.
| METHODS OF INSTRUCTIONAL DESIGN |
|---|
|
|
|---|
Learning Goals
Instructional design was initiated by identifying student learning goals that were compatible with the pre-existing goals of the GMO unit and the cell biology lab in general. We outlined broad learning goals that include general skills and conceptual ideas that the students would repeatedly encounter throughout the course (Table 1). We also outlined two measurable, specific learning goals that were targeted to the Primer Design Exercise (Table 1).
|
|
|
|
|
Class Activity
An essential component of PCR is designing quality primers, an exercise with which many undergraduates do not have much experience. To incorporate the theory of PCR into the lab, we developed a Primer Design Exercise that detailed the guidelines of a quality primer and gave the students the opportunity to design and test the quality of the primers they selected. Before starting the exercise, the students were given background on DNA replication during PCR and had already completed a graded exercise in which they drew the first three cycles of PCR. The exercise and answer key are available online at http://scientificteaching.wisc.edu/materials/ and are described in more detail in Phillips et al. (2008). Drawing the cycles of PCR ensured that students were familiar with the replication process and was helpful in identifying misconceptions about DNA replication during PCR. In addition, students were given detailed instructions that described characteristics of quality primers such as appropriate annealing temperature, sequence specificity only to the DNA to be amplified, and no secondary structure. The instructions also outlined the steps to use the Basic Local Alignment Search Tool (BLAST) to test the specificity of the primer sequence in relation to the genome of interest (Supplemental Material A).
To model scientific research, the exercise was written in the context of a researcher trying to identify strains of the bacteria Pseudomonas putida that contain a homolog of a novel aroA gene that confers resistance to glyphosate, the active component in Roundup (Supplemental Material B; answer key is available online). The students were given the DNA sequence of the P. putida aroA gene and were asked to design forward and reverse primers, without the use of a computer program, to amplify a specific region by PCR. Students assessed the quality of their primers using a website (http://www.sigma-genosys.com/calc/DNACalc.asp) that gave information about primer length, base composition, melting temperature, and secondary structure. Students made the decision to use their initial primers or redesign primers of a higher quality. Once good primers were designed, students used the BLAST function to determine the specificity of their primers (http://www.ncbi.nlm.nih.gov/BLAST/) to the aroA gene in P. putida. Finally, to connect the importance of primer design back to the wet lab, students were asked to use all available information to evaluate the primers that they were to use to amplify the constitutive Cauliflower Mosaic Virus (CaMV 35S) promoter to detect the presence of genetically modified organisms in food samples that the students brought to class.
Assessments
To assess student knowledge and retention, data were collected immediately before and after the teachable unit using electronic pre- and postsurveys and by a paper survey 5 months after completion of the unit (Figure 1B). Questions focused both on students' performance and perceptions of their understanding of DNA directionality, the steps of PCR, and bioinformatics tools such as BLAST. Student knowledge was assessed on the pre- and postsurveys by asking the students to write the reverse complement of a DNA sequence and indicate directionality. The retention assessment (5 months after the unit) asked students to design forward and reverse primers with proper directionality when given a DNA sequence. Students were given 10–15 minutes to complete the knowledge retention assessment without asking questions or using references.
An evaluative rubric for the instructors' use was designed to assess whether the students achieved specific learning goals, including understanding primer quality, directionality, and design and the use of bioinformatics tools to test primer specificity (Table 2). These questions covered multiple competence levels as outlined by Bloom's Taxonomy, including comprehension, analysis, and synthesis (Bloom, 1984). We used the broad and specific learning goals as a framework to design rubric questions. This process 1) ensured that the specific learning goals were being assessed by the questions on the exercise, 2) gave the instructors focal points to emphasize with the students during the unit, and 3) provided a standard to compare the pre- and postsurveys, the exercise, and retention questions (Huba and Freed, 2000; Handelsman et al., 2007). After completion of the teachable unit, student responses were scored using a three-level scale, with a level three signifying the most complete answer. This evaluation was not included in the students' grades.
Class Structure
During the teachable unit, the students were given the exercise to work on in groups of four as time allowed during the lab. Students had full access to all materials and instruction sheets as well as lab computers and the Internet to complete the exercise. In addition, multiple instructors were available to answer questions. We found that the cursory coverage of PCR in lecture led to misconceptions and confusion with multiple molecular techniques and reagents. For example, students often confused the use of primers to amplify DNA in PCR and the use of restriction enzymes to cleave DNA in cloning. We encouraged the students to ask questions and engaged them in discussions to work through misconceptions and troubleshooting. Groups were formed randomly and often included at least one student experienced with PCR and/or primer design. Groups were actively engaged in the exercise and worked together to solve problems that promoted scientific communication and critical thinking (Ahern-Rindell, 1998).
| RESULTS |
|---|
|
|
|---|
Student understanding of DNA directionality was assessed multiple times over the course of the teachable unit (Figures 2B and 3). An assessment of student performance before the unit (presurvey) showed that most students obtained a level two understanding of primer directionality, indicating they were able to write the reverse or the complement of a DNA sequence but not both. However, on the Primer Design Exercise 85% of the students obtained a level three, meaning they designed primers that would allow the PCR reaction to work. Results of the retention survey, assessed 5 months after the unit, indicated that although some students could design appropriate primers (level 3), the majority of the students had trouble designing a reverse primer (Figure 3B).
Students perceptions' of their understanding of directionality were assessed in pre- and postsurveys (Figure 3A). Before the teachable unit 70% of the students had heard of directionality but were unsure of the contextual meaning. Only 7% felt they understood and could extend the concepts of directionality to primer design and other topics. After completion of the unit, 95% felt they understood the topic, with about half of those students reporting they could extend their knowledge to other contexts.
In addition, students' perceptions of their understanding of DNA primers and BLAST functions were also queried (Figure 2, A and C). As before, a majority of students reported on the presurvey they had heard of these topics but were unsure of the context. On completion of the unit, 100% of students reported an understanding of DNA primers and approximately 90% reported an understanding of BLAST searches. Many of these students also felt they could extend these topics to other contexts.
As part of the postsurvey, students were questioned on the usefulness of these materials in learning to design primers and perform BLAST searches. Sixty-three and 46% of students reported the primer design and BLAST search exercises, respectively, greatly contributed to their understanding of the technique. Thirty-three and 35%, respectively, found the exercises to somewhat help their understanding or clarify a misconception about the topic.
| DISCUSSION |
|---|
|
|
|---|
Student Performance
To assess the Primer Design Exercise, three assessment questions about primer quality, directionality, and specificity were based on the specific learning goals and evaluated using a rubric (Tables 1 and 2). As illustrated in Figures 2 and 3, students clearly grasped the concepts of primer quality and orientation but had more difficulty with the question regarding specificity and BLAST searches. Question 1 surveyed a comprehension level of student understanding of quality primers, as defined by Bloom's Taxonomy (Bloom, 1984). Students were able to read the criteria of quality primers and assess the quality of their own primers. Question 2 was an analysis-level question about primer directionality. Students initially struggled to visualize both strands of DNA and where each primer would bind. However, while completing the exercise, the students comprehended the concept of directionality by combining knowledge of DNA replication and base complementarity. Question 3 targeted synthesis of multiple sources of information. This question required higher-order thinking as students had to evaluate a single primer sequence in relation to multiple genomes, which may explain why more students struggled with the concept of specificity, ultimately exposing more misconceptions (see below).
Student perceptions of their understanding of DNA directionality, primer quality, and specificity corresponded well with measured student performance on the Primer Design Exercise (Figures 2 and 3). With regard to primer quality and DNA directionality, 95–100% of students reported that they understood these topics at the end of the exercise. This correlated with the majority of students achieving a level three of performance for questions corresponding to these topics. However, students were less confident in their ability to analyze the specificity of primers as it relates to the output of a BLAST search. This was evident in the misconceptions that were voiced and in their performance on specificity related questions.
Despite the incomplete understanding of specificity, we felt the specific student learning goals were met. By the end of the unit, students were clearly able to design primers using bioinformatics databases and had an intermediate understanding of specificity that iterations of the concept could clarify. Through hands-on problem solving, 37% (level three) of students retained a complete understanding of primer directionality, and 21% (level two) of students retained a partial understanding (Figure 2B). This indicated that, although the students had mastered primer design during the teachable unit, some of this knowledge was not retained. However, this initial exposure to primer design laid the theoretical groundwork for further investigations using PCR primers or, by extension, other techniques involving DNA hybridization.
We believe that the testing environment for the retention question was significantly different from during the teachable unit because it was an individual task with no associated consequences such as the success or failure of their own experiment or receiving a grade. This may correlate with a reduced effort and seemingly less retention. It would also be interesting to further examine this idea of retention and whether it correlates to repeated exposure. For example, when discussing another molecular technique such as Northern blot hybridization, probe design should be highlighted to again discuss base complementarity and DNA directionality.
Identifying and Addressing Misconceptions
In addition to meeting the learning goals, we found several benefits to students designing their own primers. First, the students better understood the theory of how PCR is used to amplify a specific DNA sequence and why quality primers are so important, which helped to demystify the "magic" of PCR (Figure 2B). Second, students were better able to analyze their own results. A specific example of troubleshooting occurred when students in one section were mistakenly given a primer to use in the wet lab that had a single nucleotide error at the 3' end of the primer. When the lab technician realized the error, students were asked to explain how this error would affect the reaction and predict what their gel would look like. Through group discussion they were able to troubleshoot this problem and interpret the unexpected bands, which appeared on the gel. In the other four class sections we proposed the same problem of a single nucleotide change in the primer sequence and asked the students to predict the results of a PCR reaction with these primers. The students were able to draw the results on the board and explain why additional bands would appear on the gel. Additionally, the students were able to predict how an error at the 5' end of the primer might affect the reaction differently. Lastly, in designing their own primers, students exposed and often clarified their misconceptions about DNA replication, primer directionality, and primer specificity.
During the teachable unit, many misconceptions were identified by students and instructors. We had anticipated some of these from previous teaching experiences, but others were unexpected. The misconceptions were realized through various questions on the Primer Design Exercise. Supplemental Material C is an example of a student response to question 1 on the Primer Design Exercise that illustrates common misconceptions about DNA directionality, complementarity, primer annealing, and the DNA extension step of PCR. These misconceptions resulted in the design of primers that would not amplify the target sequence.
We observed that students had difficulty visualizing the second strand when given a single strand of a DNA sequence, which often led to designing both the sense and antisense primers as reverse complements of the sequence given. Many students did not fully grasp the concept until we asked them to write the base pair sequence, write the complementary strand, and identify 5' and 3' ends. It was through this formative assessment that the students made the connection between primer annealing and DNA extension. This process of active learning helped students recognize and clarify their misconceptions about DNA directionality and complementarity. Discussions with instructors or peers helped students to correct their misconceptions about primer directionality. This is evident in Figures 2 and 3, as the majority of students reached a level 3 understanding of primer directionality.
Students also struggled to understand the importance of specificity of the primer to the target sequence and how a BLAST search can indicate specificity. Students were able to compare their primers to a single organism, such as when analyzing BLAST results from the search for the aroA gene in P. putida. However, the students were less clear about the importance of specificity when asked to analyze search results for the CaMV 35S promoter primers from multiple organisms that may be present in their food products. They were also asked to think about contaminating DNA from their own hands. We observed that the students became confused when trying to differentiate between an exact alignment of what they were looking for, the source transgenic plants, and other relevant alignments that would indicate cross-reactivity. In addition, those who could identify other relevant alignments struggled to conceptualize the meaning of this alignment in relation to how their PCR results would appear on a gel and if additional bands could be explained by nonspecific priming. This more prevalent misconception is illustrated in Figure 2D, which shows that a significant portion of students remained at a level 1 of understanding. We were limited to one-on-one discussions about specificity and the meaning of BLAST results because time did not allow for a whole-class discussion; however, this may be more appropriate in the future. We revised the Primer Design Instruction Sheet in an attempt to clarify this topic, which is included as Supplemental Material A.
Transferability
Although designed to fit in the context of this lab, the exercise could easily be modified to be used in different settings such as a large classroom, independent research, or workshops as either an in-class or out-of-class activity. The Primer Design Instruction Sheet and Exercise are universal such that they could be applied to the amplification of any gene. We feel the design of this exercise could also be used as a template for designing other active-learning exercises that highlight experiment preparation and design, for example as with DNA or RNA probes used for Southern blots, Northern blots, in situ hybridization, or microarray.
Final Comments
We designed a Primer Design Exercise to complement the lab techniques that the students were concurrently learning. In doing so, students were able to correlate the biological principles involved in primer design and how primers affect PCR results. We used an active-learning approach to put the exercise in the context of amplifying a real gene for a defined experiment giving the students a sense of purpose. This lab exercise provided students with another realistic and diverse example of primer design, allowing them to build on existing knowledge, construct their own ideas, correct misconceptions, and get hands-on experience with this process.
We believed students were receptive to this hands-on approach to learning primer design because they were very engaged in the group activity and many voiced positive comments about this exercise. In this study we found that the concurrent lecture about PCR and primer design did not give students the opportunity to explore primer design and bioinformatics databases and construct their own ideas about primer directionality and specificity. One student stated, "I wish we would have done this exercise before we had to design primers from a protein sequence. I would have understood that lecture assignment better." In using active learning we were able to uncover many misconceptions about the topic and utilized group work to help clarify these misunderstandings. The rubric was designed to directly assess the specific learning goals and determine the effectiveness of the teachable unit. We found that the results of the rubric evaluation correlated well with student perceptions of how well they understood primer directionality, quality, and specificity. We hope the materials provided will benefit other instructors teaching these concepts.
Accessing Materials
The final Primer Design Instruction Sheet and Exercise are included as Supplemental Material and can also be accessed with the associated rubric and answer keys from the WPST Digital Library http://scientificteaching.wisc.edu/materials.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
These authors contributed equally to this work and were equally involved in designing and evaluating the effectiveness of the exercises presented here. Address correspondence to: Amber L. Robertson (robertson{at}wisc.edu)
| REFERENCES |
|---|
|
|
|---|
Batzli, J. M. (2005). A unique approach? Four semesters of Biology core curriculum. In: Points of view: A survey of survey courses: Are they effective? Cell Biol. Educ. 4, 125–128.[CrossRef]
Biological Sciences Curriculum Study (2003). BSCS 5E instruction model. In: BSCS Biology: A Human Approach, Dubuque, IA: Kendall-Hunt.
Bloom, B. S. (1984). Taxonomy of Educational Objectives, Boston, MA: Allyn and Bacon.
Handelsman, J., et al. (2004). Scientific teaching. Science 304, 521–522.
Handelsman, J., Miller, S., and Pfund, C. (2007). Scientific Teaching, New York: W. H. Freeman and Co.
Honts, J. E. (2003). Evolving strategies for the incorporation of bioinformatics within the undergraduate cell biology curriculum. Cell Biol. Educ. 2, 233–247.[CrossRef][Medline]
Huba, M. E., and Freed, J. E. (2000). Using rubrics to provide feedback to students. In: Learner-Centered Assessment on College Campuses, Boston, MA: Allyn and Bacon, 151–200.
Kim, T. D. (2000). PCR primer design: an inquiry-based introduction to bioinformatics on the World Wide Web. Biochem. Mol. Biol. Educ. 28, 274–276.[CrossRef]
National Research Council (2003). Bio 2010: Transforming Undergraduate Education for Future Research Biologists. Committee on Undergraduate Biology Education to Prepare Research Scientists for the 21st Century, Board on Life Sciences, Division on Earth and Life Studies, Washington, DC: National Academy Press.
Phillips, A. R., Robertson, A. L., Batzli, B., Harris, M., and Miller, S. (2008). Integrating PCR theory and bioinformatics into a research-oriented primer design exercise. CBE Life Sci. Educ. 7, 00–00.
Sambrook, S., and Russell, D. W. (2001). Molecular Cloning: A Laboratory Manual, New York: Cold Spring Harbor Laboratory Press.
Shachak, A., Ophir, R., and Rubin, E. (2005). Applying instructional design theories to bioinformatics education in microarray analysis and primer design workshops. Cell Biol. Educ. 4, 199–206.[CrossRef][Medline]
Sun, Y., et al. (2005). Novel AroA with high tolerance to glyphosate, encoded by a gene of Pseudomonas putida 4G-1 isolated from an extremely polluted environment in China. Appl. Environ. Microbiol. 7, 4771–4776.
Tanner, K., and Allen, D. (2004). Approaches to biology teaching and learning: learning styles and the problem of instructional selection—engaging all students in science courses. Cell Biol. Educ. 3, 197–201.[CrossRef][Medline]
Wiggins, G., and McTighe, J. (1998). Understanding by Design, Alexandria, VA: Association for Supervision and Curriculum Development.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | ARCHIVE | SEARCH | TABLE OF CONTENTS |