Two CD-ROMs from a series dealing with various major aspects of cell biology are evaluated in this paper using quantitative and qualitative approaches. The findings delimit similarities and differences of the two CD-ROMs and shed light on how the programs could be used in the learning process and how they should not be. The overall impression, as well as the graphical and technical features, received a predominantly good rating. The defined target groups were reached (e.g., students in secondary schools), different learning approaches were supported (e.g., discovery and autonomous learning), the CD-ROMs' usability was assessed as being easy and intuitive, and the majority of the evaluators were satisfied with the level of interactivity. Navigational problems encountered in CD-ROM 1 were overcome by a successful implementation of new navigational functions in CD-ROM 2. Most students found the CD-ROM to be a suitable complement to, or an extension of, their lessons. We conclude that many, but not all of the requirements for the various stages of the learning process could be satisfied with the existing CD-ROMs. The requirements not met are discussed to obtain insights that could help to improve the production of multimedia learning material. The use of quantitative and qualitative approaches in the evaluation of learning modules is discussed, as the study began by collecting and analyzing anecdotal reviews and was then extended to include a qualitative evaluation.

We describe an assessment of the collective impact of 35 grants that the Howard Hughes Medical Institute (HHMI) made to biomedical research institutions in 1999 to support precollege science education outreach programs. Data collected from funded institutions were compared with data from a control group of institutions that had advanced to the last stage of review but had not been funded. The survey instrument and the results reveal outcomes and impacts that HHMI considers relevant for these programs. The following attributes are considered: ability to secure additional, non-HHMI funding; institution buy-in as measured by gains in dedicated space and staff; enhancement of the program director's career; number and adoption of educational products developed; number of related publications and awards; percentage of programs for which teachers received course credit; increase in science content knowledge; and increase in student motivation to study science.