Successful project management starts with clearly defined project milestones that include client reviews and approvals at each point. These milestones or events loosely follow the Instructional Systems Design process described in Chapter Five. Recommended project milestones are detailed below.

Project Kick-off

The kick-off meeting gathers all key team members from the client and the vendor for a face-to-face review of the major project parameters. Typically, the proposal is reviewed, schedules are confirmed, and individual roles and lines of communication are clarified. If available, source materials and technical specifications are turned over to the vendor at this time.

Analysis, Design Document, and Rapid Prototype

The vendor conducts a thorough needs analysis or reviews the client's analysis if one has been completed ahead of time. This step culminates in a high-level design document that reviews audience demographics; details technical specifications; provides a detailed content outline; and describes strategies for interactivity, navigation, testing, and tracking. Along with the design document, the vendor supplies a rapid prototype that is reviewed with the same technology that will be available to the students. The prototype shows the interface, structure, and performance of the software. The client carefully reviews the design document and prototype, and provides written feedback to the vendor. After the vendor makes requested changes, approval is granted to continue.

Script or Storyboard

Sometimes called a detailed design document, in this step the vendor's instructional designers produce detailed scripts or storyboards. This document describes the details of every screen, including text, audio narration, video, and a description or sketch of graphics. Notes on each screen provide direction to the programmer and client about special navigation or other options (see Appendix I for a sample script). The client reviews these documents carefully and provides written feedback to the vendor. Revisions are made and approved before proceeding.

Development

After final script approval, development begins on all media. Artists create graphics and illustrations while audio narration and video is recorded, edited, and digitized. When these media items are complete, programmers produce the final program. A thorough round of quality control uncovers any software bugs or other problems.

Pilot Test or Formative Evaluation

At this stage, the program is tested with members from the actual student population. This pilot test is completed with 3 to 10 individuals in an environment that is identical to the one the actual students will use. This pilot test is designed to both uncover any technical glitches or bugs, and also to confirm that the instructional program is sound and achieving its objectives. Based on the results of this test, bugs are fixed and final adjustments are made to the content.

Delivery

To prepare for delivery, a final round of quality control is conducted on the master CD-ROM or actual Web-site location where the program is held. After thorough testing, the vendor produces any necessary CD-ROM labels, jewel case packaging, or quick reference user instructions. CD-ROMs are duplicated and distributed or the Web-based training program is uploaded to the server and opened for access.

Evaluation

Finally, the vendor and client work closely to evaluate the results of the program (see Chapter Five). Student evaluations and scores are tabulated and summarized and observations of behaviors completed. A brief memo or report describing the cost, benefit, and return-on-investment of the program provides vendor and client with evidence of the effectiveness of the solution.