Preparing the test team.

Team Members.

• Kathy Riley.
• Laura Carlson.
• Barb Johnson.
• Jo Mackiewicz.
• Bruce Reeves.
• Craig Stroupe.

How can others participate?

• Opportunities for student service learning?

What roles are there for test team members?

Depending on personnel available and their talents and interests, some roles can be shared by two or more individuals. Also in some instances multiple roles may be completed by a single individual.

Test coordinator.

Can be co-coordinators.

• In charge of the test plan and coordinating the test.
• Oversees the test team.
• Works with the CWC and the test writer to design the test.
• Acts as a spokesperson for the team.
• Presents the results to the CWC.

Test participant recruiter/scheduler.

To ensure consistent methodology only one person should recruit participants.

• Gets a random sample of potential participants.
  • Uses a database of potential participants for each target audience.
  • Assigns each participant a number.
  • Then picks participants with a random number generator program.
• Contacts prospective participants.
  • Logs all contacts made. (Pending, accepted, rejected...plus contact info.)
  • Uses formal scripts so that all participants are treated equally.
  • Qualifies prospective participants via recruiting script and questionnaire
• Schedules the test.
  • Schedules and confirms the participants for the test.
  • Schedules and confirms the test team members for the test.
  • Schedules and confirms the room (if applicable) for the test.
• Reminds participants and test team members prior to the test.

Test designer/writer.

Can be more than one person.

• Designs and drafts the participant recruiting log.
• Writes the recruiting script.
• Writes the recruiting questionnaire.
• Drafts the consent form.
• Writes the pre-test intro script.
• Writes the pre-test interview.
• Writes the pre-test questionnaire.
• Drafts the task list.
• Organizes the tasks for the test.
• Writes the scenarios for the test.
• Writes the post-test questionnaire.

Test facilitator.

To ensure consistent methodology only one person should facilitate the tests. The person in this position should be a different person from the data logger and camera operator.

• The only person who interacts with the participant during the test.
• Uses formal scripts so that all participants are treated equally.
• Narrates the test. Greets, interacts with and debriefs each participant.
  • Asks the participant to read and sign the consent form.
  • Reads the pre-test intro script.
  • Conducts the pre-test interview.
  • Asks the participant to fill out the pre-test questionnaire.
  • Administers the test itself.
  • Has the participant fill out the post-test questionnaire.

Data logger/note taker.

One primary person should be designated for this position. But everyone else present at the test session should take notes also.

• Keeps track of the beginning, ending, and elapsed time of test activities.
• Times each task separately. This can be done in real time or by reviewing each video tape. (If done after the test session, add extra time to the schedule.)
• Takes detailed notes.

Camera operator.

• Responsible for recording a permanent unbiased account of the entire proceedings. Including:
  • Comments made by the participants.
  • Instructions given by the test monitor.
  • All interactions between the participant, test facilitator and web site being tested.
• Adjusts the equipment for optimum recording.
• Tests camera angles to ensure that the participant and screen are clearly visible.
• Monitors the audio and video during the test unobtrusively. Tries not to draw attention to the camera(s).
• Rewinds and clearly labels the tapes.
• Creates a "highlights" video tape (optional) in coordination with the analyzer/report writer.

Test analyzer/report writer.

Can be more than one person.

• Compiles results.
• Analyzes results.
• Recommends changes.
  • Works with the team to come up with useful recommendations for changes to the web site based on the cause of the errors.
    • Keeps test objectives in mind.
    • Considers global changes before local ones. (Does not lose sight of the forest for the trees)
    • Remains objective. (Only concern is the user).
• Works with the camera operator/video editor to create a "highlights" video tape that supports results. This is optional because it can be very time consuming. But a "highlights" tape can be a very useful addition to the CWC presentation.
• Writes the final report.

Adapted From:

• Barnum, Carol M. Usability Testing and Research (Part of the Allyn & Bacon Series in Technical Communication), Longman, 2001.
• Dumas and Redish. A Practical Guide to Usability Testing, Intellect, 1999.
• Pearrow, Mark. Web Site Usability Handbook, Charles River Media, 2000.
• Rubin , Jeffrey;. Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley & Sons, 1994.

<< previous | next >>