Educational Technology      Sunny's portfolio       Univ of Missouri

competency

Systematic evaluation of a selected artifact

Evaluation Method

The conceptual frame of evaluation was “activity theory”. In the activity theoretical point of view, this evaluation focused on the object and tools & signs for usability and on the subject, rule and community for social concept.

There was no real program, so a researcher developed an evaluation protocol for a cscw design and carry out an usability test using a CSCW prototype. For the usability test, participants tried to be familiar with the prototype at first and imagined the situation of workflow using the system. They were asked to answer a survey containing likert scale questions and free style comments. Evaluation processes recorded by an audio recorder and the protocol submitted by participants were analyzed.


Evaluation Results

From the usability test, we found following lessons.

Scheduling program is useful for online collaboration because it shows group members work schedule as well as group one. We can see whiteboard calendar in office, which is a common work flow and concept of group work. So if we adopt real work flow concept in CSCW, it will works well.

Synchronous communication tool should consider following issues;

  • to allot ownership in order to control group communication
  • to control editing permission when members try to edit same document at the same time
  • to show group members activities

This program will be more powerful when it takes the advantage of both synchronous and asynchronous communication tool. Especially, sharing monitor is synchronous communication tool, which looks like face to face meeting. So users can use this tool to make decision or to discuss.

Artifact
Description
Reflective Comments
Sakai Group Project Manager [click]
The purpose of this evaluation is to assess the usefulness of “Sakai Group Project Manager” in two points …[click]
One of the most impressive things in my design work was to develop a prototype. To do so, I wrote many scenarios and … [click]