Reading seminar 2

The eleventh chapter of the course book deals with evaluation. More specifically it deals with the process of trying to improve your prototype with the help of paradigm evaulation and the framework DECIDE.

Paradigm evaluation is described in the subschapter 11.2 and it is a method for doing an evaluation on the product. There are four core paradigm evaluations: “quick and dirty”,  “usability testing”, “field studies”, and “predictive evaluation”. The techniques that is used in these evaluations are: observing users, asking users or experts for their opinion, testing users’ performance and modelling users’ task performance.

In the follwowing subchapter is the framework “DECIDE” described which is helpful for planning evalutions. The framework consists of the checklist:

1. Determine the overall goals that the evaluation adressess.
2. Explore the specific questions to be answered.
3. Choose the evaluation paradigm and techniques to answer the questions.
4. Identify the practical issues that must be adressed.
5. Decide how to deal with the ethical issues.
6. Evaluate, interpret, and present the data.

It can also be useful to to a pilot study before you do the main study to ensure that the study is well designed. A pilot sudy is a small trial run of the main study.

The theme of chapter 13 is “asking users and experts” and it deals with the different ways that you can get useful information about the product from other people. From the chapter we learn about the three styles of interviews which is structured, semi-structured and unstructured. Structured interviews can be replicated with large numbers of users with the help of surveys. Getting feedback from experts can also be useful, for exampel in a predictive evaluation is done by an expert who offer their opinions on the design.

The following chapter is about user tesing, which is a central part of usability testing. The test is usually done in controlled conditions like a laboratory. Many aspects of user testing is discucussed in the chapter ush as setting up test, collecting data and analyze the results from the test.

The question that I want to bring up at the seminar is: What are our ethical issues when it comes to our ideas and prototypes?

Kenneth Runnman