01. A draft usability test report is being checked against the best practices for usability test reporting.
Which two of the following follow those best practices?
(Choose two.)
a) An explanation of what usability is and of the human-centered design process, placed ahead of the findings
b) A one-page executive summary carrying only the most important findings, placed at the start of the report
c) A full transcript of every usability test session, so that readers can follow how each finding arose
d) No copy of the recruitment screener, and no copy of the confirmation sent to the participants
02. A team runs its usability test sessions exactly to the script. Each session ends the moment the last usability test task is finished, so that the participant can be thanked and released promptly.
Which of the ten most frequent and serious mistakes does this describe?
a) Critical results ignored, because the participant gets no chance to raise what mattered most
b) Incorrect focus, because the sessions address minor details instead of effectiveness and efficiency
c) The moderator is too active, because the session is driven by the script rather than by the participant
d) No post-session interview, so the participant's impression of the test is never summarized
03. A team working in an agile lifecycle has finished a usability test and is deciding how to communicate the results.
How does the syllabus expect reporting to differ in that setting?
a) The same report is written, but briefness and keeping to the point are given a lower level of importance
b) Less emphasis falls on documentation, the report may take the form of a verbal briefing, and results may be turned directly into backlog items
c) The findings are documented more formally, because the product owner has to approve every severity rating
d) A written report is no longer permitted, because the findings are discussed by the whole team in a retrospective instead
04. A tester is explaining why the needs of the people who attend a usability test session are weighed so heavily when the test location is chosen.
According to the syllabus, who are the primary users of any usability test session?
a) The observers, whose ability to watch, discuss and come and go the location has to support
b) The moderator and the note-taker, who between them conduct the session and record the findings that come out of it
c) The test participants, who solve the typical tasks that the whole of the session has been built around
d) The developers of the product, who will act on the findings that the sessions produce
05. A usability test report describes one of its findings with the header Error messages are not helpful, followed by a paragraph restating the same point in other words.
What does the syllabus require of a general statement of that kind?
a) That it be split into one finding per error message
b) That it be supported by at least two examples
c) That it be supported by a quote from every affected participant
d) That it be moved to the annex holding the screenshots
06. A usability tester performing quality control on a usability test has sat in on several sessions and written down what they saw.
What does the syllabus ask them to do with their own observations?
a) Keep them out of the analysis, because only the note-taker's observations may form the basis of findings
b) Add them to the usability test report as a section, so that the observations of all three are documented
c) Compare them with the notes made by the moderator and the note-taker, and raise an issue where important findings went unnoted
d) Hand them to the moderator, so that they can be merged into the common list of problems and positive findings
07. Five of the eight test participants said, without being asked, that the design of the home page is really pretty. The tester is deciding whether that belongs in the usability test report.
What does the syllabus say about reporting findings that rest on participants' opinions?
a) They may be reported, but only where the opinion was expressed spontaneously by a majority of the test participants
b) They may not be reported at all, because a usability test shows only what representative users are able to accomplish
c) They may be reported, but only where the moderator put the same question about the design to every one of the participants
d) They may be reported only as good ideas, because an opinion about the design suggests an improvement
08. The last usability test task is finished and the moderator opens the post-session interview.
Which pair of questions does the syllabus give as the key questions for that interview?
a) What is your background, and what previous experience do you have with software of this kind?
b) Which 2-3 things did you like most, and which 2-3 things are most in need of improvement?
c) Is the design of the home page appropriate, and would you recommend this product to a colleague?
d) Which of the tasks did you complete, and how long did each one take you to finish?
09. The usability test report has been distributed, and the results are now being presented to the development team and to management.
Which quality control task does the syllabus set for that stage?
a) Check that stakeholder objections are logged for a reissue
b) Check that the moderator answers every question raised
c) Check that every finding on the common list is presented
d) Check that the communication is two-way
10. Two usability problems from the same test are being rated. Both stopped some participants, and both have consequences for the user beyond the session itself.
Which statement distinguishes a Critical usability problem from a Catastrophic one?
a) A Critical problem causes substantial delays for the user, while a Catastrophic problem causes moderate dissatisfaction
b) A Critical problem is one the participants recovered from, while a Catastrophic problem is one that they gave up on
c) A Critical problem may do the user minor financial damage, while a Catastrophic problem may do the user substantial financial damage
d) A Critical problem affects the effectiveness of the user, while a Catastrophic problem affects efficiency and satisfaction