01. A group of teams at an online education provider has run three short experiments toward the same Tactical Goal. Each experiment was measured, and none of them moved the measure that Tactical Goal names. The Intermediate Goal it serves is unchanged and still current.
What should the group do next?
a) Escalate so the leadership team can reconsider the Intermediate Goal before more effort is spent.
b) Replace the Tactical Goal so a different route to the Intermediate Goal is tried.
c) Continue with the current experiments for another cycle, since three results are too few to judge the approach.
d) Ask the leadership team to lower the measure the Tactical Goal names, so this quarter shows progress.
02. A leadership team is reviewing a list of statements it has been asked to put to experiments next quarter. It wants to keep only the statements an experiment could usefully settle and return the rest to their authors.
Which two properties make a statement a hypothesis worth putting to an experiment?
(Choose two.)
a) It rests on an assumption about customer behavior that the organization is genuinely unsure about.
b) It commits the Developers to the outputs they will deliver and to the Sprint in which each one is finished.
c) It restates an Intermediate Goal that the organization has already agreed, using the same Key Value Measure and the same target date as the goal itself.
d) The executive sponsor holding the budget has agreed that the statement matches current priorities.
e) It states in advance what the organization will do differently depending on how the result comes out, whichever way it turns out.
03. A logistics company holds an Intermediate Goal of shortening the time between an order and the first delivery attempt. Its latest hypothesis, that letting customers pick a delivery window at checkout would shorten that time, was disconfirmed by a two-week trial covering eleven thousand orders at very little cost.
What should the leadership team do next?
a) Keep the Intermediate Goal and change the approach, since the trial ruled out this particular route towards it rather than the destination.
b) Add the delivery-window option to the Product Backlog so the Developers can improve it in a later Sprint.
c) Abandon the Intermediate Goal, because the evidence shows it cannot be reached.
d) Roll the delivery-window option out to every customer anyway, on the grounds that two weeks is far too short a period to judge a change of this kind properly.
04. A logistics company released a redesigned booking page and then surveyed the customers who used it. Those customers rated their satisfaction at 72 percent, and the leadership team concludes that the redesign raised customer satisfaction.
What most weakens that conclusion?
a) The satisfaction rating came from the customers who had used the page rather than from the Developers who built it.
b) No satisfaction figure was recorded before the redesign went live.
c) The result was inspected at the Sprint Review instead of at a dedicated leadership meeting.
d) The Product Owner chose the wording of the survey.
05. A logistics company's Intermediate Goal is that new shippers rebook without contacting a salesperson. Over the past quarter its teams achieved every Tactical Goal that had been set for that Intermediate Goal. The measures behind the Intermediate Goal itself have not moved.
What does that evidence most strongly indicate?
a) The teams need more time, since outcomes always lag the work that produces them.
b) The Intermediate Goal's measures are the wrong ones and should be replaced.
c) The Intermediate Goal was set too far ahead of what the organization can deliver, and a nearer one should replace it.
d) The belief that these Tactical Goals would advance the Intermediate Goal is not supported by the evidence.
06. A regional insurer expected a new self-service portal to cut the share of policies canceled within their first year, and that share did not change over the period the team had set aside. Across the same weeks the average time to settle a claim fell noticeably, which nobody had predicted and which the portal was never aimed at.
How should the leadership team read this result?
a) Report the experiment as a success on the strength of the measure that improved, and continue with the planned rollout.
b) Keep the hypothesis open and extend the experiment until the cancellation share moves.
c) Record the original hypothesis as disconfirmed, and treat the shorter settlement time as a fresh assumption to be tested on its own.
d) Discard both readings, because an experiment that produces an unexpected change cannot be interpreted.
07. A regional insurer's Intermediate Goal is that customers can renew a policy without help from an agent. Nine renewals in ten still involve a phone call, and the leadership team wants a Tactical Goal for the next two months.
Which proposal is properly derived from that Intermediate Goal?
a) Deliver the eleven renewal-portal features that the release plan lists by the end of the second month.
b) Halve the share of renewals that need a phone call for the two largest products.
c) Cut the average handling time of renewal calls by a fifth.
d) Remove the need for agent help across every product line the insurer sells, within two years.
08. An online education provider has set a Tactical Goal for the next two months: more of the learners who enroll should finish the first lesson. Measurement is already in place across the platform, and the leadership team is deciding what to look at.
Which three measures would give the team evidence about whether that Tactical Goal was reached?
(Choose three.)
a) Hours the Developers spent reworking the enrollment flow over the two months.
b) Share of enrollments that open the first lesson and stop before the end.
c) Share of learners who finish the first lesson within seven days of enrolling.
d) Median number of days between enrolling and completing the first lesson.
e) Number of new lessons published in the catalog over the two months.
f) Share of learners who renew their subscription at the end of the calendar year.
09. An online education provider wants more of its enrolled learners to finish the courses they start. A leader offers the following statement for next quarter's experiment: as demand for professional study grows, our course completion rate will rise by five percentage points.
Why can the provider not test this statement as written?
a) It ties the expected rise to a market condition the provider does not control rather than to a change the provider will make.
b) It names a rise of five percentage points, which is a larger movement than a single quarter of work on one course could realistically produce.
c) It uses course completion rate, which is an output of the provider's teaching rather than a customer outcome.
d) It sets a target for a whole quarter instead of for a single Sprint.
10. An organization has reached the Intermediate Goal it set eighteen months ago, and its Strategic Goal is still some way off. A sequence of further Intermediate Goals was drafted at the time the first one was set.
What best describes how the next Intermediate Goal should be chosen?
a) The drafted sequence of goals that was agreed with stakeholders should be followed, since it keeps planning toward the Strategic Goal stable.
b) It falls to whichever drafted goal the teams have spare capacity for.
c) It follows from the gap that still remains toward the Strategic Goal and from what the experiments taught.
d) The next goal should be the one the largest customer segment has been asking for most insistently over the past year.