The Override Test
Exercise 3: The Override Challenge
Layers Used: Layer 4 (Contradiction Challenge)
Chapter 2's error detection applied to AI's business analysis. Your Error Taxonomy from Chapter 2 is now your override trigger. The same diagnostic rigor applies -- but the errors are in AI output rather than in a scenario.
What You Do
Use AI to produce a competitive analysis for a product. The instructor has designed the prompt to produce an analysis with a specific subtle error (a logical flaw, a market assumption that does not hold, or an outdated data point). Without being told what the error is, you must: (a) identify it, (b) explain why AI made it, (c) produce a corrected version, and (d) design a prompt that would prevent this error in future.
The original AI-generated analysis. Your error identification with explanation of the error type, why AI made it, and its impact on the analysis. Your corrected analysis. Your redesigned prompt that would prevent the error. A brief explanation of your error-detection process -- how did you find it?
I was given an AI-generated competitive analysis that contains a deliberate
subtle error. I identified the error, explained why AI made it, corrected the
analysis, and redesigned the prompt to prevent it. Please:
(1) Did I correctly identify the error? If not, give me a hint and let me
try again.
(2) Is my explanation of WHY the AI made this error accurate?
(3) Does my corrected analysis actually fix the problem without introducing
new errors?
(4) Would my redesigned prompt actually prevent this type of error? Test it by
mentally running the prompt -- would it produce a better result?
(5) Rate my error-detection process -- was my approach systematic or did I get
lucky? How can I make my detection process more reliable?
Original analysis: [paste].
My error identification: [paste].
My corrected analysis: [paste].
My redesigned prompt: [paste].
Finally, complete the Thinking Score Card for this exercise:
Independent Thinking (1-10), Critical Evaluation (1-10),
Reasoning Depth (1-10), Originality (1-10), Self-Awareness (1-10).
For each score, give a one-sentence justification.
What This Teaches You
You learn the override instinct -- the willingness and ability to say "the AI is wrong here" and back it up. Most students either trust AI too much (never override) or override randomly (reject good output). This exercise trains the specific skill of knowing WHEN and WHY to override.