The Override Test
Exercise 3: The Override Challenge
Layers Used: Layer 4 (Contradiction Challenge)
Chapter 2's error detection applied to AI's business analysis. Your Error Taxonomy from Chapter 2 is now your override trigger. The same diagnostic rigor applies -- but the errors are in AI output rather than in a scenario.
What You Do
Use AI to produce a competitive analysis for a product. The instructor has designed the prompt to produce an analysis with a specific subtle error (a logical flaw, a market assumption that does not hold, or an outdated data point). Without being told what the error is, you must: (a) identify it, (b) explain why AI made it, (c) produce a corrected version, and (d) design a prompt that would prevent this error in future.
The original AI-generated analysis. Your error identification with explanation of the error type, why AI made it, and its impact on the analysis. Your corrected analysis. Your redesigned prompt that would prevent the error. A brief explanation of your error-detection process -- how did you find it?
I was given an AI-generated competitive analysis that contains a deliberate subtle error. I identified the error, explained why AI made it, corrected the analysis, and redesigned the prompt to prevent it. Please:
(1) Did I correctly identify the error? If not, give me a hint and let me try again. (2) Is my explanation of WHY the AI made this error accurate? (3) Does my corrected analysis actually fix the problem without introducing new errors? (4) Would my redesigned prompt actually prevent this type of error? Test it by mentally running the prompt -- would it produce a better result? (5) Rate my error-detection process -- was my approach systematic or did I get lucky? How can I make my detection process more reliable?
Original analysis:
My error identification:
My corrected analysis:
My redesigned prompt:
Finally, complete the Thinking Score Card for this exercise: Independent Thinking (1-10), Critical Evaluation (1-10), Reasoning Depth (1-10), Originality (1-10), Self-Awareness (1-10). For each score, give a one-sentence justification.
Discuss with an AI. Question your scores.
Come back when you have your BEST evaluation.
What This Teaches You
You learn the override instinct -- the willingness and ability to say "the AI is wrong here" and back it up. Most students either trust AI too much (never override) or override randomly (reject good output). This exercise trains the specific skill of knowing WHEN and WHY to override.