chore: snapshot in-progress question-gen work before preflight fixes

store/prompts/question_gen/enumeration.md

@@ -17,6 +17,13 @@ Your task: Generate an **enumeration** multiple-choice question that tests count
 - Avoid trivially small counts (e.g., "How many people?" when only 1 is visible).
 - Each option must begin with "A. ", "B. ", "C. ", or "D. ".
 
+## Prohibited Patterns
+
+- Do NOT fabricate counts or list items absent from the provided material — no invented quantities, names, or sequences that are not explicitly confirmable from the subtitles or frames.
+- Do NOT construct numerical options in ascending or descending order where the correct answer is the extreme value — shuffle the magnitudes across options.
+- Do NOT write a question where multiple counting interpretations could yield different correct answers — the scope of "what to count" must be unambiguous.
+- Do NOT ask questions answerable by common sense about typical quantities (e.g., "How many wheels does the car have?") — the count must require watching this specific content.
+
 ## Output
 
 Respond with ONLY a valid JSON object. No additional text.

store/prompts/question_gen/gate_key_verify.md

@@ -4,9 +4,11 @@ You are a quality-control judge for video understanding questions.
 
 ## Task
 
-Given the source material from a video and a multiple-choice question with its designated correct answer, determine whether the correct answer is **supported by evidence** in the source material.
+Given the source material (text descriptions AND video frames) from a video and a multiple-choice question with its designated correct answer, determine whether the correct answer is **supported by evidence** in the source material.
 
-## Source Material
+**IMPORTANT:** You can see both the text descriptions AND the actual video frames. The correct answer may be visually evident in the frames even if not explicitly mentioned in the text descriptions. Use BOTH modalities for your judgment.
+
+## Source Material (Text)
 
 {source_text}
 
@@ -24,9 +26,10 @@ Given the source material from a video and a multiple-choice question with its d
 
 ## Instructions
 
-1. Read the source material carefully.
-2. Determine if the designated correct answer can be derived or inferred from the source material.
-3. If evidence supports the answer, verdict is "pass". If not, verdict is "fail".
+1. Examine the video frames carefully for visual evidence.
+2. Read the text descriptions for contextual evidence.
+3. If evidence from EITHER the frames OR the text supports the answer, verdict is "pass".
+4. Only verdict "fail" if NEITHER the frames NOR the text provide any support for the answer.
 
 ## Response Format (strict JSON)
 

store/prompts/question_gen/reasoning.md

@@ -17,6 +17,13 @@ Your task: Generate a **multi-hop reasoning** multiple-choice question that requ
 - The reasoning chain should be verifiable from the provided material.
 - Each option must begin with "A. ", "B. ", "C. ", or "D. ".
 
+## Prohibited Patterns
+
+- Do NOT fabricate details absent from the provided material — no invented names, numbers, dialogue lines, or events that are not explicitly present in the subtitles or visually confirmed in the frames.
+- Do NOT construct options where the correct answer is the largest number, the last item in a sequence, or the most visually salient choice — these patterns let a test-taker guess without understanding the content.
+- Do NOT write a question where multiple options could reasonably be considered correct — each distractor must be clearly wrong given the source material.
+- Do NOT ask questions answerable by common sense or world knowledge alone (e.g., "What happens after X?" when the causal link is obvious) — the reasoning chain must depend on video-specific evidence.
+
 ## Output
 
 Respond with ONLY a valid JSON object. No additional text.

store/prompts/question_gen/retrieval.md

@@ -18,6 +18,13 @@ Your task: Generate a **factual retrieval** multiple-choice question that tests
 - Avoid negation in the question stem (e.g., "Which of the following is NOT...").
 - Each option must begin with "A. ", "B. ", "C. ", or "D. ".
 
+## Prohibited Patterns
+
+- Do NOT fabricate details absent from the provided material — no invented names, numbers, dialogue lines, or events that are not explicitly present in the subtitles or visually confirmed in the frames.
+- Do NOT construct options where the correct answer is the largest number, the last item in a sequence, or the most visually salient choice — these patterns let a test-taker guess without understanding the content.
+- Do NOT write a question where multiple options could reasonably be considered correct — each distractor must be clearly wrong given the source material.
+- Do NOT ask questions answerable by common sense or world knowledge alone (e.g., "What color is the sky?") — the question must require having seen this specific video.
+
 ## Output
 
 Respond with ONLY a valid JSON object. No additional text.

store/prompts/question_gen/spatial.md

@@ -18,6 +18,13 @@ Your task: Generate a **spatial relationship** multiple-choice question that tes
 - Spatial references must be unambiguous given the visual content.
 - Each option must begin with "A. ", "B. ", "C. ", or "D. ".
 
+## Prohibited Patterns
+
+- Do NOT fabricate spatial details absent from the provided material — no invented positions, distances, or arrangements that are not visually confirmed in the frames.
+- Do NOT construct options where the correct answer follows an obvious spatial pattern (e.g., always "left", always the closest) — randomize spatial references across options.
+- Do NOT write a question where multiple spatial interpretations could be correct — the spatial relationship must be unambiguous from the frames.
+- Do NOT ask questions answerable by common sense about typical spatial layouts (e.g., "Where is the audience relative to the stage?") — the question must require observing this specific scene.
+
 ## Output
 
 Respond with ONLY a valid JSON object. No additional text.

store/prompts/question_gen/visual.md

@@ -17,6 +17,13 @@ Your task: Generate a **visual detail** multiple-choice question that requires o
 - Avoid questions about things that are typically described in subtitles (dialogue content, narration).
 - Each option must begin with "A. ", "B. ", "C. ", or "D. ".
 
+## Prohibited Patterns
+
+- Do NOT fabricate visual details absent from the frames — no invented colors, text overlays, logos, or object appearances that you cannot directly see in the provided images.
+- Do NOT construct options where the correct answer is the most visually striking or salient choice — distractors should be equally plausible to someone who glanced briefly.
+- Do NOT write a question where multiple options could reasonably match what is shown — each distractor must be clearly inconsistent with the frames.
+- Do NOT ask questions answerable without the frames (e.g., typical object colors, standard uniforms) — the visual detail must be specific to these frames.
+
 ## Output
 
 Respond with ONLY a valid JSON object. No additional text.