chore: snapshot in-progress question-gen work before preflight fixes

This commit is contained in:
2026-07-16 04:12:21 -04:00
parent 11a5545f57
commit a4c429b247
39 changed files with 738 additions and 283 deletions
@@ -4,9 +4,11 @@ You are a quality-control judge for video understanding questions.
## Task
Given the source material from a video and a multiple-choice question with its designated correct answer, determine whether the correct answer is **supported by evidence** in the source material.
Given the source material (text descriptions AND video frames) from a video and a multiple-choice question with its designated correct answer, determine whether the correct answer is **supported by evidence** in the source material.
## Source Material
**IMPORTANT:** You can see both the text descriptions AND the actual video frames. The correct answer may be visually evident in the frames even if not explicitly mentioned in the text descriptions. Use BOTH modalities for your judgment.
## Source Material (Text)
{source_text}
@@ -24,9 +26,10 @@ Given the source material from a video and a multiple-choice question with its d
## Instructions
1. Read the source material carefully.
2. Determine if the designated correct answer can be derived or inferred from the source material.
3. If evidence supports the answer, verdict is "pass". If not, verdict is "fail".
1. Examine the video frames carefully for visual evidence.
2. Read the text descriptions for contextual evidence.
3. If evidence from EITHER the frames OR the text supports the answer, verdict is "pass".
4. Only verdict "fail" if NEITHER the frames NOR the text provide any support for the answer.
## Response Format (strict JSON)