iomgaa
afa77173e3
refactor(question_gen): adapt generator/gates/store signatures for strategy
...
- generator_v2: _load_prompt_template takes template_name str instead of
QuestionFamilySpec; _build_v2_prompt takes prompt_template + strategy_name
+ sub_pattern_instruction; generate_one_v2 takes discrete params
(prompt_template, strategy_name, skill_target, sub_pattern_instruction)
- gates: _gate_leak_test and run_gates take leak_probe_template str
instead of QuestionFamilySpec
- run_store: add sub_pattern column to DDL + idempotent migration;
record_item accepts optional sub_pattern param
- Remove QuestionFamilySpec imports from generator_v2 and gates modules
- Update test call sites accordingly
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-07-14 05:50:47 -04:00
iomgaa
271d1682c9
feat(question_gen): add lightweight 4-gate quality check
...
Implement 4 concurrent LLM-based quality gates for generated questions:
- key_verify: validates answer evidence in source material
- blind_answer: rejects questions answerable without video context
- multi_true: detects ambiguous multi-correct options
- leak_test: per-family shortcut detection (5 probe templates)
Includes run_gates orchestrator with verbatim_ratio short-circuit,
JSON response parsing with fallback, and 9 unit tests (all passing).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-07-11 23:30:13 -04:00