 iomgaa
|
7ef9b99217
|
feat: add QuestionUnit entity and GeneratedQuestion pair fields
新增 QuestionUnit 契约实体（kind/unit_id/task_type/questions/unit_hash + size/from_single/from_pair），
作为 AR pair 孪生对贯穿评测/训练 harness 的最小调度单元。
GeneratedQuestion 追加 unit_id/pair_id/question_role/flip_axis 四字段，
__post_init__ 回填 unit_id，默认值保证现有非 AR single 题构造点行为不变。
|
2026-07-15 05:45:34 -04:00 |
|
|
iomgaa
|
0fe1c96393
|
docs: add question-gen v3 construction-paradigm design and phase1 plan
Complete v3 planning: construction-first paradigm (frame-perception grounded fact extraction + 4-family independent judges + 6-layer verification + QuestionUnit contract), adversarial audit, paradigm-shift finding, real-data spike validation, logging schema, and phase1 contract implementation plan.
|
2026-07-15 05:41:10 -04:00 |
|
|
iomgaa
|
d9f7dee2df
|
docs: revise question-gen v2 design per Codex review (pair-unit contract, AR-only gate, phasing)
|
2026-07-15 01:21:28 -04:00 |
|
|
iomgaa
|
7949f16906
|
docs: add question-gen v2 grounded-contrastive design
|
2026-07-15 01:10:00 -04:00 |
|
|
iomgaa
|
fd96f906c2
|
docs: add question-gen v2 diagnosis and locked redesign direction
|
2026-07-15 00:50:29 -04:00 |
|
|
iomgaa
|
49b7be78ae
|
fix: derive OUTPUT from config output_dir so CONFIG override counts correctly
|
2026-07-14 21:12:48 -04:00 |
|
|
iomgaa
|
d84f9bf777
|
chore: harden generate_ar30.sh (drop no-op mock, add zero-gain early stop)
|
2026-07-14 21:08:00 -04:00 |
|
|
iomgaa
|
b1c1bf7aac
|
fix: isolate selector VLM exceptions at slot level (no batch crash)
|
2026-07-14 21:08:00 -04:00 |
|
|
iomgaa
|
441a0aa6c3
|
chore: format Phase B modules and register Phase B plan in wiki
|
2026-07-14 17:11:04 -04:00 |
|
|
iomgaa
|
f36eb66c18
|
fix: tolerate backfill under-delivery, fix predict None-fill, drop dead session_id
|
2026-07-14 17:07:55 -04:00 |
|
|
iomgaa
|
1d222d9f18
|
feat: wire real agent runner, backfill assembly and adversarial-filter CLI
|
2026-07-14 16:58:32 -04:00 |
|
|
iomgaa
|
73d0bb9190
|
feat: add adversarial round loop with backfill iteration and difficulty report
|
2026-07-14 16:40:05 -04:00 |
|
|
iomgaa
|
c1565a01c2
|
test: assert stage/verdict/pair_id and Q-refusal flip_skipped path
|
2026-07-14 16:33:09 -04:00 |
|
|
iomgaa
|
15aee0cfc1
|
feat: add flip gate reusing P prediction and mirror-Q agent run
|
2026-07-14 16:26:51 -04:00 |
|
|
iomgaa
|
8731e448fe
|
fix: harden mirror material rebuild (empty/invalid frames, dedup, observability)
|
2026-07-14 16:16:38 -04:00 |
|
|
iomgaa
|
4af99b700b
|
feat: add mirror question generation with canonical distinctness check
|
2026-07-14 16:08:13 -04:00 |
|
|
iomgaa
|
d4e9852864
|
feat: add cheater gate with resume-safe survivor recovery
|
2026-07-14 16:00:14 -04:00 |
|
|
iomgaa
|
24ed7ca322
|
fix: harden canonical_answer_text and align decision-core signatures to spec
|
2026-07-14 15:55:36 -04:00 |
|
|
iomgaa
|
c109f2257a
|
feat: add pure decision core for adversarial filter (hash/fingerprint/canonical/flip)
|
2026-07-14 15:51:28 -04:00 |
|
|
iomgaa
|
334fbbc94d
|
feat: add AdversarialFilterConfig for Phase B post-hoc filter layer
|
2026-07-14 15:47:21 -04:00 |
|
|
iomgaa
|
ac115d96fb
|
test: cover backfill params end-to-end (mutation isolation + seq_offset)
|
2026-07-14 15:44:43 -04:00 |
|
|
iomgaa
|
8b9e8aa19f
|
feat: add optional backfill params to run_pipeline_v2
|
2026-07-14 15:39:57 -04:00 |
|
|
iomgaa
|
d77cbc95eb
|
feat: add adversarial_verdicts table with resume and terminal-verdict query
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-14 15:35:11 -04:00 |
|
|
iomgaa
|
e41a2b0d08
|
test: guard non-AR flip isolation and AR flip-capable set
|
2026-07-14 15:30:18 -04:00 |
|
|
iomgaa
|
f12dd7e559
|
feat: add supports_flip/flip_axis to SubPattern for Phase B flip gate
|
2026-07-14 15:27:21 -04:00 |
|
|
iomgaa
|
841112c6af
|
docs: revise Phase B plan per Codex review (C1-C3,I1-I6,M1-M3)
|
2026-07-14 15:24:44 -04:00 |
|
|
iomgaa
|
abc9c097d2
|
docs: add Phase B adversarial question-gen implementation plan
|
2026-07-14 15:05:36 -04:00 |
|
|
iomgaa
|
96e314c3a0
|
fix: mark item rejected on selector_error for consistent bookkeeping
selector_error 分支（捕获 ValueError/FileNotFoundError）此前只返回 reason，
未 mark_item_rejected，导致 Phase 3 已 record 的 pending attempt 行永远停在
pending；而 hard-fail 分支会标记 rejected。两条失败路径落库风格现统一为
mark_item_rejected（异常路径无 outcome/observation，故不写 selector_scores）。
补单测 test_apply_grounded_selector_marks_rejected_on_error 守卫该路径。
|
2026-07-14 14:49:41 -04:00 |
|
|
iomgaa
|
46ac848176
|
fix: converge non-numeric selector scores to ValueError
|
2026-07-14 14:47:21 -04:00 |
|
|
iomgaa
|
eaab865d84
|
docs: register Phase A plan in research wiki
|
2026-07-14 14:41:53 -04:00 |
|
|
iomgaa
|
e64c26e578
|
style: format distractor_selector
|
2026-07-14 14:41:21 -04:00 |
|
|
iomgaa
|
76f719018c
|
feat: loosen multi_true gate to qualifier-scoped correctness
|
2026-07-14 14:33:22 -04:00 |
|
|
iomgaa
|
b1f15ddb3a
|
fix: keep cross_segment rule single-dimension, guard no-absent-events
|
2026-07-14 14:31:30 -04:00 |
|
|
iomgaa
|
58278c6de4
|
feat: enforce single-dimension counterfactual in AR distractor rules
|
2026-07-14 14:28:32 -04:00 |
|
|
iomgaa
|
ea38e4717b
|
refactor: extract grounded selector application into helper
将 Phase 3.5 的 grounded selector 逻辑抽成模块级 _apply_grounded_selector，
内部完成策略门控 / 异常捕获 / observation 落库 / hard-fail 拒绝，调用点仅剩
单一失败分支（selector_reason → 重出）。行为不变，测试全绿。
顺带移除 resample_video_interval 死子表达式（硬编码 1，(attempt-1)%1==0 恒真），
使 _process_one_slot 圈复杂度回落至 Task 6 前的 D(25)。_apply_grounded_selector
自身为 A(4)，均满足质量门。
|
2026-07-14 14:22:30 -04:00 |
|
|
iomgaa
|
b13eab0659
|
feat: wire grounded selector into AR slot processing
将 Task 5 的 grounded selector 织入 AR 出题路径（Phase 3.5，位于
record_item 与 postprocess 之间），仅在 strategy.uses_grounded_selector
为真时进入。observation 始终落库（含 hard-fail），硬失败走重出。
PipelineConfig 新增 candidate_pool_size/selector_delta_low/
selector_delta_high 三参，YAML 与 CLI seed override 同步。
|
2026-07-14 14:15:50 -04:00 |
|
|
iomgaa
|
d0194f5840
|
fix: degrade distractor pool gracefully on malformed VLM response
|
2026-07-14 14:11:13 -04:00 |
|
|
iomgaa
|
8a54055d02
|
feat: add grounded distractor selector with visual scoring
|
2026-07-14 14:06:07 -04:00 |
|
|
iomgaa
|
207e834f30
|
feat: add selector_scores observation column to question_gen_items
|
2026-07-14 13:59:29 -04:00 |
|
|
iomgaa
|
3f984acc18
|
feat: add uses_grounded_selector strategy switch (AR only)
|
2026-07-14 13:53:17 -04:00 |
|
|
iomgaa
|
2608a3841f
|
style: reformat sub_pattern round-trip tests
|
2026-07-14 13:51:51 -04:00 |
|
|
iomgaa
|
e68e4b7d57
|
fix: restore sub_pattern when loading benchmark JSON
|
2026-07-14 13:51:05 -04:00 |
|
|
iomgaa
|
111c88488f
|
style: format sub_pattern test file
|
2026-07-14 13:46:25 -04:00 |
|
|
iomgaa
|
ae0a718f67
|
feat: thread and persist sub_pattern into accepted questions
|
2026-07-14 13:45:31 -04:00 |
|
|
iomgaa
|
25f2a845ff
|
fix: run_gates must use current_tree after video resample
|
2026-07-14 13:40:46 -04:00 |
|
|
iomgaa
|
92714db370
|
docs: revise Phase A plan per Codex review (C1-C2,I1-I5,M1)
|
2026-07-14 13:38:35 -04:00 |
|
|
iomgaa
|
645585e784
|
docs: add Phase A grounded question-gen implementation plan
|
2026-07-14 13:28:43 -04:00 |
|
|
iomgaa
|
ad0bfe3a51
|
docs: add grounded + adversarial question-gen design (Phase A/B)
|
2026-07-14 13:21:06 -04:00 |
|
|
iomgaa
|
84b52a0311
|
feat(pools): auto-supplement maintenance correct questions in PerCategoryPoolStrategy
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-07-14 10:41:46 -04:00 |
|
|
iomgaa
|
72befa2bd4
|
feat(pools): add batch_correct_ratio field to PoolConfig
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-07-14 10:34:28 -04:00 |
|