docs(plans): add Spec-3 question-gen-v2 implementation plan
9 tasks: type extension → postprocess → families → sampler_v2 → generator_v2 → gates → run_store → pipeline_v2 → CLI integration. Includes structured-logging schemas/metrics and Codex review revisions.
This commit is contained in:
@@ -0,0 +1,33 @@
|
||||
---
|
||||
type: metric
|
||||
node_id: metric:qgen-regen-convergence
|
||||
title: 重出收敛率(3轮内过门)
|
||||
date: 2026-07-12
|
||||
---
|
||||
|
||||
# 重出收敛率(3轮内过门)
|
||||
|
||||
## 定义
|
||||
|
||||
所有 slot 中,在 ≤3 次尝试内最终被接受的 slot 占总 slot 的比例。
|
||||
|
||||
## 判定方式
|
||||
|
||||
- **类型**: 硬性(下限约束)
|
||||
- **阈值**: ≥ 80%(低于说明 prompt 模板或拒因反馈机制需迭代)
|
||||
- **计算**: `COUNT(DISTINCT slot_id WHERE accepted) / COUNT(DISTINCT slot_id)`
|
||||
- **数据源**: `question_gen_items`
|
||||
|
||||
## 基线
|
||||
|
||||
待首次运行后建立。
|
||||
|
||||
## SQL
|
||||
|
||||
```sql
|
||||
SELECT
|
||||
CAST(COUNT(DISTINCT CASE WHEN final_status='accepted' THEN slot_id END) AS REAL) /
|
||||
COUNT(DISTINCT slot_id) AS convergence_rate
|
||||
FROM question_gen_items
|
||||
WHERE run_id=?;
|
||||
```
|
||||
Reference in New Issue
Block a user