iomgaa
043d4aa46f
9 tasks: type extension → postprocess → families → sampler_v2 → generator_v2 → gates → run_store → pipeline_v2 → CLI integration. Includes structured-logging schemas/metrics and Codex review revisions.
34 lines
759 B
Markdown
34 lines
759 B
Markdown
---
|
|
type: metric
|
|
node_id: metric:qgen-regen-convergence
|
|
title: 重出收敛率（3轮内过门）
|
|
date: 2026-07-12
|
|
---
|
|
|
|
# 重出收敛率（3轮内过门）
|
|
|
|
## 定义
|
|
|
|
所有 slot 中，在 ≤3 次尝试内最终被接受的 slot 占总 slot 的比例。
|
|
|
|
## 判定方式
|
|
|
|
- **类型**: 硬性（下限约束）
|
|
- **阈值**: ≥ 80%（低于说明 prompt 模板或拒因反馈机制需迭代）
|
|
- **计算**: `COUNT(DISTINCT slot_id WHERE accepted) / COUNT(DISTINCT slot_id)`
|
|
- **数据源**: `question_gen_items`
|
|
|
|
## 基线
|
|
|
|
待首次运行后建立。
|
|
|
|
## SQL
|
|
|
|
```sql
|
|
SELECT
|
|
CAST(COUNT(DISTINCT CASE WHEN final_status='accepted' THEN slot_id END) AS REAL) /
|
|
COUNT(DISTINCT slot_id) AS convergence_rate
|
|
FROM question_gen_items
|
|
WHERE run_id=?;
|
|
```
|