docs: register llm_calls telemetry schema in wiki
This commit is contained in:
@@ -5,6 +5,16 @@
|
||||
"id": "plan:m1-core-plan",
|
||||
"label": "M1 核心里程碑实现计划",
|
||||
"type": "plan"
|
||||
},
|
||||
{
|
||||
"id": "schema:llm-calls",
|
||||
"label": "表结构: llm_calls(遥测 18 字段)",
|
||||
"type": "schema"
|
||||
},
|
||||
{
|
||||
"id": "metric:call-telemetry-coverage",
|
||||
"label": "每次调用必录覆盖率(含缓存命中/失败/取消)",
|
||||
"type": "metric"
|
||||
}
|
||||
],
|
||||
"links": [
|
||||
@@ -14,6 +24,20 @@
|
||||
"relation": "implements",
|
||||
"evidence": "plans/2026-07-20-m1-core-plan.md 实现 designs/2026-07-20-m1-core-design.md 冻结的全部签名",
|
||||
"added": "2026-07-20T10:18:41.339537+00:00"
|
||||
},
|
||||
{
|
||||
"source": "metric:call-telemetry-coverage",
|
||||
"target": "schema:llm-calls",
|
||||
"relation": "measures",
|
||||
"evidence": "遥测必录铁律: 一切调用路径落 llm_calls",
|
||||
"added": "2026-07-20T11:11:46.302045+00:00"
|
||||
},
|
||||
{
|
||||
"source": "schema:llm-calls",
|
||||
"target": "design:m1-core-design",
|
||||
"relation": "implements",
|
||||
"evidence": "M1 设计 §4.4 冻结 18 字段",
|
||||
"added": "2026-07-20T11:11:47.240466+00:00"
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -1,6 +1,6 @@
|
||||
# Research Wiki 索引
|
||||
|
||||
> 自动生成,更新时间:2026-07-20 10:18 UTC
|
||||
> 自动生成,更新时间:2026-07-20 11:11 UTC
|
||||
|
||||
## design (2)
|
||||
- [2026-07-20-m1-core-design](designs/2026-07-20-m1-core-design.md) `design:2026-07-20-m1-core-design`
|
||||
@@ -9,3 +9,9 @@
|
||||
## plan (2)
|
||||
- [2026-07-20-m1-core-plan](plans/2026-07-20-m1-core-plan.md) `plan:2026-07-20-m1-core-plan`
|
||||
- [M1 核心里程碑实现计划](plans/m1-core-plan.md) `plan:m1-core-plan`
|
||||
|
||||
## schema (1)
|
||||
- [表结构: llm_calls(遥测 18 字段)](schemas/llm-calls.md) `schema:llm-calls`
|
||||
|
||||
## metric (1)
|
||||
- [每次调用必录覆盖率(含缓存命中/失败/取消)](metrics/call-telemetry-coverage.md) `metric:call-telemetry-coverage`
|
||||
|
||||
@@ -5,3 +5,8 @@
|
||||
- [2026-07-20 10:18 UTC] 新增 plan: M1 核心里程碑实现计划 (plan:m1-core-plan)
|
||||
- [2026-07-20 10:18 UTC] 新增边: plan:m1-core-plan --implements--> design:m1-core-design
|
||||
- [2026-07-20 10:18 UTC] 重建索引: 4 篇页面
|
||||
- [2026-07-20 11:11 UTC] 新增 schema: 表结构: llm_calls(遥测 18 字段) (schema:llm-calls)
|
||||
- [2026-07-20 11:11 UTC] 新增 metric: 每次调用必录覆盖率(含缓存命中/失败/取消) (metric:call-telemetry-coverage)
|
||||
- [2026-07-20 11:11 UTC] 新增边: metric:call-telemetry-coverage --measures--> schema:llm-calls
|
||||
- [2026-07-20 11:11 UTC] 新增边: schema:llm-calls --implements--> design:m1-core-design
|
||||
- [2026-07-20 11:11 UTC] 重建索引: 6 篇页面
|
||||
|
||||
@@ -0,0 +1,9 @@
|
||||
---
|
||||
type: metric
|
||||
node_id: metric:call-telemetry-coverage
|
||||
title: 每次调用必录覆盖率(含缓存命中/失败/取消)
|
||||
date: 2026-07-20
|
||||
---
|
||||
|
||||
# 每次调用必录覆盖率(含缓存命中/失败/取消)
|
||||
|
||||
@@ -0,0 +1,36 @@
|
||||
---
|
||||
type: schema
|
||||
node_id: schema:llm-calls
|
||||
title: "表结构: llm_calls(遥测 18 字段)"
|
||||
date: 2026-07-20
|
||||
---
|
||||
|
||||
# 表结构: llm_calls(遥测 18 字段)
|
||||
|
||||
|
||||
## 列定义(冻结,M1 设计 §4.4 / ARCH §7.8)
|
||||
|
||||
| 列 | 类型 | 说明 |
|
||||
|---|---|---|
|
||||
| call_id | TEXT PRIMARY KEY | 每次尝试独立 UUID;INSERT OR IGNORE 幂等 |
|
||||
| parent_call_id / session_id | TEXT | 调用链路(agent step → LLM call) |
|
||||
| model / provider / source_name | TEXT NOT NULL | 溯源;model 由旧 Protocol 的 model_name 更名(VT 迁移 §8) |
|
||||
| messages / response / thinking | TEXT NOT NULL | messages 落库前多模态 part 摘要(与缓存 key 共用 digest_messages) |
|
||||
| prompt_tokens / completion_tokens | INTEGER NOT NULL | usage 帧;缺失按 est 兜底 |
|
||||
| usage_source | TEXT NOT NULL | measured / estimated |
|
||||
| latency_ms | INTEGER NOT NULL | 尝试耗时;缓存命中 0 |
|
||||
| ttft_ms / max_inter_token_ms | REAL | 流式活性测量 |
|
||||
| cache_hit | INTEGER NOT NULL DEFAULT 0 | 命中标记 |
|
||||
| error | TEXT | 异常信息;取消记 "cancelled" |
|
||||
| cost | REAL | M1 恒 NULL,M2 pricing 换算 |
|
||||
| created_at | TEXT NOT NULL DEFAULT (datetime('now')) | 落库时刻 |
|
||||
|
||||
## 埋点位置(单一 helper 铁律)
|
||||
|
||||
- `middleware/telemetry.py::TelemetryEmitter` 是全库**唯一** `record_llm_call` 调用点;
|
||||
- `TelemetryMW`(最外层)记缓存命中与最终失败;`RetryMW._emit` 经同一 Emitter 逐次记尝试;
|
||||
- 写失败降级 warning 不冒泡;取消路径 finally 尽力记录。
|
||||
|
||||
## 评估基线
|
||||
|
||||
首版无历史基线,标"待首次运行后建立";验收断言: 单测覆盖成功/失败/缓存命中/取消四路径各产生恰一行;并发 50 协程写全落库。
|
||||
Reference in New Issue
Block a user