govdoc-md-cleaner v0.1.0: 政务文档 Markdown 清洗工具(规则引擎 + CLI + 测试)

- 8 条 YAML 声明规则:页码/页眉页脚/目录点线/图片/HTML表格/散落标签/行尾空白/空行
- 防误伤设计:protect 正则 + 内容形态豁免 + OCR burst 检测
- md-clean single/batch CLI,JSON 清洗报告
- 18 个单元测试

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
2026-08-20 17:04:10 +08:00
commit c19e9fcebf
10 changed files with 814 additions and 0 deletions
+11
View File
@@ -0,0 +1,11 @@
"""govdoc-md-cleaner: 政务文档 Markdown 清洗工具包。
针对 PDF→Markdown 转换产物(MinerU / OCR 管线输出)的常见脏数据,
提供基于 YAML 规则的、可复现、可审计的清洗能力。
"""
from cleaner.cleaner import MarkdownCleaner, CleanResult, load_rules
from cleaner.cli import main
__version__ = "0.1.0"
__all__ = ["MarkdownCleaner", "CleanResult", "load_rules", "main"]