Learning Graph Quality Metrics Report¶
Overview¶
- Total Concepts: 240
- Foundational Concepts (no prerequisites, other concepts depend on them): 7
- Terminal Nodes (nothing depends on them, but have prerequisites): 45
- Orphaned Nodes (completely disconnected, no edges): 0
- Concepts with Dependencies: 233
- Average Dependencies per Concept: 2.24
Graph Structure Validation¶
- Valid DAG Structure: ✅ Yes
- Self-Dependencies: None detected ✅
- Cycles Detected: 0
Foundational Concepts¶
These concepts have no prerequisites:
- 1: Python编程基础
- 2: 计算机网络基础
- 3: Web浏览器基础
- 4: HTML文档结构基础
- 5: 数据结构与集合基础
- 6: 文件系统与IO基础
- 7: 数据合规与伦理意识
Dependency Chain Analysis¶
- Maximum Dependency Chain Length: 22
Longest Learning Path:¶
- 计算机网络基础 (ID: 2)
- 万维网与超文本传输 (ID: 8)
- 网络爬虫定义与核心价值 (ID: 9)
- 网络爬虫标准工作流 (ID: 14)
- 结构化与非结构化网页数据特征 (ID: 65)
- HTML5语义化标签与列表表格 (ID: 66)
- DOM文档对象模型树形拓扑 (ID: 67)
- DOM节点父子兄弟层级关系 (ID: 68)
- BeautifulSoup4库与解析器选型 (ID: 74)
- BS4节点导航与find_all检索 (ID: 75)
- BS4中select方法与CSS组合选择 (ID: 77)
- DOM节点文本剥离与属性提取 (ID: 78)
- 原始网页脏数据与ETL清洗流水线 (ID: 171)
- AI与大模型训练数据生命周期全貌 (ID: 211)
- LLM预训练语料Corpus质量标准 (ID: 212)
- 网页正文抽取Readability与Trafilatura (ID: 213)
- HTML转Markdown结构化保留代码表格 (ID: 215)
- 基于LLM与Function-Calling零样本解析 (ID: 218)
- LLM自动生成选择器与自愈修复爬虫 (ID: 220)
- 页面结构漂移检测与自动化健康巡检 (ID: 235)
- 数据集质量评估报告与信噪比审计 (ID: 236)
- 综合实训:垂直领域大模型RAG数据工程 (ID: 240)
Terminal Nodes Analysis¶
Terminal nodes are concepts that nothing else depends on but have prerequisites. They represent natural endpoints of learning paths — culminating or specialized concepts.
- Total Terminal Nodes: 45 (18.8% of all concepts)
- Healthy Range: 5-40% of total concepts
Concepts at the end of learning paths:
- 10: 通用搜索引擎爬虫
- 13: 深层网页与暗网数据概念
- 17: 网页抓取深度优先策略
- 19: Sitemap网站地图解析
- 35: Accept与内容协商机制
- 39: Token与JWT身份认证机制
- 53: Multipart多部分文件上传请求
- 57: 请求重定向跟随与禁止allow_redirects
- 59: SSL证书校验与警告屏蔽verify
- 64: cURL命令转Python爬虫代码技巧
- 81: XPath轴定位与逻辑运算符
- 86: XML文档与RSS订阅源解析
- 95: JSONPath与JMESPath深层数据抽取
- 96: JSONP跨域回调原理与字符串剥离
- 103: API自定义请求头X-Requested-With分析
- 104: CORS跨域资源共享与Options预检请求
- 105: GraphQL查询语言与单端点接口采集
- 107: SSE服务端推送事件流数据采集
- 121: 页面滚动触底与无限懒加载触发
- 122: Iframe内嵌框架定位与上下文切换
...and 25 more
Orphaned Nodes Analysis¶
Orphaned nodes are completely disconnected concepts with no inbound AND no outbound edges. These indicate a quality problem — every concept should connect to the graph.
- Total Orphaned Nodes: 0
✅ No orphaned nodes detected. All concepts are connected to the graph.
Connected Components¶
- Number of Connected Components: 1
✅ All concepts are connected in a single graph.
Indegree Analysis¶
Top 10 concepts that are prerequisites for the most other concepts:
| Rank | Concept ID | Concept Label | Indegree |
|---|---|---|---|
| 1 | 1 | Python编程基础 | 14 |
| 2 | 26 | HTTP请求与响应模型 | 10 |
| 3 | 31 | HTTP请求头Headers结构 | 10 |
| 4 | 131 | 网站反爬虫防御纵深体系概览 | 10 |
| 5 | 5 | 数据结构与集合基础 | 9 |
| 6 | 67 | DOM文档对象模型树形拓扑 | 8 |
| 7 | 3 | Web浏览器基础 | 6 |
| 8 | 6 | 文件系统与IO基础 | 6 |
| 9 | 47 | 构造GET请求与Params查询参数 | 6 |
| 10 | 50 | 定制请求头Headers伪装浏览器 | 6 |
Outdegree Distribution¶
| Dependencies | Number of Concepts |
|---|---|
| 0 | 7 |
| 1 | 31 |
| 2 | 120 |
| 3 | 77 |
| 4 | 4 |
| 5 | 1 |
Recommendations¶
- ✅ Terminal node percentage (18.8%): Within healthy range (5-40%)
- ✅ DAG structure verified: Graph supports valid learning progressions
- ℹ️ Long dependency chains (22): Ensure students can follow extended learning paths
Report generated by learning-graph-reports/analyze_graph.py