Skip to content

Learning Graph Quality Metrics Report

Overview

  • Total Concepts: 240
  • Foundational Concepts (no prerequisites, other concepts depend on them): 7
  • Terminal Nodes (nothing depends on them, but have prerequisites): 45
  • Orphaned Nodes (completely disconnected, no edges): 0
  • Concepts with Dependencies: 233
  • Average Dependencies per Concept: 2.24

Graph Structure Validation

  • Valid DAG Structure: ✅ Yes
  • Self-Dependencies: None detected ✅
  • Cycles Detected: 0

Foundational Concepts

These concepts have no prerequisites:

  • 1: Python编程基础
  • 2: 计算机网络基础
  • 3: Web浏览器基础
  • 4: HTML文档结构基础
  • 5: 数据结构与集合基础
  • 6: 文件系统与IO基础
  • 7: 数据合规与伦理意识

Dependency Chain Analysis

  • Maximum Dependency Chain Length: 22

Longest Learning Path:

  1. 计算机网络基础 (ID: 2)
  2. 万维网与超文本传输 (ID: 8)
  3. 网络爬虫定义与核心价值 (ID: 9)
  4. 网络爬虫标准工作流 (ID: 14)
  5. 结构化与非结构化网页数据特征 (ID: 65)
  6. HTML5语义化标签与列表表格 (ID: 66)
  7. DOM文档对象模型树形拓扑 (ID: 67)
  8. DOM节点父子兄弟层级关系 (ID: 68)
  9. BeautifulSoup4库与解析器选型 (ID: 74)
  10. BS4节点导航与find_all检索 (ID: 75)
  11. BS4中select方法与CSS组合选择 (ID: 77)
  12. DOM节点文本剥离与属性提取 (ID: 78)
  13. 原始网页脏数据与ETL清洗流水线 (ID: 171)
  14. AI与大模型训练数据生命周期全貌 (ID: 211)
  15. LLM预训练语料Corpus质量标准 (ID: 212)
  16. 网页正文抽取Readability与Trafilatura (ID: 213)
  17. HTML转Markdown结构化保留代码表格 (ID: 215)
  18. 基于LLM与Function-Calling零样本解析 (ID: 218)
  19. LLM自动生成选择器与自愈修复爬虫 (ID: 220)
  20. 页面结构漂移检测与自动化健康巡检 (ID: 235)
  21. 数据集质量评估报告与信噪比审计 (ID: 236)
  22. 综合实训:垂直领域大模型RAG数据工程 (ID: 240)

Terminal Nodes Analysis

Terminal nodes are concepts that nothing else depends on but have prerequisites. They represent natural endpoints of learning paths — culminating or specialized concepts.

  • Total Terminal Nodes: 45 (18.8% of all concepts)
  • Healthy Range: 5-40% of total concepts

Concepts at the end of learning paths:

  • 10: 通用搜索引擎爬虫
  • 13: 深层网页与暗网数据概念
  • 17: 网页抓取深度优先策略
  • 19: Sitemap网站地图解析
  • 35: Accept与内容协商机制
  • 39: Token与JWT身份认证机制
  • 53: Multipart多部分文件上传请求
  • 57: 请求重定向跟随与禁止allow_redirects
  • 59: SSL证书校验与警告屏蔽verify
  • 64: cURL命令转Python爬虫代码技巧
  • 81: XPath轴定位与逻辑运算符
  • 86: XML文档与RSS订阅源解析
  • 95: JSONPath与JMESPath深层数据抽取
  • 96: JSONP跨域回调原理与字符串剥离
  • 103: API自定义请求头X-Requested-With分析
  • 104: CORS跨域资源共享与Options预检请求
  • 105: GraphQL查询语言与单端点接口采集
  • 107: SSE服务端推送事件流数据采集
  • 121: 页面滚动触底与无限懒加载触发
  • 122: Iframe内嵌框架定位与上下文切换

...and 25 more

Orphaned Nodes Analysis

Orphaned nodes are completely disconnected concepts with no inbound AND no outbound edges. These indicate a quality problem — every concept should connect to the graph.

  • Total Orphaned Nodes: 0

✅ No orphaned nodes detected. All concepts are connected to the graph.

Connected Components

  • Number of Connected Components: 1

✅ All concepts are connected in a single graph.

Indegree Analysis

Top 10 concepts that are prerequisites for the most other concepts:

Rank Concept ID Concept Label Indegree
1 1 Python编程基础 14
2 26 HTTP请求与响应模型 10
3 31 HTTP请求头Headers结构 10
4 131 网站反爬虫防御纵深体系概览 10
5 5 数据结构与集合基础 9
6 67 DOM文档对象模型树形拓扑 8
7 3 Web浏览器基础 6
8 6 文件系统与IO基础 6
9 47 构造GET请求与Params查询参数 6
10 50 定制请求头Headers伪装浏览器 6

Outdegree Distribution

Dependencies Number of Concepts
0 7
1 31
2 120
3 77
4 4
5 1

Recommendations

  • ✅ Terminal node percentage (18.8%): Within healthy range (5-40%)
  • ✅ DAG structure verified: Graph supports valid learning progressions
  • ℹ️ Long dependency chains (22): Ensure students can follow extended learning paths

Report generated by learning-graph-reports/analyze_graph.py