检索说明
- 查询:GraphRAG evidence retrieval
- 年份过滤:2025-
- 单查询上限:20
- 发现日期:2026-11-12
Semantic Scholar 候选元数据
- 作者:M. B. Sesen, J. A. Yeung, E. Asgari
- 年份:2026
- Venue:BMJ digital health & AI
- DOI:10.1136/bmjdh-2026-000041
- arXiv:未返回
- S2 citationCount(当前快照):0
- 来源线索:https://doi.org/10.1136/bmjdh-2026-000041
摘要(未核验)
Abstract Objective Chronic kidney disease (CKD) is a progressive condition requiring evidence-based management, but adherence to complex guidelines remains challenging. Large Language Models (LLMs) could support clinical decision-making, yet their unreliability limits direct use. This study aimed to evaluate whether Retrieval-Augmented Generation (RAG), particularly a knowledge graph-enhanced pipeline (GraphRAG), improves guideline-based clinical decision support (CDS) in CKD management. Methods and analysis We compared three approaches: a baseline LLM (GPT-4o), a vector-indexed RAG pipeline and a GraphRAG pipeline. Each model answered nine clinically relevant questions for a synthetic cohort of 70 CKD patients. Outputs were assessed for clinical correctness, patient specificity and clarity using both clinician-led evaluations and an LLM-as-Judge framework. Results RAG achieved higher clinician-rated correctness than the baseline LLM (76.6% vs 70.8%), with GraphRAG showing a similar improvement (75.6%). GraphRAG produced the most patient-specific responses but was associated with substantially longer outputs and reduced clarity. Response length was strongly correlated with both specificity and clarity, indicating that this trade-off is largely length-driven. Agreement between clinician and LLM-based evaluation varied by task type (Cohen’s kappa 0.13–0.97), with lower agreement for open-ended tasks. All retrieval-based methods were constrained by the scope of the indexed guideline. Conclusions RAG and GraphRAG provide a scalable, auditable foundation for guideline-aligned CDS in CKD. RAG showed higher clinician-rated correctness, while GraphRAG improved patient specificity without a corresponding gain in correctness. Trade-offs between specificity and clarity were largely driven by response length. Effective deployment will require robust content management, calibrated evaluation frameworks and integration within clinical governance structures.
转为正式文献前的核验清单
- [ ] 从论文、出版社、会议、ACL Anthology、OpenReview 或 arXiv 页面核对标题、作者、年份和版本。
- [ ] 核对 DOI、venue、正式链接和是否存在撤稿/版本变化。
- [ ] 阅读正文后补充方法、证据边界、结果和与现有研究的关系。
Semantic Scholar 记录用于发现候选,不是正式一手引文,也不支持对结果覆盖范围或研究质量的穷尽性判断。