检索说明

  • 查询:GraphRAG evidence retrieval
  • 年份过滤:2025-
  • 单查询上限:20
  • 发现日期:2026-11-12

Semantic Scholar 候选元数据

  • 作者:B. Sesen, J. Au Yeung, E. Asgari
  • 年份:2025
  • Venue:medRxiv
  • DOI:10.1101/2025.11.25.25341010
  • arXiv:未返回
  • S2 citationCount(当前快照):4
  • 来源线索:https://doi.org/10.1101/2025.11.25.25341010

摘要(未核验)

ObjectiveChronic Kidney Disease (CKD) is a progressive condition requiring evidence-based management, but adherence to complex guidelines remains challenging. Large Language Models (LLMs) could support clinical decision-making, yet their unreliability limits direct use. This study aimed to evaluate whether Retrieval-Augmented Generation (RAG), particularly a knowledge graph-enhanced pipeline (GraphRAG), improves guideline-based clinical decision support (CDS) in CKD management. Methods and AnalysisWe compared three approaches: a baseline LLM (GPT-4o), a vector-indexed RAG pipeline, and a GraphRAG pipeline. Each model answered nine clinically relevant questions for a synthetic cohort of 70 CKD patients. Outputs were assessed for clinical correctness, patient-specificity, and clarity, using both clinician-led evaluations and an LLM-as-Judge framework. ResultsRAG-based methods outperformed the baseline LLM in clinical correctness and guideline adherence. GraphRAG achieved the highest patient-specificity by leveraging multi-hop relationships across a knowledge graph derived from NICE CKD guidelines, particularly for tasks involving thresholds, algorithmic decisions, or open-ended management. However, GraphRAG scored lower in clarity, as its graph walks often returned long guideline excerpts that obscured key recommendations. All RAG systems were limited by the scope of the indexed guideline and performed poorly when essential information was missing. ConclusionsRAG and GraphRAG provide a scalable, auditable foundation for guideline-aligned CDS in CKD, with GraphRAG showing particular strengths in tailoring advice to patient data. Nonetheless, trade-offs remain between specificity and clarity, and effective deployment will require robust content management, transparent validation pipelines, and integration within established clinical governance frameworks. Key points- LLMs have comprehensive medical knowledge but require access to up-to-date, evidence-based, and locally relevant guidelines to be effective in CDS. - Hallucinations (the generation of inaccurate or misleading information) remain a major limitation for LLMs in healthcare. - Traditional information retrieval methods face several challenges in providing accurate, context-specific evidence. - Retrieval-Augmented Generation (RAG) and graph-based RAG approaches have emerged as promising solutions to overcome these limitations. - Renal medicine provides an ideal test domain to evaluate these models, given its complexity and reliance on nuanced, multidisciplinary decision-making. - Studying LLM performance in kidney health can yield valuable insights into how such models can safely and effectively support complex clinical decision-making.

转为正式文献前的核验清单

  • [ ] 从论文、出版社、会议、ACL Anthology、OpenReview 或 arXiv 页面核对标题、作者、年份和版本。
  • [ ] 核对 DOI、venue、正式链接和是否存在撤稿/版本变化。
  • [ ] 阅读正文后补充方法、证据边界、结果和与现有研究的关系。

Semantic Scholar 记录用于发现候选,不是正式一手引文,也不支持对结果覆盖范围或研究质量的穷尽性判断。