论文标题
用于反馈和监测放射学AI/ML开发和临床部署的多站点,基于报告的集中式基础架构
A Multisite, Report-Based, Centralized Infrastructure for Feedback and Monitoring of Radiology AI/ML Development and Clinical Deployment
论文作者
论文摘要
多样性,高质量和标记的放射学图像数据的多站点,地理分布的创建和收集的基础架构对于成功的自动化开发,部署,监测和持续改进人工智能(AI)/机器学习(ML)解决方案至关重要。一种交互式放射学报告方法,该方法将图像查看,命令,自然语言处理(NLP)和图像发现与报告之间的超链接创建的创建提供了局部标签。这些图像和标签可以在基于云的系统中捕获和集中。该方法提供了一种实用有效的机制来监测算法性能。它还为新算法模型的迭代开发和质量改进提供了反馈。反馈和监测都是在不负担放射科医生的情况下实现的。该方法解决了拟议的监管后监视和外部数据的法规要求。全面的多站点数据收集有助于减少偏差。与专用回顾性专家标签相比,资源需求大大减少。
An infrastructure for multisite, geographically-distributed creation and collection of diverse, high-quality, curated and labeled radiology image data is crucial for the successful automated development, deployment, monitoring and continuous improvement of Artificial Intelligence (AI)/Machine Learning (ML) solutions in the real world. An interactive radiology reporting approach that integrates image viewing, dictation, natural language processing (NLP) and creation of hyperlinks between image findings and the report, provides localized labels during routine interpretation. These images and labels can be captured and centralized in a cloud-based system. This method provides a practical and efficient mechanism with which to monitor algorithm performance. It also supplies feedback for iterative development and quality improvement of new and existing algorithmic models. Both feedback and monitoring are achieved without burdening the radiologist. The method addresses proposed regulatory requirements for post-marketing surveillance and external data. Comprehensive multi-site data collection assists in reducing bias. Resource requirements are greatly reduced compared to dedicated retrospective expert labeling.