论文标题
ACE:迈向以应用程序为中心的边缘云协作情报
ACE: Towards Application-Centric Edge-Cloud Collaborative Intelligence
论文作者
论文摘要
基于机器学习的智能应用正在影响我们生活的许多部分。他们必须在服务延迟,网络带宽开销以及隐私方面进行严格的实际限制操作。然而,当前在云中运行的实现无法满足所有这些约束。 Edge-Cloud协作情报(ECCI)范式已成为解决此类问题的流行方法,并迅速开发和部署了应用程序。但是,由于缺乏对基础架构管理,Edge-Cloud协作服务,复杂的智能工作负载和有效的绩效优化,这些原型实现是不用一般性的开发人员依赖和方案的特定于方案,而在实践中无法有效地应用于大规模或一般的ECC方案。在本文中,我们系统地设计和构建了第一个统一的平台ACE,该平台可以处理不断增加的优势和云资源,用户透明服务,并以增加规模和复杂性增强智能工作负载,以促进成本效率和高性能的ECCI应用程序开发和部署。为了进行验证,我们明确介绍了基于ACE的智能视频查询应用程序的施工过程,并演示了如何有效地实现可自定义的性能优化。根据我们的最初经验,我们讨论了ACE的局限性和愿景,以阐明有希望的问题,以详细说明接近的ECCI生态系统。
Intelligent applications based on machine learning are impacting many parts of our lives. They are required to operate under rigorous practical constraints in terms of service latency, network bandwidth overheads, and also privacy. Yet current implementations running in the Cloud are unable to satisfy all these constraints. The Edge-Cloud Collaborative Intelligence (ECCI) paradigm has become a popular approach to address such issues, and rapidly increasing applications are developed and deployed. However, these prototypical implementations are developer-dependent and scenario-specific without generality, which cannot be efficiently applied in large-scale or to general ECC scenarios in practice, due to the lack of supports for infrastructure management, edge-cloud collaborative service, complex intelligence workload, and efficient performance optimization. In this article, we systematically design and construct the first unified platform, ACE, that handles ever-increasing edge and cloud resources, user-transparent services, and proliferating intelligence workloads with increasing scale and complexity, to facilitate cost-efficient and high-performing ECCI application development and deployment. For verification, we explicitly present the construction process of an ACE-based intelligent video query application, and demonstrate how to achieve customizable performance optimization efficiently. Based on our initial experience, we discuss both the limitations and vision of ACE to shed light on promising issues to elaborate in the approaching ECCI ecosystem.