Collaborative Research: MLWiNS: Distributed Learning over Multi-Access Channels: From Bandlimited Coordinate Descent to Gradient Sketching

协作研究：MLWiNS：多访问通道上的分布式学习：从带限坐标下降到梯度草图

基本信息

批准号：
2003081
负责人：
Junshan Zhang
金额：
$ 40万
依托单位：
Arizona State University
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2020
资助国家：
美国
起止时间：
2020-10-01 至 2022-06-30
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2003081&HistoricalAwards=false
关键词：
Collaborative Research MLWiNS Distributed Learning

项目摘要

The recent wave of technological advances in machine learning and artificial intelligence has led to widespread applications and public awareness. At the same time, the rapid growth of high-speed wireless network services presents an opportunity for future distributed learning involving a vast number of smart IoT devices. This project targets several technical challenges posed by the limited reliability of wireless connections and computational constraints of the edge nodes in distributed learning systems. Overcoming these challenges is vital to the plethora of computation, communication, and coordination tasks required by distributed machine learning at the network edge. Centered on developing innovative edge learning algorithms over wireless MAC channels under the constraints of computing, power, and bandwidth, this project can significantly impact wireless edge learning in a variety of IoT applications, ranging from transportation, safety, and agriculture, to energy efficiency, e-health, and smart infrastructure. The broader impact of this research will also come through many educational opportunities by providing opportunities in STEM to K-12, women, and underrepresented minority students. This collaborative project will develop an innovative network architecture for distributed learning over wireless multi-access channels. Specifically, the PIs will take a principled approach to develop an integrated wireless edge learning framework, using both gradient-based methods and also very recent advances in gradient-free, zero-order optimization, while taking into account the constraints in computing, power and bandwidth therein, in a holistic manner. The developed methods will be also extended to the setting of distributed online learning and reinforcement learning under wireless MAC. The PIs will focus on optimizing communication-efficient gradient sparsification based local updates that are communicated within the wireless network under bandwidth constraints; and each sender intelligently carries out transmission power allocation based on learning gradient and channel conditions. One important objective is to develop a novel learning-based framework for efficient wireless channel estimation and update to enable effective power control and learning. The project will devise edge learning algorithms that are robust against wireless channel uncertainty. The team of PIs shall comprehensively investigate the impact of the wireless bandwidth and power constraint on both the accuracy and convergence speed of edge learning algorithms.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

机器学习和人工智能方面的技术进步浪潮导致了广泛的应用和公众意识。同时，高速无线网络服务的快速增长为将来的分布式学习提供了机会，涉及大量智能IoT设备。该项目针对的是，由无线连接的有限可靠性和分布式学习系统中边缘节点的计算限制的有限可靠性所带来的几个技术挑战。克服这些挑战对于网络边缘分布式机器学习所需的大量计算，通信和协调任务至关重要。该项目集中在计算，功率和带宽的限制下，在无线MAC渠道上开发创新的边缘学习算法，该项目可能会严重影响各种物联网应用程序中的无线边缘学习，从运输，安全性和农业到能源效率，到能源效率，到能源效率，到能源效率，到能源效率电子健康和智能基础架构。这项研究的更广泛的影响还将通过许多教育机会，通过向K-12，妇女和代表性不足的少数族裔学生提供机会。这个协作项目将开发一种创新的网络体系结构，用于通过无线多访问渠道分布式学习。具体而言，PI将采用一种原则的方法来开发一个集成的无线边缘学习框架，同时使用基于梯度的方法以及最新的无梯度，零订单优化的进步，同时考虑到计算，功率和电源和权力的约束其中的带宽，以整体方式。开发的方法还将扩展到无线MAC下的分布式在线学习和增强学习的设置。 PI将着重于优化基于带宽约束的无线网络中传达的基于无线网络中的沟通梯度稀疏的本地更新；每个发件人都根据学习梯度和渠道条件智能地进行传输功率分配。一个重要的目标是开发一个基于学习的新型框架，以进行有效的无线渠道估计并进行更新，以实现有效的功率控制和学习。该项目将设计边缘学习算法，这些算法可抵抗无线通道不确定性。 PI团队应全面研究无线带宽和功率限制对边缘学习算法的准确性和收敛速度的影响。该奖项反映了NSF的法定任务，并被认为是通过基金会的知识分子和广泛的知识分子和广泛的评估来支持的。影响审查标准。

项目成果

期刊论文数量（7）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

Finding the Homology of Decision Boundaries with Active Learning

寻找决策边界与主动学习的同源性

DOI：
发表时间：
2020
期刊：
Advances in neural information processing systems
影响因子：
0
作者：
Li, Weizhi;Dasarathy, Gautam;Ramamurthy, Karthikeyan N.;Berisha, Visar
通讯作者：
Berisha, Visar

Class GP: Gaussian Process Modeling for Heterogeneous Functions

GP 类：异质函数的高斯过程建模

DOI：
发表时间：
2023
期刊：
LION 17
影响因子：
0
作者：
Malu, M.;Pedrielli, G.;Dasarathy, G.;Spanias, A.
通讯作者：
Spanias, A.

State and Topology Estimation for Unobservable Distribution Systems using Deep Neural Networks.

使用深度神经网络对不可观测的配电系统进行状态和拓扑估计。

DOI：
10.1109/tim.2022.3167722
发表时间：
2022
期刊：
IEEE transactions on instrumentation and measurement
影响因子：
5.6
作者：
Azimian,Behrouz;Biswas,ReetamSen;Moshtagh,Shiva;Pal,Anamitra;Tong,Lang;Dasarathy,Gautam
通讯作者：
Dasarathy,Gautam

Distributed Zero-Order Algorithms for Nonconvex Multiagent Optimization