NeTS: Medium: Collaborative: Reliable Underwater Acoustic Video Transmission Towards Human-Robot Dynamic Interaction

NeTS：媒介：协作：实现人机动态交互的可靠水下声学视频传输

• 批准号: 1763964
• 负责人: Dario Pompili
• 金额: $ 50万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-09-01 至 2022-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1763964&HistoricalAwards=false
• 关键词: NeTS; Medium; Collaborative; Reliable; Underwater

In the past decade underwater communications have enabled a wide range of applications; there are, however, novel underwater monitoring applications and systems based on human-robot dynamic interaction that require real-time multimedia acquisition and classification. Remotely Operated Vehicles (ROVs) are key instruments to support such interactive applications as they can capture multimedia data from places where humans cannot easily/safely go; however, underwater vehicles are often tethered to the supporting ship by a fiber cable or have to rise periodically to the surface to communicate with a remote station via Radio Frequency (RF) waves, which constrains the mission. Wireless acoustic communication is the typical physical-layer technology for underwater communication; however, video transmissions via acoustic waves are hard to accomplish as the acoustic waves suffer from attenuation, limited bandwidth, Doppler spreading, high propagation delay, high bit error rate, and time-varying channel. For these reasons, state-of-the-art acoustic communication solutions are still mostly focusing on enabling delay-tolerant, low-bandwidth/low-data-rate scalar data transmission or at best low-quality/low-resolution multimedia streaming in the order of few tens of Kbps. Hence, the objectives of this research program are: (1) To design novel communication solutions for robust, reliable, and high-data rate underwater multimedia streaming on the order of hundreds of Kilobits per second (Kbps); (2) To investigate the problem of integrating communication methods available in multiple environments on an innovative software-defined testbed architecture integrating Microelectromechanical (MEMS)-based Acoustic Vector Sensors (AVSs) that will enable processing-intensive physical-layer functionalities as software-defined, but executed in hardware that can be reconfigured in real time by the user based on the Quality of Experience (QoE).By exploiting multiple-antenna arrays and AVSs, in Task 1 a novel physical-layer solution will be proposed to boost the data rate for underwater acoustic transmission so as to transfer high-resolution video underwater. By following a novel probabilistic approach, an efficient Medium Access Control (MAC) layer solution will be designed to share reliably the space among the steered vehicles by using AVSs so as to reduce the acoustic interference. The quality of multimedia delivery will be improved by applying a robust closed-loop hybrid Automatic Repeat Request (ARQ) coding technique based on the estimated angles of arrivals using AVSs. In Task 2, the SEANet G2 acoustic networking platform will be modified to investigate the design and fabrication of a new class of miniaturized and integrated AVS arrays based on the Aluminum Nitride (AlN) piezoelectric MEMS technology. Finally, in Task 3, scenarios will be defined to validate the ideas proposed in Task 1 using the Naviator, AVSs, and SEANet testbed; Task 2 will be evaluated by integrating SEANet to a buoy and the Naviator along with AVSs to build a testbed for conducting video transmission experiments. Tasks 1 and 2 will be also integrated by comparing the pros and cons of MEMs AVSs with Commercial Off-The-Shelf (COTS) AVSs and by evaluating the semi-autonomous human-in-the-loop features to enhance user QoE.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在过去的十年中，水下通信已实现了广泛的应用程序；但是，基于需要实时多媒体采集和分类的人类机器人动态相互作用，有新的水下监测应用和系统。远程操作的车辆（ROV）是支持此类交互式应用程序的关键工具，因为它们可以从人类无法轻松/安全地进行的地方捕获多媒体数据；但是，水下车辆通常被纤维电缆束缚在支撑船上，或者必须定期上升到地面以通过射频（RF）波与远程站进行通信，从而限制了任务。无线声音通信是用于水下通信的典型物理层技术；然而，由于声波遭受衰减，有限的带宽，多普勒扩散，高传播延迟，高钻头错误率和时变通道，因此很难通过声波进行视频传播。由于这些原因，最先进的声学通信解决方案仍然主要集中于实现延迟耐耐受性，低带宽/低数据标准标量数据传输或最多只能以几千万KBP的顺序以低质量/低分辨率的多媒体流传输。因此，该研究计划的目标是：（1）设计新颖的通信解决方案，以根据每秒数百千千座（KBPS）的订单达到稳健，可靠和高数据水下多媒体流媒体播放； （2）要调查整合在多种环境中可用的沟通方法的问题，以创新的软件定义的测试床结构集成了基于微机械（MEMS）的基于微机械（MEM）的声学矢量传感器（AVSS），该架构将启用软件定义，但可以在硬件中执行的经验（以实现的方式进行），该功能可以实现，以实现良好的经验（可以在硬件中执行）。在任务1中，将提出一种新型的物理层解决方案，以提高水下声学传播的数据速率，从而将高分辨率的视频在水下传递。通过遵循一种新型的概率方法，将设计有效的培养基访问控制（MAC）层解决方案，以通过使用AVSS在转导车辆之间可靠地共享空间，以减少声学干扰。通过使用基于使用AVS的估计的到达角度，使用强大的闭环混合自动重复请求（ARQ）编码技术，可以提高多媒体交付的质量。在任务2中，Seanet G2声学网络平台将进行修改，以研究基于氮化铝（ALN）Piezoelectric MEMS技术的新型微型化和集成AVS阵列的设计和制造。最后，在任务3中，将定义方案，以使用Naviator，AVSS和Seanet Testbend验证任务1中提出的想法；任务2将通过将Seanet与浮标集成到浮标，并与AVS一起评估，以构建用于进行视频传输实验的测试台。任务1和2还将通过将MEMS AVSS的优缺点与商业现成（COTS）AVSS进行比较，并通过评估半自治的人类特征来增强用户QOE。这奖反映了NSF的宣传奖，反映了NSF的立法任务，并被认为是通过基金会的智力上的评估来进行评估，并值得通过评估来评估基金会的优点和广泛的范围。

项目成果

UW-CTSM: Circular Time Shift Modulation for Underwater Acoustic Communications

• DOI: 10.23919/wons54113.2022.9764464
• 发表时间: 2022-03
• 期刊: 2022 17th Wireless On-Demand Network Systems and Services Conference (WONS)
• 作者: Zhuoran Qi;D. Pompili

In-Network Collaboration for CDMA-Based Reliable Underwater Acoustic Communications

基于 CDMA 的可靠水下声学通信的网内协作

• DOI: 10.1109/joe.2019.2910940
• 发表时间: 2019
• 期刊: IEEE Journal of Oceanic Engineering
• 影响因子: 4.1
• 作者: Rahmati, Mehdi;Petroccia, Roberto;Pompili, Dario
• 通讯作者: Pompili, Dario

ASVTuw: Adaptive Scalable Video Transmission in Underwater Acoustic Multicast Networks

ASVTuw：水下声学组播网络中的自适应可扩展视频传输

• DOI: 10.1145/3567600.3568137
• 发表时间: 2022
• 期刊: WUWNet'22: The 16th International Conference on Underwater Networks & Systems
• 作者: Qi, Zhuoran;Petroccia, Roberto;Pompili, Dario
• 通讯作者: Pompili, Dario

Spatial Modulation-based Orthogonal Signal Division Multiplexing for Underwater ACOMMS

基于空间调制的正交信号分复用水下 ACOMMS

• DOI: 10.1109/ucomms56954.2022.9905682
• 发表时间: 2022
• 期刊: 2022 Sixth Underwater Communications and Networking Conference (UComms
• 作者: Qi, Zhuoran;Pompili, Dario
• 通讯作者: Pompili, Dario

Underwater Adaptive Video Transmissions Using MIMO-Based Software-Defined Acoustic Modems

• DOI: 10.1109/tmm.2021.3127454
• 发表时间: 2023
• 期刊: IEEE Transactions on Multimedia
• 影响因子: 7.3
• 作者: M. Rahmati;Zhuoran Qi;D. Pompili