CAREER: Improving Mobile Video Delivery for Emerging Contents and Networks

职业：改进新兴内容和网络的移动视频传输

• 批准号: 1915122
• 负责人: Feng Qian
• 金额: $ 55.66万
• 依托单位: University of Minnesota-Twin Cities
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-08-27 至 2024-04-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1915122&HistoricalAwards=false
• 关键词: CAREER; Improving; Mobile; Video; Delivery

Streaming videos wirelessly on mobile devices is an increasingly important application. The objective of this project is to bring innovations to mobile video delivery for new content types and over emerging networks. Specifically, the project investigates three aspects: (1) 360-degree immersive video delivery, (2) video streaming over multiple network paths (multipath), and (3) video streaming over millimeter-wave (mmWave) links. These are expected to be the key building blocks of next-generation video streaming services. First, 360-degree videos provide users with unique panoramic viewing experience; however, 360-degree video content delivery is much more challenging compared to regular videos. Second, multiple network interfaces have become a norm on off-the-shelf mobile devices but their potential is far from being fully exploited. Third, mmWave is a key technology that will be integrated into 5G wireless networks; but adapting video streaming to mmWave largely remains an uncharted territory. The proposed solutions will benefit the society by enhancing the user experience and reducing the resource consumption for next-generation immersive video services. The research will also be integrated with an education plan that seeks to prepare computer science students with the knowledge of new technological trends in networking and systems, and stimulate the general public interest in Science, Technology, Engineering, and Mathematics.This project includes three inter-connected research thrusts. (1) For 360 video streaming, based on the concept of field-of-view (FoV) guided streaming, the project uses big data analytics to facilitate accurate head movement prediction, a key prerequisite for FoV-guided streaming. It also uses a rate adaptation scheme with a "delta encoding" design allowing the quality of a fetched chunk to be incrementally upgraded. This substantially improves adaptability when facing randomness in head movements. (2) For multipath streaming, the project uses multiple network interfaces to be used simultaneously for streaming videos. The network framework supports video rate adaptation and allows users to flexibly configure each path's cost. The framework also supports delay-sensitive live streaming over multipath through strategic packet scheduling. (3) mmWave links bear unique characteristics of massive capacity and intermittent availability. The project first designs a transport layer for mmWave links. It then proposes several video streaming strategies tailored to mmWave, such as strategically combining mmWave and legacy omni-directional radios. For the above research thrusts, the project will develop algorithms, models, and systems, backed up by real implementation and evaluation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

在移动设备上无线流动视频是一个越来越重要的应用程序。该项目的目的是为新内容类型和新兴网络提供移动视频交付的创新。具体而言，该项目研究了三个方面：（1）360度沉浸式视频传递，（2）通过多个网络路径（多路径）和（3）视频流通过毫米波（MMWave）链接进行视频流。这些预计将是下一代视频流服务的关键构建块。 首先，360度视频为用户提供了独特的全景观看体验；但是，与常规视频相比，360度视频内容交付更具挑战性。其次，多个网络接口已成为现成的移动设备的规范，但其潜力远非完全被利用。第三，MMWave是将集成到5G无线网络中的关键技术。但是，将视频流传输到mmwave的大部分是一个未知的领域。拟议的解决方案将通过增强用户体验并减少下一代沉浸式视频服务的资源消耗来使社会受益。这项研究还将与一项教育计划集成，该计划旨在为计算机科学专业的学生提供有关网络和系统中新技术趋势的知识，并激发公众对科学，技术，工程和数学的普遍兴趣。该项目包括三个相互连接的研究推力。 （1）对于360个视频流，基于视野（FOV）引导流的概念，该项目使用大数据分析来促进准确的头部移动预测，这是FOV指导流的关键先决条件。它还使用“ Delta编码”设计的费率适应方案，允许逐步升级被提取的块的质量。当面对头部运动中随机性时，这显着提高了适应性。 （2）对于多径流，该项目使用多个网络接口用于流视频。网络框架支持视频速率适应，并允许用户灵活地配置每个路径的成本。该框架还通过战略数据包调度来支持通过多路径延迟敏感的实时流。 （3）MMWave链接具有巨大容量和间歇性可用性的独特特征。该项目首先设计用于MMWave链接的传输层。然后，它提出了几种针对MMWave量身定制的视频流策略，例如战略性地结合MMWave和Legacy Omni方向收音机。 对于以上研究的推力，该项目将开发算法，模型和系统，并得到真正的实施和评估的支持。该奖项反映了NSF的法定任务，并被认为是值得通过基金会的知识分子和更广泛影响的评估评估标准的评估来支持的。

项目成果

Quality-aware strategies for optimizing ABR video streaming QoE and reducing data usage

• DOI: 10.1145/3304109.3306231
• 发表时间: 2019-06
• 期刊: Proceedings of the 10th ACM Multimedia Systems Conference
• 作者: Yanyuan Qin;Shuai Hao;K. Pattipati;Feng Qian;S. Sen;Bing Wang;Chaoqun Yue

A First Look at Commercial 5G Performance on Smartphones

• DOI: 10.1145/3366423.3380169
• 发表时间: 2019-09
• 期刊: Proceedings of The Web Conference 2020
• 作者: Arvind Narayanan;Eman Ramadan;Jason Carpenter;Qingxu Liu;Yu Liu;Feng Qian;Zhi-Li Zhang

Demo: Tile-Based Viewport-Adaptive Panoramic Video Streaming on Smartphones

演示：智能手机上基于图块的视口自适应全景视频流

• DOI: 10.1145/3241539.3267715
• 发表时间: 2018
• 期刊: The 24th Annual International Conference on Mobile Computing and Networking
• 作者: Qian, Feng;Han, Bo;Xiao, Qingyang;Gopalakrishnan, Vijay
• 通讯作者: Gopalakrishnan, Vijay

YuZu: Neural-Enhanced Volumetric Video Streaming

• 发表时间: 2022
• 作者: Anlan Zhang;Chendong Wang;B. Han;Feng Qian

Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices

• DOI: 10.1145/3241539.3241565
• 发表时间: 2018-10
• 期刊: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking
• 作者: Feng Qian;B. Han;Q. Xiao;V. Gopalakrishnan