Checksum-aided video error correction for real-time, streaming and broadcast video applications

适用于实时、流媒体和广播视频应用的校验和辅助视频纠错

• 批准号: RGPIN-2017-05412
• 负责人: Coulombe, Stéphane
• 金额: $ 2.4万
• 依托单位: École de technologie supérieure
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=648192
• 关键词: Checksum; aided; video; error; correction

In the recent years, we have witnessed an impressively rapid deployment of video devices, applications and systems, and the growth of video will only intensify in the coming years with emerging technologies such as 4K/8K Ultra HD formats, video devices for remote monitoring and control of machinery, transport and healthcare, virtual and augmented reality, and other devices resulting from the emerging Internet of Things. However, transmission errors over unreliable networks (e.g. wireless and satellite) cause significant visual impairments or dramatically reduce the effectiveness of networks (e.g. by causing retransmissions). Such errors significantly degrade the user's quality of experience (QoE) in most real-time and near real-time video applications. ******The main objective of this research program is to investigate low-complexity solutions to the problem of video error correction, which can be realistically integrated into communication systems. Specifically, the applicant and his team will study a new application layer video error correction approach, which has the potential to fully repair damaged video packets under reasonable error conditions. This approach consists in exploiting the protocol's checksum information, currently used only to detect errors, to correct errors. ******The applicant and his team will achieve the main objective through three research activities. First, in the context of real-time video, they will investigate how the checksum information can be exploited in a list decoding approach, which attempts to decode various candidate corrected video packets until a valid (decodable) packet is found, to dramatically reduce the number of candidates to consider and, therefore, the computational complexity. Second, in the context of near-real-time video streaming, they will investigate how the checksum can be used to limit the number of retransmissions by combining the information of a damaged packet with its retransmitted damaged version(s) to produce a repaired packet. Finally, in the context of video broadcasting using forward error correction (FEC) (redundant information), they will investigate how the checksum can be used in conjunction with FEC to produce a repaired packet. The technologies conceived in this research program will be validated on current as well as future video standards. ******The advances provided by this research will bring significant improvements in the quality and efficiency of video services and enable the emergence of unprecedented media experiences. As for their previous projects, Canada will strongly benefit from the intellectual property and commercialization of these technologies and from the training of highly qualified personal in the fast growing field of video processing and applications.

近年来，我们目睹了视频设备，应用和系统的令人印象深刻的快速部署，视频的增长只能在未来几年内通过4K/8K Ultra HD格式，视频设备，用于远程监控和控制机械，运输和医疗保健，虚拟和增强现实的现实和其他设备以及其他互联网的设备的新兴技术来加剧。但是，不可靠的网络（例如，无线和卫星）上的传输错误会导致严重的视觉障碍或大大降低网络的有效性（例如，通过引起重新启动）。在大多数实时和接近实时的视频应用程序中，此类错误会大大降低用户的经验质量（QOE）。 ******该研究计划的主要目的是研究视频错误校正问题的低复杂解决方案，这些解决方案可以实际整合到通信系统中。具体来说，申请人及其团队将研究一种新的应用程序层视频错误校正方法，该方法有可能在合理的错误条件下完全修复损坏的视频数据包。这种方法包括利用协议的校验和信息，目前仅用于检测错误，以纠正错误。 ******申请人及其团队将通过三项研究活动实现主要目标。首先，在实时视频的背景下，他们将调查如何在列表解码方法中利用校验和信息，该方法试图解码各种候选的校正视频数据包，直到找到有效的（可解码）数据包，以大大减少要考虑的候选者的数量，从而减少计算复杂性。其次，在近实时视频流的背景下，他们将通过将损坏数据包的信息与其重新构造的损坏版本相结合以生成修复的数据包来调查如何使用校验和来限制重新召集的数量。最后，在使用正向错误校正（FEC）（冗余信息）视频广播的背景下，他们将研究如何与FEC结合使用校验和生产修复的数据包。该研究计划中构想的技术将以当前和未来的视频标准进行验证。 ******这项研究提供的进步将带来视频服务的质量和效率的重大提高，并能够出现前所未有的媒体体验。至于他们以前的项目，加拿大将从这些技术的知识产权和商业化以及在快速增长的视频处理和应用领域中对高素质的个人进行培训。