Language-independent speaker anonymization with multiple privacy-related attributes

具有多个隐私相关属性的独立于语言的说话人匿名化

基本信息

批准号：
22K21319
负责人：
Miao Xiaoxiao
金额：
$ 1.83万
依托单位：
National Institute of Informatics
依托单位国家：
日本
项目类别：
Grant-in-Aid for Research Activity Start-up
财政年份：
2022
资助国家：
日本
起止时间：
2022-08-31 至 2024-03-31
项目状态：
已结题

项目摘要

The first year's work on speaker anonymization includes three parts:Part 1) Following our plan, we propose modifying the speaker embedding and pitch to conceal the speaker's gender. This approach has been accepted by ICASSP 2023. Our code and audio samples is available. (see https://github.com/ nii- yamagishilab/speaker_sex_attribute_privacy)Part 2) I contributed to the VoicePrivacy 2022 challenge and built a self-supervised learning (SSL) -based speaker anonymization system (SAS). It uses an SSL-based content encoder to extract general context representations regardless of the language of the input speech. This model is released for free (see https://www.voiceprivacychallenge.org).Part 3) We made changes to the SSL-based SAS program mentioned earlier, with the goal of making it easier for users to operate. We added several new features, including the ability to adjust pitch and select speakers to anonymize in a flexible way. This updated program was then applied to Japanese speech data. A broadcasting company in Japan has expressed interest in using this model for a real TV program.

第一年的说话人匿名化工作包括三个部分：第 1 部分）按照我们的计划，我们建议修改说话人嵌入和音调以隐藏说话人的性别。此方法已被 ICASSP 2023 接受。我们的代码和音频示例可用。（请参阅 https://github.com/nii-yamagishilab/speaker_sex_attribute_privacy）第 2 部分）我为 VoicePrivacy 2022 挑战做出了贡献，并构建了一个基于自我监督学习 (SSL) 的说话者匿名系统 (SAS)。它使用基于 SSL 的内容编码器来提取一般上下文表示，而不管输入语音的语言如何。该模型免费发布（参见https://www.voiceprivacychallenge.org）。第3部分）我们对前面提到的基于SSL的SAS程序进行了更改，目的是让用户更容易操作。我们添加了一些新功能，包括调整音调和选择以灵活方式匿名的发言者的能力。然后将这个更新的程序应用于日语语音数据。日本的一家广播公司表示有兴趣将该模型用于真实的电视节目。