Computationally analyzing the hierarchical complexity of infants' social coordination on multi scales in natural daily life to investigate infants' cognitive development

计算分析自然日常生活中婴儿多尺度社会协调的层次复杂性，以研究婴儿的认知发展

• 批准号: 22K20314
• 负责人: Li Jiarui
• 金额: $ 1.5万
• 依托单位: The University of Tokyo
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Research Activity Start-up
• 财政年份: 2022
• 资助国家: 日本
• 起止时间: 2022-08-31 至 2024-03-31
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/en/grant/KAKENHI-PROJECT-22K20314/
• 关键词: multi-scale coordination; infant daily interaction; culture differences; Social interaction; Infants development; Multi-scale analysis

This project aims at quantifying social modalities and multi-scales to find the multi-combining computational mechanisms in infants’ interactive development. The current achievements focused on the first two of the three research questions: Q1. What cues in which modality do infants accept from the social-interactive environment in which time scale? Q2. How do infants manage the cues to interact with the environment inter/across time scale(s)?A multi-scales analysis framework was proposed based on the prosodic alignment between infants and caregivers in daily interaction. The framework analyzed the day-long audio data from a Tseltal corpus. The results revealed that infants’ and caregivers’ vocalizations are differently coordinated on each timescale, . Furthermore, the same analysis was conducted on a Canadian-English corpus with audio data under similar collection conditions. The results reveal that maternal prosodic alignment occurs in English but not Tseltal, while infant alignment to caregivers is weak but similarly present across cultures. Interestingly, Tseltal dyads were more likely than Canadian ones to show increases in prosodic alignment over longer sequences of interaction. A conference paper and a poster based on these results were presented at (Li, J., et al., ICDL 2022) and (Li, J., et al., SRCD 2023).Current findings stressed that infants received varied auditory cues from the environment on a global, a middle, and a local scale (Q1). Moreover, infants also behave differently, corresponding to these cues across time scales. (Q2)

该项目旨在量化社会方式和多规模，以在婴儿的互动发展中找到多组合的计算机制。当前的成就集中在三个研究问题中的前两个：Q1。在哪个时间范围内，婴儿从社会交互环境中接受哪种线索？ Q2。婴儿如何管理与环境间/跨时间量表相互作用的线索？根据每日相互作用的婴儿与护理人员之间的韵律比对，提出了多尺度分析框架。该框架分析了Tseltal语料库的一天的音频数据。结果表明，婴儿和看护人的发声在每个时间表上都有不同的协调。此外，在类似的收集条件下，对加拿大 - 英语语料库进行了相同的分析。结果表明，肥大的韵律对准以英语而不是tseltal发生，而婴儿与护理人员的一致性很弱，但在各种文化中类似地存在。有趣的是，与加拿大二元组相比，tseltal二元组比加拿大二元组显示出比更长的相互作用序列相比的韵律比对的增加。在（Li，J。等，ICDL 2022）和（Li，J。等，SRCD 2023）的（Li，J。等，ICDL 2022）上介绍了会议文件和海报。申流的发现强调，婴儿在全球，中等和局部规模（Q1）上从环境中获得了不同的听觉提示。此外，婴儿的行为也有所不同，与时间尺度相对应。 （Q2）

项目成果

Multi-scale analysis of vocal coordination in infant-caregiver daily interaction

婴儿与护理人员日常互动中声音协调的多尺度分析

• 发表时间: 2022
• 作者: 藤本花音;蘆田宏;Jiarui Li
• 通讯作者: Jiarui Li

Infant-Caregiver Vocal Coordination in Daily Interaction in Tseltal and Canadian English

采尔塔尔语和加拿大英语日常互动中婴儿与看护者的声音协调

• 发表时间: 2023
• 作者: 野間紘久;大井瞳;山本浩彰;窪田恵美;田中春仁;宮崎友里;井上真里;新川瑤子;大塚公美子;高階光梨;中島俊;久我弘典;横井良典;横井良典;Jiarui Li
• 通讯作者: Jiarui Li