CHS: Small: Collaborative Research: Increasing Social Connectedness in Telerobotic Platforms Through Adding Gesture Capabilities

CHS：小型：协作研究：通过添加手势功能增强远程机器人平台的社交联系

• 批准号: 1618283
• 负责人: Jerry Weinberg
• 金额: $ 21.96万
• 依托单位: Southern Illinois University at Edwardsville
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-01-15 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1618283&HistoricalAwards=false
• 关键词: CHS; Small; Collaborative; Research; Increasing

This project will study how making common telepresence robots more expressive and interactive affects people's willingness to use them and their opinions of remote collaborators. Many telepresence robots take the form of a screen on a mobile platform, giving remote attendees a physical body that can increase feelings of presence and interaction compared to a normal videoconference. However, the limited non-verbal expressiveness of these platforms is a major barrier to their use. Thus, the research goal is to increase the embodiment and social interaction capabilities of these platforms by adding a hand and arm to support common non-verbal interactions such as pointing, gesturing, and touch. To do this, the researchers will first build a simple hand and arm to support these non-verbal interactions and add it to an existing telepresence robot. They will then develop software to run on the robot to execute the gestures and ensure the safety of people nearby, as well as a user interface that maps gestures by the remote user onto gestures the hand and arm are able to execute. They will then test the usability of the system and its effects on social presence through studies that include both one-on-one and small group icebreaking conversations. This work will lead toward more natural interfaces for telepresence robots and a better understanding of how people accept them and interact with them. This, in turn, should lead to social benefits by making remote interaction more effective, saving time, effort, and fuel costs around travel while supporting not just remote meetings but other remote services such as medical diagnosis and caregiving. The team will also use the research both for their own classes and for outreach at events designed to encourage children to explore science careers. The work sits at the intersection of telerobotics, haptics, and social psychology. Because gestures, pointing, handshakes, and other non-verbal communication are an important part of human interaction that current telepresence platforms do not support, the work focuses on the development of a lightweight arm that can implement those gestures without the complexity, fragility, and expense of arms that fully mimic human motion. To make this tradeoff, the research team will develop a 3D-printed, 5-fingered hand with 3 degrees of freedom and simple connections that allow the fingers to bend naturally enough to recreate the intended gestures. The control software will use a forward and inverse kinematics approach to model hand configurations and use an open-loop controller that works along with the human operator to implement the gestures; bump, force, and optical sensors will be used to address safety concerns. For the human remote operator, the team will develop interfaces that (a) add cameras to the robot to provide a fuller view of the remote environment needed for effective gestures, and (b) use motion-tracking hardware to detect the remote user's arm motion and translate it into the space of possible motions of the robot arm, focusing on the specific targeted social gestures. They will evaluate the system through a series of between-subjects user studies, having participants as either the remote or local user interacting with a version of the robot with or without the arm. Participants will interact with trained experimental confederates both to reduce variability and to ensure that the target non-verbal gestures are experienced in both the with- and without-arm conditions. The team will measure perceived social connectedness with conversation partners and acceptability of the robot using standard scales, as well as asking questions about the particulars of the experience both to gain deeper insight into the reasons why the arm is effective (if it is) and to guide the design of future systems.

该项目将研究如何使常见的触觉机器人更具表现力和互动性影响人们使用它们的意愿以及对远程合作者的看法。 许多远程机器人在移动平台上采用屏幕的形式，为远程与会者提供了身体，与正常的视频会议相比，可以增加存在感和互动的感觉。 但是，这些平台的非语言表现力有限是其使用的主要障碍。 因此，研究目标是通过添加手和手臂来支持常见的非语言相互作用，例如指向，手势和触摸来提高这些平台的实施和社会互动能力。 为此，研究人员将首先建立一个简单的手和手臂来支持这些非语言相互作用，并将其添加到现有的远程机器人中。 然后，他们将开发在机器人上运行的软件，以执行手势并确保附近的人的安全，以及将远程用户手势映射手势的用户界面能够执行手和手臂。 然后，他们将通过包括一对一和小组破冰对话在内的研究来测试系统的可用性及其对社会存在的影响。 这项工作将导致更自然的界面用于远程机器人，并更好地理解人们如何接受它们并与它们互动。 反过来，这应该通过使远程互动更有效，节省时间，精力和燃料成本，同时不仅支持远程会议，还可以支持其他远程服务，例如医疗诊断和护理，从而带来社会收益。 该团队还将在自己的课程和旨在鼓励儿童探索科学职业的活动的活动中使用研究。这项工作位于远程植物学，触觉和社会心理学的交集。 由于手势，指向，握手和其他非语言交流是当前触发平台不支持人类相互作用的重要组成部分，因此工作着重于可以在没有复杂性，脆弱性和支出完全模仿人类运动的情况下实施这些手势的轻量级手臂的发展。 为了实现这一权衡，研究团队将开发一个3D打印的5个手指的手，并具有3个自由度和简单的连接，使手指自然地弯曲以重新创建预期的手势。 该控制软件将使用前向和反向运动学方法来建模手动配置，并使用与人类操作员一起实现手势的开环控制器；颠簸，力和光传感器将用于解决安全问题。 对于人类远程操作员，团队将开发（a）在机器人中添加摄像头的接口，以提供有效手势所需的远程环境的完整视图，并且（b）使用运动跟踪硬件来检测远程用户的手臂运动并将其转换为机器人手臂的可能性，专注于特定目标的社交手势。 他们将通过一系列受试者之间的用户研究来评估系统，让参与者作为远程或本地用户与有或没有手臂的机器人的版本进行交互。 参与者将与训练有素的实验同盟互动以减少变异性并确保目标非语言手势在伴有和无臂状况下经历。 该团队将使用标准量表来衡量与对话伙伴的感知社会联系以及机器人的可接受性，并询问有关体验细节的问题，以更深入地深入了解手臂有效的原因（如果是），并指导未来系统的设计。