I-Corps: Semio: Customer discovery for a software platform for human-robotic interactions

I-Corps：Semio：人机交互软件平台的客户发现

• 批准号: 1641982
• 负责人: Andrea Belz
• 金额: $ 5万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-06-15 至 2017-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1641982&HistoricalAwards=false
• 关键词: Corps; Semio; Customer; discovery; software

This I-Corps team is developing a standardized software platform to allow humans to interact with and use robots through natural communication, such as speech and body language. The proposed "Semio" software platform allows robot developers to create (through developer tools) and deploy (to an app store) speech/gesture-based applications to be executed by robots, and allows non-expert robot users to access (from the app store) and use (through natural communication and smart devices) those robot applications. The proposed software enables a robot to automatically recognize human speech and body language, make decisions about how to respond (specified by the developer for the application), and act based on those decisions while also providing its own speech and body language. This natural communication interface increases the usability of robots by novice users. The Semio software platform involves novel algorithms and robust code bases that enable a robotic hardware platform to operate "out of the box" based on a set of core social behaviors that serve as building blocks of face-to-face conversational interaction; these behaviors include speech (what is said), eye gaze (where attention is focused), gestures (face, head, body, arm, and hand movements), turn-taking (when to talk and when to listen), and interpersonal spacing (where to stand for to have a conversation). The target market for the proposed speech/gesture-based software is personal robotics, though the team is also exploring other markets, such as smart devices (smart phones, GPS, and the Internet of Things), gaming, transportation (cars and self-driving cars), sensors (Microsoft Kinect and Intel RealSense), and general robotics (industrial, military, and commercial robotics). The team is currently targeting customers who are hardware and software developers of these interactive technologies. Developers may be both expert and non-expert, and may be members of industry, the Maker community, hobbyists, or academia. Through repeated customer interviews, this team will continue to integrate customer feedback into the demo app to better improve the product content and performance to meet the identified needs of customers. The software platform will also be connected to a hardware robot platform to begin proof-of-concept demonstrations to and connection-building with prospective customers in the robotics market.

这个I-Corps团队正在开发一个标准化的软件平台，以允许人类通过自然通信（例如语音和肢体语言）与机器人进行互动和使用。拟议的“ SEMIO”软件平台允许机器人开发人员（通过开发人员工具）创建（通过开发人员工具），并（到App Store）基于语音/手势的应用程序由机器人执行，并允许非专家机器人用户访问（从App Store）访问（从App Store）访问（通过自然通信和智能设备）这些机器人应用程序。提出的软件使机器人能够自动识别人类的语音和肢体语言，做出有关如何响应的决定（由开发人员为应用程序指定），并根据这些决定采取行动，同时还提供了自己的语音和肢体语言。这种自然的通信接口增加了新手用户的机器人的可用性。 SEMIO软件平台涉及新颖的算法和强大的代码库，这些算法使机器人硬件平台能够基于一组核心社​​交行为来操作“开箱即用”，这些核心社交行为是面对面对话交互的构建。这些行为包括言语（所说的），眼睛凝视（注意力集中），手势（面部，头部，身体，手臂和手动运动），转弯（何时说话，何时聆听）以及人际间距（在哪里可以进行对话）。拟议的语音/手势软件的目标市场是个人机器人技术，尽管团队还探索其他市场，例如智能设备（智能手机，GPS和物联网），游戏，运输（汽车和自动驾驶汽车），传感器（Microsoft Kinect Kinect and Intel and Intel and Intelsense），以及一般机器人（Industrial Robotics），以及一般的机器人（Marterial Robot）。该团队目前正在针对这些交互式技术的硬件和软件开发人员的客户。开发人员可能既是专家又是非专家，并且可能是工业，创造者社区，业余爱好者或学术界的成员。通过反复的客户访谈，该团队将继续将客户反馈集成到演示应用程序中，以更好地改善产品内容和性能，以满足客户的确定需求。该软件平台还将连接到硬件机器人平台，以开始与机器人市场中潜在客户的概念验证演示和建立联系。