CSR: Small: Collaborative Research: Easily Adapting Apps to Diverse Wearable Form Factors

CSR：小：协作研究：轻松调整应用程序以适应不同的可穿戴设备外形

• 批准号: 1717973
• 负责人: Aruna Balasubramanian
• 金额: $ 28.45万
• 依托单位: SUNY at Stony Brook
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-01 至 2020-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1717973&HistoricalAwards=false
• 关键词: CSR; Small; Collaborative; Research; Easily

With the advent of many small, inter-connected devices - from appliances to wearable computers - the vision of ubiquitous computing appears increasingly tractable. The key obstacle is software development effort. Currently, a programmer must write a substantial amount of code for each different device form factor, such as smart phones, smart watches, and smart glasses. The research objective of this proposal is to demonstrate that a combination of techniques from Operating Systems, Human Computer Interaction, and Programming Languages can significantly reduce the programmer effort in adapting applications to different form factors. The developer writes an application for one form factor, and then specifies a simple metaprogram to extend the application to additional form factors. The UIWear system proposed in this project compiles the metaprogram to effectively and efficiently extend the smart phone application to different form factors. UIWear has the potential to transform the wearable application market by: (a) reducing the barrier for development and (b) intelligently offloading computation between the smart phone and the wearable device. Ubiquitous computing has the potential to dramatically improve many aspects of life, including healthcare, commerce, and education. Unfortunately, the widening range of different devices also introduces an equally large range of different and complex programming models' creating an obstacle between good ideas and end users. This proposal, if successful, will significantly simplify development of ubiquitous apps, making these platforms available to a wide range of developers. The work on augmenting accessibility services is independently useful to design new applications for the visually impaired. The software designed as part of this project will be released on a public site: https://github.com/sbunetsys. Electronic data will be archived internally. All data will be kept for at least 5 years after publication; likely longer, depending on its size and outside interest. The project will advance the state-of-the-art in three key areas. First, it will explore new models for abstracting and refactoring graphical user interfaces (GUIs) for a wide range of form factors. The research approach is to identify an intermediate, lowest-common-denominator-style representation of the GUI that has enough details to allow the GUI to be repositioned, transformed, and scaled, but is simple enough that it can be rendered natively on any device display. Second, the UIWear framework will design new constraint optimization strategies to find the optimal UI that satisfies the limitations of the new form factor while leveraging the unique capabilities of the form factor. Third, the UIWear framework will use new language-level analysis techniques to guide programmers in placing computation across multiple devices.

随着许多小型互连设备（从家用电器到可穿戴计算机）的出现，普适计算的愿景似乎变得越来越容易处理。主要障碍是软件开发工作。目前，程序员必须为每种不同的设备外形尺寸（例如智能手机、智能手表和智能眼镜）编写大量代码。 该提案的研究目标是证明操作系统、人机交互和编程语言的技术组合可以显着减少程序员使应用程序适应不同外形尺寸的工作量。开发人员为一种外形尺寸编写应用程序，然后指定一个简单的元程序以将应用程序扩展到其他外形尺寸。该项目中提出的 UIWear 系统编译元程序，以有效且高效地将智能手机应用程序扩展到不同的外形尺寸。 UIWear 有潜力通过以下方式改变可穿戴应用市场：(a) 减少开发障碍；(b) 智能地卸载智能手机和可穿戴设备之间的计算。 普适计算有潜力显着改善生活的许多方面，包括医疗保健、商业和教育。 不幸的是，不同设备的范围不断扩大也引入了同样大范围的不同且复杂的编程模型，这在好想法和最终用户之间造成了障碍。该提案如果成功，将大大简化无处不在的应用程序的开发，使这些平台可供广泛的开发人员使用。增强无障碍服务的工作对于为视障人士设计新的应用程序非常有用。 作为该项目一部分设计的软件将在公共网站上发布：https://github.com/sbunetsys。电子数据将在内部存档。所有数据将在发布后保存至少5年；可能会更长，具体取决于其规模和外部兴趣。该项目将推进三个关键领域的最先进技术。首先，它将探索针对各种外形尺寸进行抽象和重构图形用户界面（GUI）的新模型。研究方法是确定 GUI 的中间、最低公分母风格的表示形式，该表示形式具有足够的细节，允许 GUI 重新定位、转换和缩放，但又足够简单，可以在任何设备上本地呈现展示。其次，UIWear 框架将设计新的约束优化策略，以找到满足新外形尺寸限制的最佳 UI，同时利用外形尺寸的独特功能。第三，UIWear框架将使用新的语言级分析技术来指导程序员跨多个设备进行计算。

项目成果

A Survey of Patterns for Adapting Smartphone App UIs to SmartWatches

智能手机应用程序 UI 适应智能手表的模式调查

• DOI: 10.1145/3379503.3403564
• 发表时间: 2020-01
• 期刊: 22nd International Conference on Human-Computer Interaction with MobileDevices and Services (MobileHCI ’20
• 作者: Zhou, Zhilan;Xu, Jian;Balasubramanian, Aruna;Porter, Donald E.
• 通讯作者: Porter, Donald E.

Ultra-Low-Power Mode for Screenless Mobile Interaction

超低功耗模式实现无屏移动交互

• DOI: 10.1145/3242587.3242614
• 发表时间: 2018-10
• 期刊: 31st Annual ACM Symposium on User Interface Software and Technology
• 作者: Xu, Jian;Zhu, Suwen;Balasubramanian, Aruna;Bi, Xiaojun;Shilkrot, Roy
• 通讯作者: Shilkrot, Roy