Gaze-contingent computer screen magnification control for people with low vision

针对低视力人士的注视相关计算机屏幕放大倍数控制

• 批准号: 10226365
• 负责人: Roberto Manduchi
• 金额: $ 35.87万
• 依托单位: UNIVERSITY OF CALIFORNIA SANTA CRUZ
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10226365
• 关键词: Affect; Age; Algorithms; Appearance; Apple; Behavior Control; Benchmarking; Blindness; Categories; Collaborations; Communication; Complex; Computer Vision Systems; Computer software; Computers; Consumption; Correlation Studies; Data; Data Set; Desktop Video; Engineering; Ensure; Eye; Face; Failure; Funding; Glass; Goals; Hand; Image; Individual; Learning; Location; Magic; Manuals; Measures; Minnesota; Modality; Mus; Operating System; Optometry; Performance; Peripheral; Process; Psychological reinforcement; Psychology; Reader; Reading; Research; Resort; Role; Schools; Science; Speech; Speed; Structure; Study Subject; System; Tablet Computer; Technology; Testing; Text; Time; Training; Translating; Update; Vision; Visual; Visual impairment; Work; algorithm development; algorithm training; base; computer science; control trial; cost; data acquisition; design; experience; experimental study; falls; gaze; human subject; interest; motor control; news; recurrent neural network; sample fixation; software systems; tool; web page; web site

! Project Summary This application describes proposed research with the goal of facilitating use of a computer screen magnifier by people with low vision. Screen magnification is a well-established, popular technology for access of onscreen content. Its main shortcoming is that it requires the user to continuously control, with the mouse or trackpad, the location of the focus of magnification, in order to ensure that the magnified content of interest is within the screen viewport. This tedious process may be time-consuming and ineffective. For example, the simple task of reading the news on a web site requires continuous horizontal scrolling, which affects the experience of using this otherwise very beneficial technology, and may discourage its use, especially by those with poor manual coordination. We propose to develop a software system that enables hands-free control of a screen magnifier. This system will rely on the user’s eye gaze (measured by a regular IR-based tracker, or from analysis of the images in a camera embedded in the screen) to update the location of the focus of magnification as desired. This research is inspired by preliminary work, which showed promising results with two simple gaze-based control algorithms, tested on three individuals with low vision. This project will be a collaboration between the Department of Computer Science and Engineering at UC Santa Cruz (PI: Manduchi, Co-I: Prado) and the School of Optometry at UC Berkeley (PI: Chung). Dr. Legge from the Department of Psychology at U. Minnesota will participate as a consultant. Two human subjects studies are planned. In Study 1 with 80 low vision subjects from four different categories of visual impairment, we will investigate the failure rate of a commercial gaze tracker (Aim 1), and will record mouse tracks, gaze tracks, and images from the subjects while performing a number of tasks using two modalities of screen magnification (Aim 2). In Study 2, with the same number of subjects, we will repeat the Study 1 experiment, but using a gaze-based controller trained from the data collected in Study 1, and individually tunable for best performance (Aim 3). In addition, we will experiment with an appearance-based gaze tracker that uses images from the screen camera, thereby removing the need for specialized gaze tracking hardware, as well as with a computer tablet form factor (Aim 4). We expect that reading speed and error rate using our gaze-based controller will be no worse than using mouse-based control. If successful, this study will show that the convenience of hands-free control offered by the proposed system comes at no additional cost in terms of individual performance at the considered tasks. !

！ 项目概要 该申请描述了拟议的研究，其目的是促进人们使用计算机屏幕放大镜 屏幕放大是一种成熟、流行的屏幕内容访问技术。 主要缺点是它需要用户使用鼠标或触控板连续控制物体的位置 放大焦点，以确保放大的感兴趣内容位于屏幕视口内。 繁琐的过程可能既耗时又低效，例如，在网络上阅读新闻这一简单任务。 网站需要连续水平滚动，这影响了使用体验，否则非常有利 技术，并可能阻碍其使用，尤其是那些手动协调能力差的人。 我们建议开发一个软件系统，可以实现屏幕放大器的免提控制。 依赖于用户的眼睛注视（通过常规的基于红外的跟踪器测量，或通过对相机中的图像的分析来测量） 嵌入在屏幕中）来根据需要更新放大焦点的位置。 初步工作显示了两种简单的基于凝视的控制算法的有希望的结果，并在三个设备上进行了测试 视力低下的人。 该项目将由加州大学圣塔分校计算机科学与工程系合作 Cruz（PI：Manduchi，Co-I：Prado）和加州大学伯克利分校验光学院（PI：Chung 博士）。 明尼苏达大学心理学系将作为顾问参与计划中的两项人类受试者研究。 在研究 1 中，有 80 名来自四种不同类别的视力障碍的低视力受试者，我们将调查失败情况 商业视线追踪器的速率（目标 1），并将记录鼠标轨迹、视线轨迹和受试者的图像 同时使用两种屏幕放大模式执行多项任务（目标 2），与研究 2 相同。 受试者数量，我们将重复研究 1 实验，但使用根据数据训练的基于凝视的控制器 研究 1 中收集的数据，并可单独调整以获得最佳性能（目标 3）。 基于外观的视线跟踪器，使用来自屏幕摄像头的图像，从而无需专门的 视线跟踪硬件，以及平板电脑的外形（目标 4）。 如果这项研究成功的话，使用基于凝视的控制器的错误率不会比使用基于鼠标的控制差。 将表明所提出的系统提供的免提控制的便利性无需额外成本 就所考虑的任务中的个人表现而言。 ！