A Non-Document Text and Display Reader for Visually Impaired Persons

适合视障人士的非文档文本和显示阅读器

• 批准号: 7446299
• 负责人: JAMES M COUGHLAN
• 金额: $ 42.18万
• 依托单位: SMITH-KETTLEWELL EYE RESEARCH INSTITUTE
• 依托单位国家: 美国
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-04-01 至 2011-03-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/7446299
• 关键词: Access to Information; Acoustics; Address; Algorithms; American; Applications Grants; Auditory; Blindness; Categories; Cellular Phone; Code; Computer Vision Systems; Computer software; Cosmetics; Count; Custom; Daily; Data; Databases; Development; Devices; Economics; Electronics; Employment; Evaluation; Feasibility Studies; Figs - dietary; Funding; Goals; Hand; Home environment; Human; Image; Image Analysis; Impairment; Lavandula; Mainstreaming; Marketing; Memory; Modification; Paper; Printing; Process; Public Health; Range; Reader; Reading; Research; Resolution; Running; Schools; Self-Help Devices; Speech; Standards of Weights and Measures; Surveys; System; Telephone; Testing; Text; Training; Universities; Vision; Visit; Visual; Visual impairment; Visually Impaired Persons; Voice; Workplace; base; blind; consumer product; cost; design; desire; image processing; microwave electromagnetic radiation; optical character recognition; prevent; programs; rehabilitation technology; response; time interval; tool; trafficking; visual information

DESCRIPTION (provided by applicant): The goal of this project is to develop a computer vision system based on standard camera cell phones to give blind and visually impaired persons the ability to read appliance displays and similar forms of non-document visual information. This ability is increasingly necessary to use everyday appliances such as microwave ovens and DVD players, and to perform many daily activities such as counting paper money. No access to this information is currently afforded by conventional text reading systems such as optical character recognition (OCR), which is intended for reading printed documents. Our proposed software runs on a standard, off-the- shelf camera phone and uses computer vision algorithms to analyze images taken by the user, to detect and read the text within each image, and to then read it aloud using synthesized speech. Preliminary feasibility studies indicate that current cellular phones easily exceed the minimum processing power required for these tasks. Initially, the software will read out three categories of symbols: LED/LCD appliance displays, product or user-defined barcodes, and denominations of paper money. Ultimately these functions will be integrated with other capabilities being developed under separate funding, such as reading a broad range of printed text (including signs), recognizing objects, and analyzing photographs and graphics, etc., all available as free or low-cost software downloads for any cell phone user. Our specific goals are to (1) gather a database of real images taken by blind and visually impaired persons of a variety of LED/LCD appliance displays, barcodes and US paper currency; (2) develop algorithms to process the images and extract the desired information; (3) implement the algorithms on a camera phone; and (4) conduct user testing to establish design parameters and optimize the human interface. PUBLIC HEALTH RELEVANCE: For blind and visually impaired persons, one of the most serious barriers to employment, economic self sufficiency and independence is insufficient access to the ever-increasing variety of devices and appliances in the home, workplace, school or university that incorporate visual LED/LCD displays, and to other types of text and symbolic information hitherto unaddressed by rehabilitation technology. The proposed research would result in an assistive technology system (with zero or minimal cost to users) to provide increased access to such display and non- document text information for the approximately 10 million Americans with significant vision impairments or blindness.

描述（由申请人提供）：该项目的目标是开发一种基于标准拍照手机的计算机视觉系统，使盲人和视障人士能够阅读设备显示屏和类似形式的非文档视觉信息。这种能力对于使用微波炉和 DVD 播放器等日常用品以及执行许多日常活动（例如数纸币）越来越有必要。目前，传统的文本阅读系统（例如用于阅读印刷文档的光学字符识别 (OCR)）无法提供对此信息的访问。我们提出的软件在标准的现成拍照手机上运行，​​并使用计算机视觉算法来分析用户拍摄的图像，检测和读取每个图像中的文本，然后使用合成语音大声朗读。初步可行性研究表明，当前的蜂窝电话很容易超出这些任务所需的最低处理能力。最初，该软件将读出三类符号：LED/LCD 设备显示屏、产品或用户定义的条形码以及纸币面额。最终，这些功能将与单独资助下开发的其他功能集成，例如阅读各种印刷文本（包括标志）、识别物体以及分析照片和图形等，所有这些功能都可以作为免费或低成本软件提供任何手机用户均可下载。我们的具体目标是 (1) 收集盲人和视障人士拍摄的各种 LED/LCD 电器显示器、条形码和美国纸币的真实图像数据库； （2）开发算法来处理图像并提取所需信息； (3) 在拍照手机上实现算法； (4) 进行用户测试以建立设计参数并优化人机界面。公共卫生相关性：对于盲人和视障人士来说，就业、经济自给自足和独立的最严重障碍之一是无法充分获得家庭、工作场所、学校或大学中不断增加的各种包含视觉功能的设备和电器。 LED/LCD 显示器，以及迄今为止康复技术尚未解决的其他类型的文本和符号信息。拟议的研究将产生一个辅助技术系统（用户成本为零或最低），为大约 1000 万患有严重视力障碍或失明的美国人提供更多对此类显示和非文档文本信息的访问。