Capti Screen Reading Assistant for Goal Directed Web Browsing

用于目标导向网页浏览的 Capti 屏幕阅读助手

• 批准号: 9048176
• 负责人: Yevgen Borodin
• 金额: $ 50万
• 依托单位: CHARMTECH LABS, LLC
• 依托单位国家: 美国
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-08-01 至 2017-12-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/9048176
• 关键词: Automation; Blindness; Budgets; Businesses; Communication; Computer software; Computers; Data; Development; Disabled Persons; Ensure; Environment; Evaluation; FarGo; Focus Groups; Generations; Goals; Human Resources; In Situ; Information Retrieval; Internet; Internships; Laboratory Study; Lead; Learning; Legal patent; Link; Longitudinal Studies; Machine Learning; Marketing; Mining; Modeling; Natural Language Processing; Online Systems; Pattern; Phase; Probability; Process; Productivity; Publications; Publishing; Reader; Reading; Recording of previous events; Rehabilitation therapy; Research; Research Personnel; Reservations; Resources; Schedule; Scheme; Seasons; Self-Help Devices; Small Business Innovation Research Grant; Speed; Suggestion; System; Technology; Time; Universities; Vision; Visual impairment; Work; base; collaborative environment; commercial application; commercialization; computer human interaction; design; disability; educational atmosphere; empowered; experience; improved; innovation; member; natural language; next generation; novel strategies; operation; payment; predictive modeling; public health relevance; quality assurance; query optimization; research and development; response; success; technological innovation; tool; usability; web page; web-accessible

 DESCRIPTION (provided by applicant): Web browsing with assistive technologies such as screen readers and magnifiers can often be a frustrating and challenging experience for people with vision impairments, because it entails a lot of searching for content, forms, and links that are required for doing online tasks such as shopping, bill-payment, reservations, etc. This SBIR Phase II project will build on Phase I results and will continue the development and eventual deployment of Capti Screen Reading Assistant - a next-generation assistive technology, enabling goal- directed web browsing for people with visual impairments. With Capti Assistant, users will be able to stay focused on their high-level browsing goals that are expressed in natural language (spoken or typed). The Assistant will lead the users step-by-step towards the fulfillment of these goals by offering suggestions on what action to take at every step of the way and automatically executing the chosen action on behalf of the user. Suggested actions will include operations such as form filling, activating controls (e.g., clicking buttons and links), et. Capti Assistant will dramatically reduce the time spent by people with visual impairments on performing tasks online. The Assistant will significantly improve the speed and efficiency with which they can interact with the Web, thereby, making people with disabilities more productive in today's web-based economy. Given a user browsing goal, expressed in a natural-language form, Capti Assistant will utilize a predictive model to guide the user toward the goal. The unique aspect of the Assistant is that its suggestions will be automatically learned from the user's own history of browsing actions and commands, as well as from the user's demonstration of how to accomplish browsing tasks that have not been done before. The Assistant will process user commands and present the suggested browsing actions to the user on demand, giving the user a choice between following the suggestions or continue browsing normally without accepting the suggestions. The functionality offered by the Assistant will go far beyond popular personal assistant applications such as Siri, which have not been designed specifically for people with vision impairments, and which cannot be used for ad hocweb browsing. Capti Assistant will go a long way towards bridging the growing web accessibility divide between the ways people with and without vision impairments browse the Web. For them, the Assistant will usher in a new era of independence and employability in our global web-based economy. Thus, from a broader perspective, goal- directed browsing will exemplify the vision of the Universally Accessible Web whose thesis is "equal access for all", i.e. anyone should be able to reap the benefits of the Web without being constrained by any disability.

 描述（由申请人提供）：对于有视力障碍的人来说，使用屏幕阅读器和放大镜等辅助技术浏览网页通常是一种令人沮丧和具有挑战性的体验，因为它需要大量搜索所需的内容、表格和链接。执行在线任务，如购物、账单支付、预订等。该 SBIR 第二阶段项目将建立在第一阶段成果的基础上，并将继续开发和最终部署 Capti 屏幕阅读助手（下一代辅助技术），实现以下目标：指导的借助 Capti Assistant，用户将能够专注于以自然语言（口头或打字）表达的高级浏览目标。通过提供关于每一步采取什么操作的建议并代表用户自动执行所选操作来实现这些目标。建议的操作将包括诸如表单填写、激活控件（例如，单击按钮和链接）之类的操作。 ），等。 Assistant 将大大减少视力障碍人士在网上进行操作的时间。 Assistant 将显着提高他们与网络交互的速度和效率，从而使残疾人在当今的网络经济中更加高效。以自然语言形式表达的用户浏览目标，Capti Assistant 将利用预测模型来引导用户实现该独特目标。 助手的一个方面是，它的建议将自动从用户自己的浏览操作和命令的历史记录以及用户如何完成以前未完成的浏览任务的演示中学习。助手将处理用户命令并进行操作。按需向用户呈现建议的浏览操作，让用户可以选择遵循建议或继续正常浏览而不接受建议。Assistant 提供的功能将远远超出 Siri 等流行的个人助理应用程序。专为视力障碍人士设计，并且不能用于临时网络浏览，Capti Assistant 将在弥合视力障碍者和正常人浏览网络方式之间日益扩大的网络可访问性鸿沟方面大有帮助。对于他们来说，该助手将迎来一个独立的新时代。因此，从更广泛的角度来看，目标导向的浏览将体现普遍可访问的网络的愿景，其主题是“人人平等”，即任何人都应该能够受益。不受任何残疾的限制。