HCC: Small: AccessMath: Improving Mathematics Lectures for Low Vision Students through Integrated Video, Note-Taking and Search

HCC：小型：AccessMath：通过集成视频、笔记和搜索改进低视力学生的数学讲座

• 批准号: 1218801
• 负责人: Stephanie Ludi
• 金额: $ 48.68万
• 依托单位: Rochester Institute of Tech
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-09-01 至 2017-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1218801&HistoricalAwards=false
• 关键词: HCC; Small; AccessMath; Improving; Mathematics

Access to mathematics education is critical to facilitating careers in the sciences, engineering, technology, and in many professions, as well as to providing the mathematical literacy needed in everyday life. The PI's goal in this project is to increase real-time access in the classroom to mathematical material for low vision students (who are visually impaired but not blind), which is currently mostly lacking as these students must primarily rely on assistive technology and human note takers to provide access to course materials after the class meeting. The PI's approach is to bring together expertise in computer science, mathematics, and accessibility to provide a useful and usable solution to this problem for the iPad. Called AccessMath, the prototype application will provide zoom-able camera views as well as a view of notes written at the whiteboard (captured by a Mimio), which may be altered through magnification and contrast adjustment features. The system will support consulting and searching course content during lecture, including textbooks, handouts, notes written at the whiteboard, and audio in video (e.g., to find the word "eigenvalue" in recorded lectures for the course). A novel note-taking facility will be employed, where notes are represented on note "cards" that can be attached to a specific location in the current view (e.g., at a spot in the whiteboard view), then manually moved, resized, rotated, stacked, and "flicked" out of view, providing a natural means for interacting informally with notes created during lecture. Notes are created as blank cards, or as cards containing views of whiteboard data, video excerpts, or existing notes. Notes are also used in constructing search queries. Linear algebra (in particular matrices) is the pilot scope for the project, due to the many challenges in conveying a matrix, individual items within the matrix, following derivations, and the scale of the matrix needed when completing non-trivial problems. AccessMath users will have a single iPad which connects to a server providing video feeds and recognition and retrieval services.Broader Impacts: AccessMath will assist low-vision students with mathematical instruction in and out of class, at the high school and university levels, by providing immediate access to lecture materials, including searches for mathematical content in whiteboard notes, handouts, textbooks, and lecture videos (through word spotting in audio). The system will afford student ownership in note taking and customizing access, which will be significantly better than current solutions, and will reduce or eliminate the extent to which visually impaired students fall behind their sighted peers in the classroom setting. The project will also advance the state-of-the-art in recognition and retrieval for mathematical notation, and will create a novel note-taking model using the metaphor of photos on a tabletop, which should be applicable to domains other than mathematics.

获得数学教育对于促进科学，工程，技术和许多专业的职业以及提供日常生活所需的数学素养至关重要。 PI在该项目中的目标是增加课堂上的实时访问，以供低视力学生（视力障碍但不是盲目）的数学材料，目前主要缺乏，因为这些学生必须主要依靠辅助技术和人类笔记者，以便在课堂会议结束后提供课程材料的访问权限。 PI的方法是将计算机科学，数学和可访问性方面的专业知识汇总在一起，以为iPad提供有用的可用解决方案。 称为AccessMath的原型应用程序将提供可放大的相机视图以及在白板上写的笔记的视图（由Mimio捕获），可以通过放大倍率和对比度调整功能来更改。 该系统将支持讲座期间的咨询和搜索课程内容，包括教科书，讲义，在白板上写的笔记以及视频中的音频（例如，在课程中录制的演讲中找到“ eigenvalue”一词）。 将采用一个新颖的记录设施，其中可以在当前视图（例如，在白板视图中的位置）附加到特定位置的注释“卡”，然后手动移动，调整大小，旋转，堆叠，堆叠，并“忽略”，并提供了与在创建期间创建的注释的自然手段。 注释是作为空白卡或包含白板数据，视频摘录或现有笔记的视图的卡创建的。 注释还用于构建搜索查询。 线性代数（尤其是矩阵）是该项目的试验范围，因为在传达矩阵，矩阵中的单个项目，衍生后的各个项目以及完成非平凡问题时所需的矩阵规模。 AccessMath用户将具有单个iPad，该iPad连接到提供视频提要，识别和检索服务的服务器。Boader的影响：AccessMath将帮助低视觉的学生在课堂上，高中和大学级别的数学指导，通过在Whiteboard Boarde，butior and Butior，todbits，todbits和Sotects，and secteos（以及语言）中（以及语言）进行搜索，并通过搜索数学内容，并通过搜索材料，并通过搜索材料，并通过录音符，并通过potects和sotecte搜索搜索材料。 该系统将为学生拥有并自定义访问提供学生所有权，这将比当前的解决方案要好得多，并将减少或消除视觉障碍学生在课堂环境中落后于视力的同伴的程度。 该项目还将推进识别和检索数学符号的最先进，并将使用桌面上的照片隐喻创建一个新颖的笔记模型，该模型应适用于数学以外的其他领域。