SGER: Toward the Automated Tactilization of Graphical Images

SGER：走向图形图像的自动化触觉化

• 批准号: 0335143
• 负责人: Richard Ladner
• 金额: $ 8.27万
• 依托单位: University of Washington
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-07-01 至 2004-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0335143&HistoricalAwards=false
• 关键词: SGER; Toward; Automated; Tactilization; Graphical

Tactual perception of graphical images is a challenging problem. In this project, the PI and his team propose to develop new image processing and understanding techniques that specifically relate to low-bandwidth tactual perception. The PI and his team will design and build a prototype of an interactive Tactile Image Editor (TIE) that will enable sighted users to translate, as automatically as possible, graphical images into highly comprehensible Braille graphics (raised dots embossed on paper) that can be viewed tactually by blind persons. The focus is on graphical images (drawings, graphs, charts, and diagrams) that appear in textbooks, research papers, and Web pages that are used by scientists, engineers, and mathematicians (students and professionals). Criteria will be developed for what makes a Braille graphic as understandable as possible. That information will be provided to graphical image transcribers to enable them to make good decisions about the transcription of graphical images either manually or with the assistance of the TIE. To achieve his goals, the PI and his team will explore the use of image processing techniques to automate and expedite the conversion of graphical images that are in print or digital format into Braille graphics. They will explore application of low-level image processing techniques such as denoising, edge detection, smoothing, and resolution reduction, to determine heuristics for producing effective Braille graphics. They will validate developed heuristics with an experimental study, in which blind participants will evaluate the readability and comprehensibility of images produced by the derived heuristics. They will explore the application of segmentation techniques to enable them to locate text and other objects that need special attention within an image (for instance, text must be extracted and placed appropriately). They will develop classification and learning algorithms to enable them to determine the type of image being processed, because different kinds of images may require different processing steps. They will develop a software prototype, the Tactile Image Editor (TIE), which will enable them to easily apply the image processing heuristics, segmentation techniques, and classification and learning algorithms in future research. They will conduct an observational study of Braille transcribers, to better understand the processes they use and to inform the future design of the TIE's interface and functionality.Broader Impacts: This research will lead to better and more timely access by blind scientists, engineers, and mathematicians (students and professionals) to graphical images that are becoming more and more prevalent in textbooks, research papers, and on the Web. The research will also lead to a better understanding of what makes Braille graphics most understandable; this information will be useful for graphical image transcribers, whether they use the TIE tool or not. Although the focus of the research is on scientific graphical material, the TIE is potentially useful in other areas that rely on graphical images to covey information. The students, both graduate and undergraduate, who work on the project will benefit from its cross-disciplinary nature.

图形图像的触觉感知是一个具有挑战性的问题。 在这个项目中，PI和他的团队建议开发新的图像处理和理解技术，这些技术与低型宽带的触觉感知特别相关。 PI和他的团队将设计和构建一个交互式触觉图像编辑器（TIE）的原型，该原型将使视力用户能够尽可能自动地翻译成图形图像，将图形图像自动转换为盲人可以触觉的高度理解的盲文图形（在纸上上面汇编的凸起的点）。 重点是出现在教科书，研究论文和网页中的图形图像（图形，图形，图表和图表）上，科学家，工程师和数学家（学生和专业人士）使用。 将制定标准，以使盲文图形尽可能理解。 该信息将提供给图形图像转录器，以使他们能够手动或在领带的帮助下对图形图像的转录做出良好的决定。 为了实现他的目标，PI和他的团队将探索使用图像处理技术来自动化和加快以印刷或数字格式为盲文图形的图形图像的转换。 他们将探索低级图像处理技术的应用，例如去核，边缘检测，平滑和分辨率降低，以确定生成有效的盲文图形的启发式方法。 他们将通过一项实验研究来验证开发的启发式方法，在该研究中，盲人参与者将评估衍生启发式方法产生的图像的可读性和可理解性。 他们将探索分割技术的应用，以使其能够在图像中找到需要特别注意的文本和其他对象（例如，必须提取文本并适当地放置文本）。 他们将开发分类和学习算法，使其能够确定正在处理的图像的类型，因为不同类型的图像可能需要不同的处理步骤。 他们将开发一个软件原型，即触觉图像编辑器（TIE），这将使他们能够轻松地应用图像处理启发式方法，细分技术以及将来的研究中的分类和学习算法。 他们将对盲文转录器进行观察性研究，以更好地了解他们使用的过程，并为领带界面和功能的未来设计提供信息。Broader的影响：这项研究将导致盲人科学家，工程师，工程师和数学家（学生和专业人士（学生和专业人士）在图形图像中变得越来越流行，而在教科书中变得越来越流行。 这项研究还将更好地理解使盲文图形最容易理解的原因。无论是否使用TIE工具，此信息对于图形图像转录器都将很有用。 尽管这项研究的重点是科学图形材料，但在其他依靠图形图像来查看信息的领域中，TIE有可能有用。 从事该项目的研究生和本科生的学生将从其跨学科性质中受益。