CPS: Synergy: Collaborative Research: SensEye: An Architecture for Ubiquitous, Real-Time Visual Context Ssensing and Inference
CPS:协同:协作研究:SensEye:无处不在的实时视觉上下文感知和推理架构
基本信息
- 批准号:1239341
- 负责人:
- 金额:$ 70万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2012
- 资助国家:美国
- 起止时间:2012-10-01 至 2015-09-30
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Continuous real-time tracking of the eye and field-of-view of an individual is profoundly important to understanding how humans perceive and interact with the physical world. This work advances both the technology and engineering of cyber-physical systems by designing an innovative paradigm involving next-generation computational eyeglasses that interact with a user's mobile phone to provide the capability for real-time visual context sensing and inference. This research integrates novel research into low-power embedded systems, image representation, image processing and machine learning, and mobile sensing and inference, to advance the state-of-art in continuous sensing for CPS applications. The activity addresses several fundamental research challenges including: 1) design of novel, highly integrated, computational eyeglasses for tracking eye movements, the visual field of a user, and head movement patterns, all in real-time; 2) a unified compressive signal processing framework that optimizes sensing and estimation, while enabling re-targeting of the device to perform a broad range of tasks depending on the needs of an application; 3) design of a novel real-time visual context sensing system that extracts high-level contexts of interest from compressed data representations; and 4) a layer of intelligence that combines contexts extracted from the computational eyeglass together with contexts obtained from the mobile phone to improve energy-efficiency and sensing accuracy.This technology can revolutionize a range of disciplines including transportation, healthcare, behavioral science and market research. Continuous monitoring of the eye and field-of-view of an individual can enable detection of hazardous behaviors such as drowsiness while driving, mental health issues such as schizophrenia, addictive behavior and substance abuse, neurological disease progression, head injuries, and others. The research provides the foundations for such applications through the design of a prototype platform together with real-time sensor processing algorithms, and making these systems available through open source venues for broader use. Outreach for this project includes demonstrations of the device at science fairs for high-school students, and integration of the platform into undergraduate and graduate courses.
持续实时跟踪个体的眼睛和视野对于理解人类如何感知物理世界以及如何与物理世界交互非常重要。 这项工作通过设计涉及下一代计算眼镜的创新范式,推进了网络物理系统的技术和工程,该眼镜与用户的手机交互,提供实时视觉上下文感知和推理的能力。这项研究将低功耗嵌入式系统、图像表示、图像处理和机器学习以及移动传感和推理的新颖研究整合在一起,以推进 CPS 应用连续传感的最新技术。该活动解决了几个基础研究挑战,包括:1)设计新颖的、高度集成的计算眼镜,用于实时跟踪眼球运动、用户的视野和头部运动模式; 2) 统一的压缩信号处理框架,可优化传感和估计,同时使设备能够根据应用的需求重新定位以执行广泛的任务; 3)设计一种新颖的实时视觉上下文感知系统,从压缩数据表示中提取感兴趣的高级上下文; 4) 智能层,将从计算眼镜中提取的上下文与从手机中获取的上下文相结合,以提高能源效率和传感精度。这项技术可以彻底改变一系列学科,包括交通、医疗保健、行为科学和市场研究。对个人眼睛和视野的持续监测可以检测危险行为,例如驾驶时的瞌睡、精神分裂症等心理健康问题、成瘾行为和药物滥用、神经系统疾病进展、头部受伤等。该研究通过设计原型平台和实时传感器处理算法,为此类应用奠定基础,并使这些系统通过开源场所获得更广泛的使用。该项目的推广包括在高中生科学博览会上演示该设备,以及将该平台集成到本科生和研究生课程中。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Deepak Ganesan其他文献
Will Distributed Computing Revolutionize Peace? The Emergence of Battlefield IoT
分布式计算会彻底改变和平吗?
- DOI:
- 发表时间:
2018 - 期刊:
- 影响因子:0
- 作者:
T. Abdelzaher;Nora Ayanian;T. Başar;S. Diggavi;Jana Diesner;Deepak Ganesan;R. Govindan;Susmit Jha;Tancrède Lepoint;Benjamin M Marlin;K. Nahrstedt;D. Nicol;R. Rajkumar;S. Russell;S. Seshia;Fei Sha;Prashant J. Shenoy;M. Srivastava;G. Sukhatme;A. Swami;P. Tabuada;D. Towsley;N. Vaidya;V. Veeravalli - 通讯作者:
V. Veeravalli
Analysis of effects of Mobility and Active Route Timeout between Sensor Nodes in Wireless Sensor Networks
无线传感器网络中传感器节点间移动性和活动路由超时的影响分析
- DOI:
- 发表时间:
2012 - 期刊:
- 影响因子:0
- 作者:
Meenakshi Tripathi;M. Gaur;V. Laxmi;Deepak Ganesan;Alberto Cerpa;Wei Ye;Yan Yu;Jerry Zhao - 通讯作者:
Jerry Zhao
Phyjama
睡衣
- DOI:
- 发表时间:
2019 - 期刊:
- 影响因子:0
- 作者:
A. Kiaghadi;S. Z. Homayounfar;Jeremy Gummeson;Trisha L. Andrew;Deepak Ganesan - 通讯作者:
Deepak Ganesan
Heteroskedastic Geospatial Tracking with Distributed Camera Networks
使用分布式相机网络的异方差地理空间跟踪
- DOI:
10.48550/arxiv.2306.02407 - 发表时间:
2023 - 期刊:
- 影响因子:0
- 作者:
Colin Samplawski;Shiwei Fang;Ziqi Wang;Deepak Ganesan;Mani Srivastava;Benjamin M. Marlin - 通讯作者:
Benjamin M. Marlin
A remote wireless sensor network/electrocardiographic approach to discriminating cocaine use
鉴别可卡因使用的远程无线传感器网络/心电图方法
- DOI:
- 发表时间:
2015 - 期刊:
- 影响因子:0
- 作者:
G. Angarita;A. Natarajan;Edward Gaiser;Abhinav Parate;Benjamin M Marlin;R. Gueorguieva;Deepak Ganesan;R. Malison - 通讯作者:
R. Malison
Deepak Ganesan的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Deepak Ganesan', 18)}}的其他基金
CSR: Medium: Systems Abstractions for Self-Powered Smart Textiles
CSR:中:自供电智能纺织品的系统抽象
- 批准号:
1763524 - 财政年份:2018
- 资助金额:
$ 70万 - 项目类别:
Continuing Grant
CHS: Small: Robust Eye Tracking and Facial Context Sensing for Mobile Augmented Reality and Virtual Reality
CHS:小型:用于移动增强现实和虚拟现实的强大眼动追踪和面部情境感知
- 批准号:
1815347 - 财政年份:2018
- 资助金额:
$ 70万 - 项目类别:
Continuing Grant
FW-HTF: Collaborative Research: An Embodied Intelligent Cognitive Assistant to Enhance Cognitive Performance of Shift Workers
FW-HTF:协作研究:增强轮班工人认知表现的具体智能认知助手
- 批准号:
1839999 - 财政年份:2018
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
EAGER: Preliminary Studies for Real-Time Tracking of Cognitive Fatigue via Eye Movement Patterns
EAGER:通过眼动模式实时跟踪认知疲劳的初步研究
- 批准号:
1551850 - 财政年份:2015
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
Student Travel Support for the ACM HotWireless 2014 Workshop
ACM HotWireless 2014 研讨会的学生旅行支持
- 批准号:
1454953 - 财政年份:2014
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CSR: Small: Towards Autonomous, Ultra-Low Power RFID-Scale Sensing Systems
CSR:小型:迈向自主、超低功耗 RFID 规模传感系统
- 批准号:
1218586 - 财政年份:2012
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
NeTS: Small: Design of an Efficient Backscatter Communication Stack for Sensor Devices
NeTS:小型:传感器设备的高效反向散射通信堆栈设计
- 批准号:
1217606 - 财政年份:2012
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
NetSE: Large: Collaborative Research: FieldStream: Network Data Services for Exposure Biology Studies in Natural Environments
NetSE:大型:协作研究:FieldStream:自然环境中暴露生物学研究的网络数据服务
- 批准号:
0910900 - 财政年份:2009
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CRI:II-NEW: Design of a Solar-powered River Sensor Network Tested
CRI:II-NEW:经过测试的太阳能河流传感器网络设计
- 批准号:
0855128 - 财政年份:2009
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CSR: Small: System and Network Support for Harvesting-aware Solar Sensor Networks
CSR:小型:对采集感知太阳能传感器网络的系统和网络支持
- 批准号:
0916577 - 财政年份:2009
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
相似国自然基金
诊疗一体化PS-Hc@MB协同训练介导脑小血管病康复的作用及机制研究
- 批准号:82372561
- 批准年份:2023
- 资助金额:49 万元
- 项目类别:面上项目
BLM解旋酶抑制剂纳米马达智能给药系统构建及对前列腺癌的协同治疗作用
- 批准号:82360558
- 批准年份:2023
- 资助金额:32 万元
- 项目类别:地区科学基金项目
微生物-零价铁组合式PRB修复铀污染地下水协同作用机制研究
- 批准号:42302293
- 批准年份:2023
- 资助金额:30 万元
- 项目类别:青年科学基金项目
阳-非离子药剂协同强化铁矿石反浮选过程的界面作用调控机制
- 批准号:52374261
- 批准年份:2023
- 资助金额:50 万元
- 项目类别:面上项目
ALDOC协同糖酵解与PHB2介导的线粒体自噬促进心梗后心肌再生修复的作用机制研究
- 批准号:82370344
- 批准年份:2023
- 资助金额:49 万元
- 项目类别:面上项目
相似海外基金
CPS:Medium:Collaborative Research: High-Fidelity High-Resolution and Secure Monitoring and Control of Future Grids: a synergy of AI, data science, and hardware security
CPS:中:协作研究:未来电网的高保真高分辨率和安全监控:人工智能、数据科学和硬件安全的协同作用
- 批准号:
1932196 - 财政年份:2019
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CPS:Medium:Collaborative Research:High-Fidelity High-Resolution and Secure Monitoring and Control of Future Grids: a synergy of AI, data science, and hardware security
CPS:中:协作研究:未来电网的高保真高分辨率和安全监控:人工智能、数据科学和硬件安全的协同作用
- 批准号:
1932501 - 财政年份:2019
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CPS: Synergy: Collaborative Research: Towards Effective and Efficient Sensing-Motion Co-Design of Swarming Cyber-Physical Systems
CPS:协同:协作研究:实现集群网络物理系统的有效和高效的传感-运动协同设计
- 批准号:
1936599 - 财政年份:2019
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CPS: Synergy: Collaborative Research: DEUS: Distributed, Efficient, Ubiquitous and Secure Data Delivery Using Autonomous Underwater Vehicles
CPS:协同:协作研究:DEUS:使用自主水下航行器进行分布式、高效、无处不在和安全的数据传输
- 批准号:
1853257 - 财政年份:2018
- 资助金额:
$ 70万 - 项目类别:
Standard Grant
CPS: Synergy: Collaborative Research: TickTalk: Timing API for Federated Cyberphysical Systems
CPS:协同:协作研究:TickTalk:联合网络物理系统的计时 API
- 批准号:
1645578 - 财政年份:2018
- 资助金额:
$ 70万 - 项目类别:
Standard Grant