Carnegie Mellon University
The team designed a hyper-reality helmet to provide on-demand information on a heads-up display for first responders to work in indoor and hazardous environments where a GPS signal is not available and visibility is poor.The teams second generation helmet has multimodal interfaces, including sensors, pre-incident planning maps, stereo vision, and voices. Our experiments showed the importance of pre-incident planning and sensory fusion in the real-world problem-solving.This research has impacts on advancing the technology for pre-incident planning, firefighting,emergency medicine, and other first responding and risk management missions. It also affects future research initiatives in emergency medicine, robotic rescue and recovery, and smart city technologies. - July 2019
Principle Investigator: Yang Cai
Carnegie Mellon University
This project focuses on the development of a smart helmet to assist first responders in emergency environments of fire, flood, shooting, cyber attack, and medical distress, where GPS, cellular and regular WiFi signals are not available. The hyper-reality technology is to superimpose the on-demand information to the objects in an actual scene image so that the user can see more in-depth information beyond reality. In contrast to many prevailing augmented reality technologies, our approach focuses on enhancing reality with minimal graphical and textual highlighting without obscuring the user’s view. The hyper-reality helmet contains a holographic screen that can mix the actual visible image with mapping and visualization information. The helmet contains a visible camera, a thermal imaging camera, an Android smartphone processor, voice command, and tactile interface. In order to be deployable to a broader spectrum of first responders, including firefighters, police, medical, and cyber professionals, it needs to be extremely affordable, reconfigurable and robust for different applications.
This project includes the following six tasks:
Benefits and Outcomes
A prototype of the hyper-reality helmet and measurable case studies in realistic environments such as an office building, airport, and paramedic emergency response situations. A system that can be integrated with available LBS technologies to enhance mapping and visualization of data on-demand. This approach can benefit not only individual responders, but also futuristic human-robot first responder forces.