It's like a scouter, drone cooperation AI smart glasses for lifesaving "3rd-EYE" to practical use | Buzzap!

A scouter-class smart glass has been developed that looks a bit like a dragon ball "scouter" and has functions. Details are as below. According to a press release from Rock Garage, the company jointly conducted a demonstration test of the system " 3rd-EYE " that supports lifesaving activities by linking drones, AI and smart glasses with the Ibaraki Southwest Wide Area Fire Department. .. 3rd-EYE is a search activity support system that can automatically analyze drone images with AI to identify the position of the person to be searched, display the location information on smart glasses, and share information efficiently . The search results are shared with the terminals installed at the command headquarters and can be used when giving instructions. The background to the development of this system is that in Japan, where earthquakes and floods occur frequently, the use of drones for search activities, grasping the damage situation, and lifesaving activities is being sought, but at the moment, the information collected by drones is used. It may not be fully communicated. In 3rd-EYE, the pilot will fly the drone, and the search and rescue team will carry out search and rescue activities according to the instructions from the command headquarters that confirmed the images, search results, and the position of the members. The information obtained from the drone will be efficiently aggregated and quickly fed back to lifesaving. Specifically, AI analyzes the video taken by the drone in real time and extracts the human figure. The search crew will go to the rescue while checking the condition on the video. Since it can be displayed in conjunction with the current position and orientation, it is a major feature that members wearing smart glasses can intuitively understand where the rescuer is in the field of view . With such an intuitive display, it is possible to communicate accurately between members and the command headquarters, and it is expected that rescue activities will be expedited. In addition, all information is collected on the tablet terminal installed in the command headquarters. The following features have been implemented to give you an accurate picture of the current state of your search.・ Real-time video display function of drone ・ Drone ・ Map display function of human figure detection result by AI ・ Double check function of detection result by human ・ Current position of member ・ Movement trajectory display function In addition, "pin" is installed on the map to rescue Also equipped with a "pinning function" that allows you to indicate the destination to the smart glasses of the members. You can accurately guide you to your destination. The current position of each member is displayed in real time on the map so that you can always know the behavior of the separate corps, and you can also know the location where you searched once, so you can search efficiently. In this verification test, a demonstration experiment was conducted in which the practical version of 3rd-EYE was incorporated into search activity training by a firefighting organization. By optimizing the specifications and functions through repeated hearings and demonstration experiments with the fire department, we have confirmed that search activities can be carried out efficiently without breaking the chain of command . We are strongly conscious of not only using drones but also incorporating them efficiently, and all the elements necessary for lifesaving activities that compete for the moment of a disaster are incorporated. At first glance, the specifications are reminiscent of the screens and systems of games such as FPS, but their practicality is demonstrated in the professional activities of a firefighting organization. 3rd-EYE can be applied not only to various disasters, but also to mountain accidents, search for wandering elderly people, security, and vermin investigation. With labor shortages becoming a problem, it is likely to be a great help in terms of human life and security.

・ Related articles Almost funnel, 130 military drones can be operated by one person and by voice | Buzzap! KDDI's world's first "water-air combined drone" succeeded in remote underwater photography, making it possible to inspect offshore wind power generation and fishing reefs without ships or divers | Buzzap! Amazon launches home guard drone "Ring Always Home Cam", patrols indoors by autonomous flight and notifies smartphone if there is an intruder | Buzzap!