Intelligent Visual Search and Rescue System
Home - Products - Intelligent Visual Search and Rescue System

Intelligent Visual Search and Rescue System

The intelligent visual search and rescue system includes intelligent multispectral detection equipment, intelligent visualization equipment, intelligent voice interaction equipment, multi-modal autonomous network communication equipment, and individual soldier equipment. The system has functions such as intelligent search and rescue, image transmission, voice intercom, remote positioning, information collection, and assisted decision-making; at the fire rescue scene, it helps firefighters to find ignition points and trapped people in the smoke, frees firefighters' hands, and realizes front and backstage audio and video collaboration, to complete rescue tasks effectively.

1. Overview

The intelligent visual search and rescue system includes intelligent multispectral detection equipment, intelligent visualization equipment, intelligent voice interaction equipment, multi-modal autonomous network communication equipment, and individual soldier equipment. The system has functions such as intelligent search and rescue, image transmission, voice intercom, remote positioning, information collection, and assisted decision-making; at the fire rescue scene, it helps firefighters to find ignition points and trapped people in the smoke, frees firefighters' hands, and realizes front and backstage audio and video collaboration, to complete rescue tasks effectively.

2. Product Hardware

(1) Intelligent multi-spectral detection equipment

● Integrated multi-spectrum detection module with infrared detection, visible light fusion, data processing, and intelligent search. It can transmit the images and data detected, from the fire scene to the internal display and off-site command terminal, by the air call in real time, through the ad hoc network.

● Multispectral detection module (integrated type)

● The integrated multi-spectral detection module has the functions of infrared detection, visible light fusion, data processing and intelligent search. It can transmit the images and data detected at the scene of the fire to the internal display screen of the air call and the off-site command terminal, in real time through the ad hoc network.

● Multispectral detection module (split type)

● The split-type multispectral detection module separates the detection and data processing modules. Only the intelligent detection and search and rescue unit is kept on the head, which greatly reduces the weight of the head. It’s more comfortable for firefighters to wear.

Intelligent multi-spectral detection equipment

Multispectral detection module (integrated type):


Parameter index
Item Index
Item Index
Resolution 384 × 288 Power consumption less than 2.5W
Response band 8 ~ 14μm Temperature measurement range -20 ℃ ~ + 550 ℃
Image frame rate 25Hz / 50Hz Temperature measurement accuracy
± 3 ℃ / ± 3% of range
NETD ≤60mK@f#1.0 Color plate
white hot / black hot / pseudo color
Image correction Shutter correction Working time not less than 3.5 hours
Voltage
DC5.0V Weight less than 320g

Multispectral detection module (split type):


Parameter index
Item Index Item Index
Resolution 384 × 288 Temperature measurement range -20 ℃ ~ + 550 ℃
Response band 8 ~ 14μm Temperature measurement accuracy ± 3 ℃ / ± 3% of range
Image frame rate 25Hz / 50Hz Color plate White hot / Black hot / Pseudo color
NETD ≤60mK@f#1.0 weight <180g

Data processing module:

The data processing module can collect and process the detected infrared data, visible light images, voice information, and data of wearable devices, transmit the images in real time to air call internal and off-site commanders, through the wireless network; it also has a one-button SOS alarm; the product can replace the existing walkie-talkie of firefighters, completely free the hands of firefighters.

Parameter index
Item
Index Item
Index
Communication function WIFI, Bluetooth Image processing Support video hard codec
Network Fire Network Interactive Voice / Button
Storage 64G / 128G Sensor gyroscope / gravity acceleration / geomagnetic
Operating system Android Power consumption less than 3.5W

(2) Intelligent visualization equipment

The visual collaboration system mainly includes air mask display, wristwatch display, flat panel display and accusation center display; this system transmit the information collected by the detector in real time to firefighters, field commanders and command and control centers, through using the communication network, which facilitates command and decision. It help to realize visualized collaborative search and rescue at the fire rescue scene.

Intelligent visualization equipment:

Air ventilator display module:

The air ventilator display module mainly displays individual information and data collected by the intelligent detection system.It helps view the dynamics of the fire environment in real time, implement the rescue timely and efficiently.


Parameter index
Item
Index Item
Index
Resolution 1024 * 768 Angle of view not less than 25 °
WIFI communication 2.4G working time about 2.5 hours
Charging interface TYPE-C Brightness not less than 200cd / cm²
Storage space RAM + ROM: 8 + 16GB Power consumption <2.0W

Watch:

The watch can display infrared detection images, visible light fusion images, inertial navigation positioning data, vital sign data, air call data. It through viewing the internal information of the fire field in real time, to help schedule and make decision in time. Besides, it transmits the processed images to the air call internal and off-site commanders in real time, by intelligent control, a real-time alarm and wireless network.


Parameter index
Item
Index Item
Index
Resolution 320 * 240 Working time about 2.5 hours
Charging interface USB2.0 Brightness Not less than 300cd / cm²
WIFI communication 2.4G Power consumption 2.5W
Storage space RAM + ROM:
8 + 16GB
Weight less than 300g

Portable command terminal:

Portable command terminals is mainly used to monitor and timely dispatch on-site information from field commanders, to check the internal conditions of the fire site in real time, and to deploy manpower and materials in a timely manner according to specific conditions, under the condition of ensuring the safety of life and maximize rescue efficiency.


Parameter index
Item Index Item Index
Screen size 21.5 inches Resolution 1920╳1080
Processor Intel Memory Dual Channel 8GDDR3
Hard disk 128G SSD Network card Intel I219LM Gigabit Ethernet wired network card;Intel Dual Band Wireless 8260 (802.11ac).
Bluetooth Bluetooth 4. Maximum brightness 1040nit (adjustable)
Battery 42AH 16.8V Battery type LG A product 18650 battery pack
Operating system Windows 7 Professional Edition Interface HDMI, VGA, AV, SDI

Command and control center:

● The command and control center can realize the functions of acquisition, scheduling, storage, picture splicing, display and remote control of video and audio signals, by accessing the video information data.

● The large screen display can adopt a variety of display schemes according to different usage methods: LCD screen splicing, LED screen with dot pitch of 1.66mm, or display using a projector. Carousel or overlay processing can be performed, according to the video information input in the front.

● The input control signal processing system of the accusation center can be displayed simultaneously, on a large screen in the form of a window. It can realize single-screen display, arbitrary size display, cross-screen display, full-screen roaming, arbitrary zoom and other functions.

(3) Intelligent voice interactive equipment

The intelligent voice interaction device includes a bone conduction pickup, a speaker, and a data processing module. It can send and receive voice information in a noisy environment in time, and can control individual equipment and background voice interaction through the voice control module, which can replace the original walkie-talkie. The product has low power consumption, high syntax recognition rate and wake-up rate, and has data communication and control output interfaces. In harsh environments such as fires, it can accurately recognize specific voice instructions to improve the efficiency of fire rescue.

Bone conduction talking module:

Bone conduction call module contains bone conduction pickups and speakers. In the noisy fire scene, it can receive the commander's voice and other team members' help in time, which is convenient for team collaboration and management. In harsh environments such as fires, it can accurately recognize specific voice instructions to improve the efficiency of fire rescue.


Parameter index
Item Index Item Index
Resonance frequency 4KHZ ± 20% AT (@ 1.0 V) Sensitivity 82 ± 4dB 0.1W / CRY6151 AT 1000Hz;1.78V 10CM
Rated power 0.2W AT 2.53V Maximum power 0.5W AT 4V
S / N ratio ≥58DB Effective bandwidth 20 ~ 20KHz OUTPUT S.P.L-10dB

Voice processing unit:

The voice processing unit is a highly reliable voice chip independently developed by the company. The module uses integrated circuit technology, digital signal processing technology and embedded neural network processor, has data acquisition, signal processing identification and control output functions. The product has low power consumption, high syntax recognition rate and wake-up rate, and has data communication and control output interfaces.


Parameter index
Item Index Item Index
Recognition rate 1m> 94%; 3m> 90%; 5m> 87% Wake-up rate 1m> 95%; 3m> 93%; 5m> 91%
Interface PDM, TDM Entries ≥1000
Positioning Support sound source positioning Noise reduction Support noise reduction processing

(4) Multi-modal AD hoc network communication equipment

● Multi-modal AD hoc network communication equipment mainly includes: MESH network, public network (4G / 5G), and private network. MESH network is adopted when the public network is paralyzed at the rescue site, and the field information is transmitted in time to facilitate command, to help on decision making.

● The MESH wireless Ad hoc network is powerful. All nodes can realize multi-channel voice, data, image and other multimedia information real-time interaction, under non-line-of-sight and fast-moving conditions. Supports any network topology, using the same frequency networking, multi-hop relay, each node device can move quickly and randomly. The entire network is convenient to deploy, flexible to use, simple to operate, and easy to maintain. It provides users with reliable, timely, efficient, and secure all-IP-based multimedia services such as clear voice, broadband data, high-definition video, and visual command and dispatch.

Multi-modal AD hoc network communication equipment:

MESH Individual Communications Station:

The individual communication station is small in size and light in weight. It is equipped with a detachable lithium battery, which can be held by hand or carried on the shoulder, back or waist of the individual soldier. Fast self-organizing and self-healing, automatic multi-hop relay, can provide multimedia interactive services such as voice group call, video return and so on,for individual soldier handling and tactical teams, to achieve efficient collaboration. As a wireless extension and extension of fixed or vehicle-mounted radios in a multi-hop ad hoc network, it is easy to penetrate into the scene of an emergency, a dense crowd, or a building, and greatly enhance the ability of deep network communication.

Parameter index
Item Index Item Index
Working frequency 520 ~ 650MHz or 1.2 ~ 1.5GHz Carrier bandwidth 2.5 / 5.0 / 10.0MHz, flexible match
Transmission system COFDM Duplex mode TDD mode
Modulation method QPSK / 16QAM / 64QAM / 256QAM (Adaptive) Transmission capacity Standard transmission bandwidth peak speed rate 21Mbps
Network scale support 32 nodes Transmitting power 520 ~ 650MHz: 1W, single transmission and double reception
Receive sensitivity ≤-100dBm Video encoding Built-in H.265 audio and video encoding board
Image quality CIF / HD1 / D1 / 720P / 1080P Encryption method DES56 / AES128 / AES256 (optional)
Device power consumption ≤7.5W Antenna interface N type × 2
Equipment weight (including battery) 430kg Working environment temperature -20 ℃ ~ + 55 ℃

Mesh car station:

MESH vehicle-mounted equipment can be deployed in motor vehicles, ship cabins, or aircraft cabins, with simple installation, flexible use, rapid equipment deployment, good mobility, and convenient mobile networking. Especially in the field environment, emergencies and other scenes, it can be deployed and opened on-site efficiently, realizing remote real-time collaboration between the front-end task site and the rear command center. It is especially suitable for a variety of application scenarios such as on-site front-end command, regional emergency communications, fleet / fleet self-organizing communications, patrol security, line inspection, mobile monitoring, and mobile relay transmission.

Parameter index
Item Index Item Index
Working frequency 320 ~ 450MHz, 450 ~ 650MHz Carrier bandwidth 2.5 / 5.0 / 10.0MHz
Transmission system COFDM duplex mode TDD mode
Modulation method QPSK / 16QAM / 64QAM / 256QAM (adaptive) Transmission capacity Standard transmission bandwidth peak rate 28Mbps
Network scale Support 32 nodes Transmitting power 2W / channel, dual transmission and dual reception
Receiving sensitivity ≤-100dBm video coding built-in H.265 audio and video coding board
Image quality CIF / HD1 / D1 / 720P / 1080P Encryption method DES56 / AES128 / AES256 (optional)
Device power consumption ≤25W Antenna interface N type × 2, SMA
Equipment weight (including battery) 3.15kg Working environment temperature -40 ℃ ~ + 65 ℃

(5) Individual equipment

Individual soldier equipment mainly consists of an air call detection module, a vital sign detection module and an inertial navigation positioning module. The above-mentioned equipment can transmit real-time firefighters' individual equipment information parameters, vital signs parameters, and personnel location information in a complex network-free environment; coordinate and deploy personnel in a timely manner based on on-site images to improve rescue efficiency.

Air ventilator detection module:

Function description:

1> Automatically calculate the remaining working time of the cylinder, and report it to the individual communications equipment;

2> Double display of mechanical and digital pressure to ensure maximum safety;

3> Integrated firefighters call for help function, including static alarm, manual distress alarm, etc .;

4> With automatic alarm function,it automatic alarm when reach the set threshold (cylinder pressure, temperature, battery power, etc.)

5> Provide detailed alarm event log records for analysis and statistics afterwards;

6> Compatible with mainstream air respirator interface, easy installation;

7> Automatic switch on and off according to pressure and movement status, easy to operate.

Vital Signs Monitoring Module:

Function description:

1> Support real-time heart rate measurement function, report heart rate status to individual communication equipment, through real-time communication with handheld terminal;

2> Weight <25g, support BLE4.0 Bluetooth;

3> Use PPG (photoelectric volume pulse wave tracing) heart rate sensor, using touch keys;

4> Maximum support 7 days working time, continuous heart rate test up to 48 hours;

5> Support IP67 waterproof rating.

Individual positioning module:

Function description:

1> Upload the location information to the server in real time through the individual communication equipment;

2> Select the industry-leading MEMS inertial sensor with excellent indicators, and package it into a module;

3> The module supports embedded insoles, which are stable and will not shake, and are not easy to be interfered by the external environment. Compensation algorithms corresponding to the pace and speed of different wearers, with high positioning accuracy and long positioning time;

4> The core size of the module is 80 * 35 * 9.5mm, weight 33g, supports IP67 protection level, easy to carry, and will not fall off;

5> The positioning module has a domestic leading algorithm optimization solution. The extremely small battery capacity can also ensure that the system can work continuously for more than 60 hours and the standby time is six months, thereby reducing the product volume and improving the experience of firefighters.

6> Indoor and outdoor continuous positioning, positioning accuracy: horizontal accuracy <3m, vertical accuracy <0.5m. Motion track closing accuracy: <= ± 3 ‰, module operating temperature range -25 ℃ ~ + 70 ℃;

7> Recognition of motion posture (standing, walking, running, lying down, going up and down stairs), support for 30 seconds of static alarm display on the monitoring host

3. Product Software

Function introduction:

The intelligent visual search and rescue system transmits the equipment information of the individual soldiers to the command center in real time, through the MESH / 4G network for analysis and decision-making, and pushes the results of the analysis and decision to the individual soldier equipment to achieve accurate and rapid rescue, and realizes the linkage between the individual soldiers and the command center .

The main functions are summarized as follows:

➢ Real-time fire scene visualization

➢ Map model construction

➢ Fusion of real-time motion trajectory and map model

➢ Analysis and decision based on big data

➢ Real-time interaction of multimedia data

➢ Effectiveness evaluation

Software platform:

Real-time video transmission:

Use MESH / 4G network to realize real-time viewing of helmet infrared / visible light camera images by individual equipment, field command terminal, and command center.

Rapid and 3D modeling:

Under special circumstances, real-time rapid modeling is convenient for tracking and observing the movement trajectory; at the same time, accurate three-dimensional map models can be quickly constructed based on the floor plan of the building. When there is no floor plan, a virtual three-dimensional map model can be quickly constructed based on the basic information of the floor.

Real-time motion tracking:

The system can realize the rapid fusion of human motion trajectory and map model, and support simultaneous access of multiple channels of information.

Personal information display, including name, device number, group, posture, heart rate, alarm, location and other information.

Analysis and decision:

The system performs analysis and decision-making based on the obtained information, and pushes the results of the analysis and decision-making to the individual soldier equipment. Under the premise of ensuring the safety of the firefighters, the rescue work is completed quickly.

➢ Target analysis: use algorithms to analyze dangerous objects and trapped people, to assist rapid rescue;

➢ Pre-judgment of trends: Pre-judgment of individual status of individual soldiers, to guide their actions after comprehensive platform information;

Real-time data interaction:

The system realizes real-time multimedia data interaction through MESH / 4G, and directly displays infrared / visible light video information, analysis and decision results, etc. to firefighters and command centers;

Prev:No more!!
Next:No more!!
We will provide you with professional services, welcome to consult
Online Service×
We have get many patents already, keep very good cooperation with many military enterprises and scientific research institutions. Good quality and competitive price are always our advantage.