DK2681722T3 - Method and system for identifying falls and transmitting an alarm - Google Patents
Method and system for identifying falls and transmitting an alarm Download PDFInfo
- Publication number
- DK2681722T3 DK2681722T3 DK12712975.7T DK12712975T DK2681722T3 DK 2681722 T3 DK2681722 T3 DK 2681722T3 DK 12712975 T DK12712975 T DK 12712975T DK 2681722 T3 DK2681722 T3 DK 2681722T3
- Authority
- DK
- Denmark
- Prior art keywords
- alarm
- monitored
- person
- room
- unrecognizable
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
- G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
- G08B21/0476—Cameras to detect unsafe condition, e.g. video cameras
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19678—User interface
- G08B13/19686—Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Alarm Systems (AREA)
Abstract
A method and a device for detecting a particular emergency situation or detecting a fall and issuing an alarm is made available. The method comprises monitoring a space by means of at least one optical sensor, such as a video camera or infrared camera, detecting a fall of a person in the monitored space by evaluating the images recorded with the optical sensor, distorting the image data and triggering an alarm and transmitting the distorted image data to at least one authorized receiver if a fall of a person in the monitored space is detected.
Description
METHOD AND SYSTEM FOR DETECTING A FALL AND ISSUING AN ALARM Technical Field
The claimed invention relates to a method and system for detecting a fall, detecting particular emergency situations and transmitting an alarm in the home environment. The invention relates in particular to a method and system for detecting a fall by means of a passive optical sensor and transmitting a multi-stage alarm in the form of distorted image data.
Prior art
Falls are a particular accident risk especially for elderly people. These persons are often injured such that they are no longer able to stand up without external help or to request help, which could lead to a life-threatening situation. Preventive measures to avoid falls can be taken, however, falls especially of elderly people living alone can never be ruled out entirely so that the detection of a fall with following assistance can increase the quality of life of the affected group of persons in that they may continue to live in their familiar surroundings and still be supervised by medical personnel and/or relatives. US 7 248 172 B2 discloses a method and system for fall detection, where the person to be supervised wears a device for fall detection or triggering an alarm at the body. This alarm can be transmitted in the form of radio transmission to a rescue centre.
However, the above systems may cause acceptance problems among the concerned group of persons since the permanent wearing of the devices is awkward and uncomfortable for these people. Furthermore, especially elderly people are prone to possibly simply forget to put the corresponding devices on again, e.g. after bathing.
Detecting a fall is also possible by means of sensors installed in a floor or mats provided with sensors, but realising such a system is very complex and expensive. A further category of methods for detecting a fall and recognising particular emergency situations are optically based methods. Here the persons are permanently monitored and an optical fall/emergency detection is carried out, comprising a classification by means of common classification algorithms such as Bayes classifiers, neural networks or main component analysis of a recorded incident and triggering an alarm when a fall/an emergency is detected and transmitting same to a superior instance. US 20060145874 A1 relates to an optically-based method, wherein the image treatment algorithms determine in particular the percentage share of a person lying on the floor, the position of the person as well as the size of the person. Moreover, the velocity and acceleration of a person falling is determined. US 20030058341 A1 relates to an optically-based method, wherein an object is separated from a scene, detected and analysed. Here certain properties of the object are analysed by means of comparative values with certain events.
In particular, an event classification via geometric primitives is possible, such as described in “Compressed-Domain Fall Incident Detection for Intelligent Homecare” by Chia-Wen Lin, Zhi-Hong Ling, Yeng-Cheng Chang and Chung J. Kuo submitted to Journal of VLSI Signal Processing-System for Signal, Image and Video Technology. US 20050146605 A1 relates to an optical surveillance method with geometric primitives and subsequent event analysis by means of event discriminators. Here an alarm can be triggered depending on the detected event.
Methods comprising a permanent video surveillance of a person, however, constitute an encroachment on the right of personality of the person and thus can lead to acceptance problems.
Document WO 2007 139658 A2 is probably the closest prior art of the subject-matter of the invention and discloses a method for fall detection comprising distortion of image data in order to protect a person’s privacy.
Disclosure of the invention
Therefore, it is the object of the invention to provide a method and system for detecting a fall, which is reliable and operates safely.
This object is achieved with a method and system according to the independent claims 1 and 9. Dependent claims 2 to 8 relate to particular embodiments. A room is supervised by means of a passive optical sensor, such as a video or infrared camera. Furthermore, an evaluation of the recorded images is conducted with regard to the detection of a fall or a particular emergency situation, wherein, however, the image data are at first transmitted in a distorted manner only to an authorised receiver by triggering an alarm upon detection of a fall. Thus, the supervised person’s right to his/her own image is ensured since images of this person are not permanently transmitted but only distorted images when a fall is detected.
When a fall or a particular emergency situation has been detected, a reverse channel is activated first, which verifies the detected situation. The supervised person is enabled to classify a triggered alarm as false alarm.
Only if after a certain period of time an alarm is not classified as false alarm by the supervised person, decoding of the transmitted optical signal is conducted so that the supervised person is depicted. This visual depiction of the situation and person would also be revealed in the moment when a rescue service arrives.
The distortion of the image data is carried out preferably by means of geometric primitives. For example the objects present in a recorded image are each replaced by one or more geometric primitives. Preferably every person present in the recorded image is treated and depicted as at least one geometric primitive. Preferably the fall detection is evaluated for every person by means of the geometric primitive(s).
When a fall or helplessness of a fallen person is recognised in the undistorted image, the authorised receiver can initiate further rescue measures, such as requesting rescue services or instructing medical personnel to care for the fallen person.
The gist of the invention is a method and system for detecting a particular emergency situation, especially a fall, wherein, during the permanent optical surveillance of a person, only in case of an emergency or fall detection, at first distorted and, where appropriate, encoded image data of this person and/or this room are transmitted to an authorised instance by triggering an alarm. Only after having established a reverse channel and in the absence of an alarm classification as false alarm by the supervised person will an undistorted image of the situation or person be transmitted to an authorised instance.
This method and system are advantageous in that they do not restrict the physical freedom of action of a person to be monitored, they are comfortable for the person and ensure the person’s right to his/her own image as part of the general right of personality and are moreover cost effective and easily workable for medical personnel and/or relatives.
Brief description of the drawings
The method and the corresponding system of the invention are described in more detail in the following by means of embodiments and the drawings.
They show:
Figure 1 a system for detecting a particular emergency situation or a fall detection with a server and a Universal Standard Gateway and an array of optical sensors,
Figure 2 a system for detecting a particular emergency situation or a fall detection with a HealthBox and an Health platform and an array of optical sensors, and Figure 3 a system for detecting a particular emergency situation or a fall detection with a Logic HealthBox and a Health platform, wherein the algorithms for video analysis and fall detection are implemented in an optical sensor.
Detailed description of the embodiments
Figure 1 shows an embodiment of the system. Images of a person to be monitored 118 are permanently recorded by means of a plurality of optical sensors 11 having individual camera sensors 11.1 to ll.n. The camera sensors 11.1 to ll.n can be arranged in a room to be monitored such that the person to be monitored is detected by at least one camera sensor at all times. The optical sensors 11 are connected via an interface 19 to a server 13. The server 13 comprises a logic 12, wherein the algorithms are implemented for splitting the images recorded by means of the sensors 11 into geometric primitives as well as algorithms for detection of a fall or a particular emergency situation. When a fall or an emergency situation is detected, a distorted image is transmitted via means and method for encoding and authentication, which may contain a firewall 15, through a TCP/IP interface 17 and the internet 113 to an authorised group of people 117, where appropriate via a Universal Standard
Gateway 114, wherein the transmission can be effected bidirectionally wireless 115 or by wire 116.
If a particular emergency situation or a fall is detected, an alarm will be triggered, which the monitored person 118 can invalidate (classify as false alarm). To this end a reverse channel is established between the supervised room and the authorised receiver via data or telephone connection. If, after a certain period of time, an alarm is not classified as false alarm, an undistorted transmission of the image or a sequence of images will be transmitted to the authorised group of people. The transmission by wire 116 or wireless transmission 115 is also effected in encoded manner. A further additional possibility for establishing a reverse channel is by means of an acoustic means 14 and a sound card 18 integrated in the system. An acoustic connection between the authorised group of people 117 is established via the internet 113 and the server 13 via the sound card 18 and the acoustic means 14, such as a loudspeaker and a microphone, wherein the connection can be bidirectional. Further sensors 112 or user menus 111 can be connected via the interface 19 to the server 13 which is provided with an additional logic in this implementation as PC.
In the embodiment of Figure 1, the logic 12 comprises the software for conducting the video image analysis, the fall or emergency detection analysis and the encoding as well as data communication.
Figure 2 shows a further embodiment. In this embodiment, the server 13 of Figure 1 is a so-called HealthBox 26, i.e. a device for monitoring the state of health of a person. The image processing as well as the data processing of all health sensors and the data encoding is executed in a Logic HealthBox 25, which is embedded in the HealthBox 26. The authentication and routing of the information is carried out in an external HealthPlatform 27, which may be a system for monitoring a plurality of people. HealthBox 26 and HealthPlatform 27 are connected via the internet 113. The alarm or the distorted and in a further step undistorted images are transmitted in encoded form either wirelessly 115, e.g. to smartphones, or by wire 116, e.g. to a telephone or an external computer, to an authorised group of people 117. The optical sensors 11.1 to ll.n are connected to the HealthBox 26 via an interface 19. The camera sensors only record the images. The server of the first embodiment of Figure 1 with the further means is implemented in this second embodiment in form of the HealthBox 26. The HealthPlatform 27 of this second embodiment furthermore comprises the functionality of the Universal Standard Gateway 114 of the first embodiment. As far as the further elements of this embodiment are concerned, reference is made to Figure 1.
The logic HealthBox 25 in the embodiment of Figure 2 comprises the software for executing the video image analysis, the fall or emergency detection analysis, the data processing of all sensors, in particular health sensors and the encoding as well as data communication.
Figure 3 shows a third embodiment of the system. The optical sensors are made in the form of one master 30 and a plurality of slaves 41, 42. The optical sensor operating as master 30 has a camera part 31, an internal interface 32, a SmartCamera logic 33 and an interface 34. Contrary to the first and second embodiments, in this embodiment the software and the corresponding evaluation unit, implementing the algorithms for video analysis and fall or emergency detection, are integrated in the SmartCamera logic 33 of the optical sensor operating as master. The SmartCamera logic 33 is internally connected via the interface 32 to the camera part 31. The SmartCamera logic 33 is further connected to the other optical sensors 41, 42 of the system operating as slaves via the interface 34 and to the HealthBox 26 via the interface 19. Reference is made to Figure 1 and Figure 2 regarding the remaining elements and functionality of the embodiment.
The SmartCamera logic 33 in the embodiment of Figure 3 comprises the software for executing the video image analysis and fall detection analysis. The logic HealthBox 35 has the remaining functions which are comprised in the logic HealthBox 25 of the embodiment of Figure 2. This includes the software for the data processing of all sensors, in particular health sensors and the encoding and data communication.
In the following, the invention will be explained in further detail on the basis of functions and properties.
The optical sensors are to be preferably positioned in the room such that an optimal covering of the room to be monitored is achieved, also in case of narrow rooms with complex structure. When necessary, more than one optical sensor is to be used for one room area. Preferably, an active energy management is implemented so that only optical sensors are in the activated mode which are currently required.
The optical sensors are configured in such a manner that they are robust against variable light conditions such as reflections and backlight. Moreover, they can be configured in form of infrared sensors in order to be able to detect falls and emergency situations also in the dark.
The fall detection algorithms are implemented such that they can detect any kind of falls, such as slumping down, a heavy fall and a slowed-down fall. These types of falls are clearly defined beforehand and part of a library of activated fall detection algorithms (“patterns”). The detection of emergency situations is primarily effected by algorithms evaluating the static condition of a person relative to the home surroundings and in particular detect an abnormal static condition.
The detection algorithms are implemented such that they are robust against other persons or animals present in the room as well as against the positions of the optical sensors and a covering of the person to be monitored by furniture and/or other persons or animals. Moreover, they are able to not classify quick movements of objects as falls of persons.
The detection algorithms comprise methods for separating a person from the background and vectorizing and splitting the image of a person into geometric primitives and detecting the position in the room either in the server or the optical sensor. In this case, the fall detection makes use of the dynamic of a fall. It is analysed how fast the position of these geometric primitives changes within an image sequence. The image processing can take place centrally in a determined HealthBox and be connected with a cloud to minimize maintenance cost and to simply expand the evaluation patterns.
The system is construed such that within a certain period of time all people of an authorised group of people are informed. This authorised group of people has exclusively access to personal data and status information about the person to be monitored. The system is construed in a way that the authorised group of people can be supplemented with further persons or restricted by certain persons. In case of a validated alarm, the system provides the authorised persons with, i.a. the time of the fall, the location of the fall, a still image and, where applicable, a video.
In order to ensure the privacy, the system reports at various places when image or video material leaves the room to be monitored. The recording of image or video data of the person to be monitored is preferably conducted only for a period of time which is absolutely necessary for the functionality of the fall detection system. The security level of the telecommunication is preferably scalable so that it can be chosen among various security levels of the system, starting from low-end security level to high-end security level.
On the platform the system can contain additionally appropriate features for administration, billing, routing and client administration. In particular, the system is configured such that it is easily maintainable from outside by means for an automatic upgrade of firmware and drivers as well as algorithms.
The system is configured preferably in a scalable manner so that additional optical and non-optical sensors can be added to or removed from the system, which supplement the functional properties and performance of the system.
The overall system is configured such that any impression of supervision is avoided with regard to optics and design and blends unobtrusively into the living ambiance.
The invention has been explained in more detail on the basis of examples and the Figures, wherein this explanation is not intended to restrict the invention. Naturally, skilled persons may perform amendments and modifications without leaving the scope of the following claims.
Claims (9)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161449131P | 2011-03-04 | 2011-03-04 | |
EP11156968 | 2011-03-04 | ||
PCT/EP2012/053443 WO2012119903A1 (en) | 2011-03-04 | 2012-02-29 | Method and system for detecting a fall and issuing an alarm |
Publications (1)
Publication Number | Publication Date |
---|---|
DK2681722T3 true DK2681722T3 (en) | 2018-03-05 |
Family
ID=44455253
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
DK12712975.7T DK2681722T3 (en) | 2011-03-04 | 2012-02-29 | Method and system for identifying falls and transmitting an alarm |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP2681722B1 (en) |
DK (1) | DK2681722T3 (en) |
WO (1) | WO2012119903A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014068480A2 (en) * | 2012-10-29 | 2014-05-08 | Markus Schori | Security system having integrated emergency calling function |
BE1021528B1 (en) | 2013-02-01 | 2015-12-08 | Familyeye Bvba | FALL DETECTION SYSTEM AND METHOD FOR DETECTING A FALL OF A MONITORED PERSON |
CN107749143B (en) * | 2017-10-30 | 2023-09-19 | 安徽工业大学 | WiFi signal-based system and method for detecting falling of personnel in through-wall room |
CN111753587B (en) * | 2019-03-28 | 2023-09-29 | 杭州海康威视数字技术股份有限公司 | Ground falling detection method and device |
CN111104932A (en) * | 2020-02-03 | 2020-05-05 | 北京都是科技有限公司 | Tumble detection system and method and image processor |
CN114067436B (en) * | 2021-11-17 | 2024-03-05 | 山东大学 | Fall detection method and system based on wearable sensor and video monitoring |
FR3136094B1 (en) * | 2022-05-25 | 2024-09-27 | Inetum | Fall detection method by image analysis |
CN117116004A (en) * | 2023-10-25 | 2023-11-24 | 深圳市微克科技有限公司 | Tumble alarm method, system and medium of intelligent wearable device |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE517900C2 (en) * | 1999-12-23 | 2002-07-30 | Wespot Ab | Methods, monitoring system and monitoring unit for monitoring a monitoring site |
US9892606B2 (en) * | 2001-11-15 | 2018-02-13 | Avigilon Fortress Corporation | Video surveillance system employing video primitives |
US20050146605A1 (en) | 2000-10-24 | 2005-07-07 | Lipton Alan J. | Video surveillance system employing video primitives |
US7110569B2 (en) | 2001-09-27 | 2006-09-19 | Koninklijke Philips Electronics N.V. | Video based detection of fall-down and other events |
SE0203483D0 (en) | 2002-11-21 | 2002-11-21 | Wespot Ab | Method and device for fall detection |
US7145462B2 (en) * | 2003-01-10 | 2006-12-05 | Honeywell International Inc. | System and method for automatically generating an alert message with supplemental information |
JP4789511B2 (en) * | 2004-06-04 | 2011-10-12 | キヤノン株式会社 | Status monitoring device and status monitoring system |
US7248172B2 (en) | 2005-03-22 | 2007-07-24 | Freescale Semiconductor, Inc. | System and method for human body fall detection |
US7613324B2 (en) * | 2005-06-24 | 2009-11-03 | ObjectVideo, Inc | Detection of change in posture in video |
DE602007012999D1 (en) * | 2006-01-07 | 2011-04-21 | Arthur Koblasz | USE OF RFID TO PREVENT OR DETECT SCORES, BREAKS, BEDDING, AND MEDICAL FAULTS |
US8334906B2 (en) * | 2006-05-24 | 2012-12-18 | Objectvideo, Inc. | Video imagery-based sensor |
GB0620620D0 (en) * | 2006-10-17 | 2006-11-29 | Imp Innovations Ltd | Pervasive sensing |
GB2444107A (en) * | 2006-11-22 | 2008-05-28 | Karen Gail Lambert | Resident monitoring system with remote communications and video processing. |
US9277878B2 (en) * | 2009-02-26 | 2016-03-08 | Tko Enterprises, Inc. | Image processing sensor systems |
-
2012
- 2012-02-29 DK DK12712975.7T patent/DK2681722T3/en active
- 2012-02-29 EP EP12712975.7A patent/EP2681722B1/en active Active
- 2012-02-29 WO PCT/EP2012/053443 patent/WO2012119903A1/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
EP2681722A1 (en) | 2014-01-08 |
EP2681722B1 (en) | 2017-12-20 |
WO2012119903A1 (en) | 2012-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DK2681722T3 (en) | Method and system for identifying falls and transmitting an alarm | |
US11663870B2 (en) | Scalable systems and methods for monitoring and concierge service | |
KR101990803B1 (en) | PROTECTION SYSTEM FOR VULNERABLE CLASSES USING Internet Of Things AND METHOD THEREFOR | |
Zhang et al. | HONEY: a multimodality fall detection and telecare system | |
EP3563359B1 (en) | A method and a system for providing privacy enabled surveillance in a building | |
CN102339518A (en) | Method and apparatus for activating and deactivating video cameras in a security system | |
JP2016066314A (en) | Security service system and security service method | |
EP3422316A1 (en) | Monitored-person monitoring device, method and system | |
US9959425B2 (en) | Method and system of privacy protection in antagonistic social milieu/dark privacy spots | |
KR20160150323A (en) | Sensor-based Intelligent Emergency Call Client Device | |
JP3460680B2 (en) | Field situation notification system and imaging unit used for the same | |
JP2002175581A (en) | Life watching system | |
JP2015109040A (en) | Emergency call device and emergency call system | |
CN111127824A (en) | Early warning method, device and system | |
JP2009015536A (en) | Suspicious person report device, suspicious person monitoring device and remote monitoring system using the same | |
KR20220097113A (en) | Family safety service using mobile phone | |
CN105321310A (en) | System and method of communicating data from an alarm system to emergency services personnel | |
JP6539799B1 (en) | Safety confirmation system | |
KR101473926B1 (en) | Household Management System and Method | |
JP2020161018A (en) | Security system, management device, mobile terminal and security method | |
EP2153614B1 (en) | System and method for exchanging data between a first data processing system and a second data processing system via an at least partly public communication network | |
JP2008146401A (en) | Full-time crime prevention system | |
JP2020013185A (en) | Watching device and watching device control program | |
JP2010286982A (en) | Security system, and abnormality detection method | |
JP6151891B2 (en) | Crime prevention system |