WO2022222847A1 - Device wake-up method and system, electronic device, and storage medium - Google Patents
Device wake-up method and system, electronic device, and storage medium Download PDFInfo
- Publication number
- WO2022222847A1 WO2022222847A1 PCT/CN2022/086914 CN2022086914W WO2022222847A1 WO 2022222847 A1 WO2022222847 A1 WO 2022222847A1 CN 2022086914 W CN2022086914 W CN 2022086914W WO 2022222847 A1 WO2022222847 A1 WO 2022222847A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- state
- wake
- target area
- woken
- detection information
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000003993 interaction Effects 0.000 claims abstract description 57
- 230000004044 response Effects 0.000 claims abstract description 10
- 238000004590 computer program Methods 0.000 claims abstract description 8
- 238000001514 detection method Methods 0.000 claims description 171
- 238000012790 confirmation Methods 0.000 claims description 42
- 238000004891 communication Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 16
- 230000002618 waking effect Effects 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 241000209094 Oryza Species 0.000 description 5
- 235000007164 Oryza sativa Nutrition 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 235000009566 rice Nutrition 0.000 description 5
- 238000010408 sweeping Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000010411 cooking Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002401 inhibitory effect Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Definitions
- the present application relates to the field of information technology, and in particular, to a device wake-up method and system, an electronic device and a storage medium.
- the present application provides a device wake-up method and system, an electronic device and a storage medium to reduce the false wake-up rate.
- a technical solution adopted in the present application is: a device wake-up method, comprising: a decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein the state of the device to be awakened Indicates whether the device to be awakened is allowed to wake up; in response to the wakeup confirmation request sent by the device to be awakened, based on the state of the device to be awakened, it indicates whether the device to be awakened wakes up in voice interaction mode.
- the personnel situation in the target area is determined based on the personnel detection information in the target area sent by the cloud device.
- the method before determining the state of the device to be awakened in the target area based on the personnel situation in the target area, the method further includes: receiving personnel detection information of the target area obtained by the cloud device based on the collected data, wherein the collected data It is collected from the target area by the collection device; based on the personnel detection information, the personnel situation in the target area is obtained.
- the collection device includes at least one of a door switch sensing device, an image collection device, and a target sensing device
- the collected data includes entry and exit data collected by the door switch sensing device, and image data collected by the image collection device. and at least one of sensing data of the target sensing device.
- the person detection information in the target area includes at least one of the following: the person detection information corresponding to the door switch sensing device obtained based on the entry and exit data; the image obtained based on the portrait detection result of the image data The personnel detection information corresponding to the device is collected; based on the sensing data, the personnel detection information corresponding to the target sensing device is obtained.
- determining the state of the device to be woken up in the target area based on the personnel situation in the target area includes: when there are people in the target area, determining the state of the device to be woken up as a wake-up allowed state; in the target area In the case of no one, the state of the device to be woken up is determined as the state of prohibiting wake-up.
- instructing the device to be woken up whether to wake up the voice interaction mode based on the state of the device to be woken up includes: in the case that the state of the device to be woken up is the wake-up allowed state, instructing the device to be woken up to execute the wake-up voice interaction mode; In the case that the state of the device to be woken up is the wake-up prohibited state, the device to be woken up is instructed not to perform the wake-up voice interaction mode.
- the wake-up confirmation request is generated when the device to be woken up collects audio data and detects that the audio data contains preset words; when the state of the device to be woken up is the wake-up allowed state, the device to be woken up indicates that the device is to be woken up.
- the device executes the wake-up voice interaction mode, including: in the case that the state of the device to be woken up is the wake-up allowed state, detecting the audio data contained in the wake-up confirmation request; in the case of detecting that the audio data contains preset words, indicating the to-be-awakened state
- the device implements the wake-up voice interaction mode.
- the decision-making device includes at least one of the following features: the decision-making device is located in the target area, and the processing capability of the decision-making device is stronger than that of the device to be awakened; and/or, the decision-making device and the device to be awakened use short-range wireless communication for communication.
- the communication is either connected on the same local area network; and/or the target area is a home area.
- an electronic device comprising a processor, a memory and a communication circuit, the memory and the communication circuit are coupled to the processor; the memory stores program instructions, and the processor is used for executing Program instructions to implement the device wake-up method in the above solution.
- a computer-readable storage medium storing program instructions that can be run by a processor, and the program instructions are used to implement the device wake-up method in the above solution.
- a device wake-up device comprising a state determination module and a mode indication module
- the state determination module is configured for decision-making equipment to determine the target based on the personnel situation in the target area.
- the state of the device to be woken up in the area, where the state of the device to be woken up indicates whether the device to be woken up is allowed to wake up
- the mode indication module is configured to respond to a wake-up confirmation request sent by the device to be woken up, based on the state of the device to be woken up, indicating Whether to wake up the device to wake up the voice interaction mode.
- FIG. 1 is a schematic diagram of a framework of an embodiment of a device wake-up system of the present application
- FIG. 2 is a schematic flowchart of an embodiment of a device wake-up method of the present application
- FIG. 3 is a schematic diagram of a framework of an embodiment of an electronic device of the present application.
- FIG. 1 is a schematic diagram of a framework of an embodiment of a device wake-up system of the present application.
- the device wake-up system includes a decision-making device and a device to be woken up, and the decision-making device and the device to be woken up are connected to each other to ensure interactive communication between the two.
- the decision-making device may be an electronic device that can implement any of the device wake-up method embodiments in this application, and its specific circuit framework can refer to the relevant descriptions of the electronic device embodiments in this application, which will not be repeated here.
- the device to be awakened may be located in the target area, and if the voice interaction mode is awakened, the device to be awakened can execute the voice command received in the target area.
- the processing capability of the decision-making device may be stronger than that of the device to be woken up.
- the number of cores, the number of threads and the frequency of the CPU (Central Processing Unit, central processing unit) of the decision-making device may be greater than that of the device to be awakened.
- Decision-making devices may include, but are not limited to: televisions, NAS (Network Attached Storage, network attached storage), set-top boxes, etc., which are not limited here.
- the decision-making device and the device to be woken up can communicate through short-range wireless communication, or the decision-making device and the device to be woken up can also be connected in the same local area network through short-range wireless communication.
- the short-range wireless communication manner may specifically include, but is not limited to, Bluetooth, ZigBee (ie, ZigBee protocol), etc., which are not limited herein.
- the device wake-up system may include only one decision-making device.
- the devices to be woken up are densely distributed. In this case, only one decision-making device can be deployed with all the devices.
- the device to be woken up achieves a reliable connection; alternatively, please continue to refer to Figure 1.
- the device wake-up system can also include multiple (eg, 2, 3, etc.) decision-making devices, and each decision-making device can be connected to a At least one (eg, 1, 2, 3, etc.) devices to wake up.
- the device to be woken up connected to the decision-making device can be specifically set according to the relative position between the decision-making device and the device to be woken up.
- the connected devices to be woken up may include: study room For the smart sockets in the living room and the smart lamps in the study room, for the decision-making device "TV” in the living room, the connected devices to be woken up can include: sweeping robots in the living room, smart sockets in the living room, and smart devices in the living room. Lamps and other decision-making devices can be deduced in the same way, and no examples will be given here; alternatively, the device to be woken up linked to the decision-making device can also be directly configured by the user, for example, the user can directly configure the decision-making device in the bedroom. "Connect with the smart socket in the bedroom, the air conditioner in the bedroom, and the smart lighting in the bedroom. In practical application, one of the above two methods can be selected, which is not limited here.
- the collection devices may include but are not limited to door switch sensing devices, image collection devices, target sensing devices, etc.
- the collected data may include but not limited to door switch sensing devices
- the target area can be determined based on one of them, or a combination of two or more of them. personnel inside. For details, reference may be made to the related descriptions in the following disclosed embodiments, which are not repeated here.
- the collection device and the device to be woken up are not opposite individuals, and the device to be woken up may also include the collection device.
- the device to be woken up may include: rice cookers, sweeping robots, smart sockets, cameras, and the aforementioned smart sockets
- the camera can execute voice commands such as "delete local video”, “save local video to the cloud”, etc., so that when the voice command "delete local video” is executed, the local camera can be deleted.
- voice command "Save local video to the cloud” the video stored locally by the camera is saved to the cloud.
- the camera can also be used as a collection device to collect image data, so that according to the image Data, determine the personnel situation, and the specific determination method can refer to the relevant descriptions in the following disclosed embodiments, which will not be repeated here for the time being.
- the devices to be woken up may not include collection devices.
- the devices to be woken up may include rice cookers, sweeping robots, and smart sockets, and the collection devices may include door locks and infrared sensing devices, which are not limited here.
- the decision-making device can directly determine the personnel situation in the target area based on the collection data obtained by the collection device, which can help shorten the communication link in the process of deciding whether to wake up as much as possible. Wake-up delay.
- the cloud device is connected to the collection device to obtain the collection data of the target area, and based on the collected data, the personnel detection information of the target area is determined; Send it to the decision-making device, so that the decision-making device can determine the situation of the personnel based on the personnel detection information, thereby determining the state of the device to be awakened.
- the cloud device often has stronger processing capabilities, enabling it to run more complex and accurate mathematics. Model to process the collected data to improve the accuracy of the personnel situation, so that through the cooperation of cloud equipment, decision equipment, and collection equipment, it can help to improve the accuracy of the determined state of the device to be woken up, and reduce the decision-making equipment. processing load.
- FIG. 2 is a schematic flowchart of an embodiment of a device wake-up method of the present application. Specifically, the following steps can be included:
- Step S21 The decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area.
- the state of the device to be woken up is used to indicate whether the device to be woken up is allowed to wake up or not allowed to wake up.
- the relevant descriptions in the aforementioned disclosed embodiments which will not be repeated here.
- the personnel situation in the target area may be specifically determined based on the data collected by the collection device for the target area.
- the collected data may include entry and exit data collected by the door switch sensing device; and if the collection device includes an image capture device, the collected data may include image data captured by the image capture device;
- the collection device includes a target sensing device, the collected data may include sensing data sensed by the target sensing device, which is not limited herein.
- the cloud device in order to reduce the processing load of the decision-making device and improve the accuracy of the personnel situation, can also obtain the personnel detection in the target area based on the collection data obtained by the collection device. information, so that the decision-making device can receive the personnel detection information obtained by the cloud device from the collected data, and based on the personnel detection information, determine the personnel situation in the target area, so as to cooperate with the cloud device, the decision-making device and the collection device. Determines whether the device to be woken wakes up in voice interaction mode.
- the personnel detection information may include but is not limited to: entry and exit information, etc., which are not limited here. Further, whether the person detection information is obtained by the cloud device or the person detection information is directly obtained by the decision device, the personnel detection information can be determined according to different collection data of the target area by different collection devices.
- the person detection information corresponding to the door switch sensing device can be obtained based on the entry and exit data collected by the door switch sensing device, in order to facilitate the detection of people corresponding to other collection devices.
- the information is distinguished, and the person detection information corresponding to the door switch sensing device can be called the first person detection information.
- the cloud device when the cloud device receives the door entry data collected by the door switch sensing device, it can generate a status of someone coming back, and the cloud device receives the data collected by the door switch sensing device.
- a person leaving state When going out data, a person leaving state can be generated.
- the aforementioned first person detection information may specifically include: someone returning state and someone leaving state, and specifically may include the generation number H of someone returning state and the generation number I of someone leaving state .
- a portrait detection result can be obtained, and the portrait detection result may include that there is no portrait in the image data.
- the second person detection information includes the image data and there is no portrait, so that the person can be directly determined. The situation is that there is no one in the target area.
- the portrait detection result may include the presence of a portrait, and the presence of a portrait entering the door, and after statistics, the number of times that there is a portrait entering the door is H, and the number of times that there is a portrait going out is 1, then If H is greater than I, it can be considered that the personnel situation includes that the target area is occupied, otherwise it can be considered that the personnel situation includes that the target area is unoccupied.
- the personnel detection information corresponding to the target sensing device can be obtained based on the sensing data sensed by the target sensing device, in order to facilitate the distinction from the personnel detection information corresponding to other collection devices.
- the person detection information corresponding to the target sensing device may be referred to as the third person detection information.
- target sensing devices can be deployed inside the door and outside the door, and each time the sensing data sensed by the target sensing device outside the door is received first, and then the sensing data sensed by the target sensing device inside the door, can be The state of someone returning is generated, and each time the sensing data sensed by the target sensing device inside the door is received first, and then the sensing data sensed by the target sensing device outside the door, the state that someone has left can be generated.
- the above-mentioned third The person detection information may specifically include: the generation times H of the state where someone came back and the generation number I of the state where someone left.
- the third person detection information may specifically include: the generation times H of the state where someone came back and the number I generated when the person left the state.
- the generation times of the state where someone came back can be compared.
- H and the generation number I of the person leaving the state and based on the comparison result, determine the person situation, that is, whether there is a person in the target area.
- the generation times H of the person returning state is greater than the generation number I of the person leaving state, it can be determined that the target area is occupied, otherwise it can be determined that the target area is unoccupied.
- the second person detection information may include whether there is a person in the target area
- the first person detection information may include: someone comes back The generation times H of the state and the generation times I of people leaving the state, by comparing the generation times H and the generation times I, an initial personnel situation A (that is, whether there is a person in the target area) can be determined to be obtained. Further, the above-mentioned personnel situation A can be verified by using the second personnel detection information to obtain the final personnel situation B. For example, the user uses the fingerprint to open the door to enter the target area, so the number of generation H is 1.
- the door lock does not detect that the door lock does not use the fingerprint.
- the action of opening the door directly that is, the action of unlocking the house is not detected
- the generation number I is still 0. Since the generation number H is greater than the generation number I, it is determined that there is a person in the target area, which is inconsistent with the actual situation. That is to say, in actual application, there may be errors in the personnel situation determined by the collected data of the door lock, so the second detection information can be used to correct the personnel situation in the above-mentioned target area to obtain the final personnel situation (that is, the target area). area unoccupied).
- the user uses the fingerprint to open the door to enter the target area, so the number of generation H is 1 time, and the door is closed at this time.
- the number of generation I is 1.
- the user receives a notification of the cancellation of the party, and the user returns to the target area and closes the door. Since the number of generation H is equal to the number of generation I, it is determined that there is no one in the target area, which is inconsistent with the actual situation. That is to say, in actual application, there may be errors in the personnel situation determined by the collected data of the door lock, so the second detection information can be used to correct the unmanned personnel situation in the above target area to obtain the final personnel situation (ie target area is occupied).
- the personnel situation may include two situations: the target area is occupied and the target area is unmanned.
- the personnel situation may further include: the target area is occupied and in an active state, and the target area is occupied and in sleep.
- the shooting range of the image acquisition device can cover the entire target area, in this case, based on the portrait detection result of the image data collected by the image acquisition device, the aforementioned second can be obtained.
- the person detection result, and the second person detection information may include whether there is a person and whether the person is in an active state or a sleep state. On this basis, the second person detection information can be used to determine the situation of the person.
- a wake-up confirmation request can be generated when the device to be woken collects audio data "disconnected”, or collects audio data "starts sweeping", or collects audio data "starts cooking”.
- the device to be woken up will not be switched to "awakened device", that is, the device to be woken up still cannot respond to the user's voice command.
- the device to be woken up may be instructed to execute the wake-up voice interaction mode; on the contrary, in the case that the state of the device to be woken up is determined to be the above-mentioned wake-up prohibited state, The device to be woken up can be instructed not to execute the above-mentioned wake-up voice interaction mode.
- the device to be woken up may generate a wake-up confirmation request. Further, the device to be woken up can package the audio data into the wake-up confirmation request. If the device to be woken up is in a state of prohibiting wake-up, the decision-making device can instruct the device to be woken up not to perform the above-mentioned wake-up voice interaction mode, and if the device to be woken up is allowed to wake up.
- the decision-making device can further detect the above-mentioned wake-up audio data, and if the preset words are also detected, the decision-making device can instruct the device to be woken up to execute the above-mentioned wake-up voice interaction mode.
- the device to be woken up collects audio data and also detects that the audio data contains preset words, it generates a wake-up confirmation request and the wake-up confirmation request contains audio data, and the decision-making device further verifies the audio data in the wake-up confirmation request.
- the person detection information corresponding to the door switch sensing device includes: someone coming back state and someone leaving state, the someone coming back state is generated by the cloud device receiving the door entry data collected by the door switch sensing device, and the someone leaving state It is generated by the cloud device receiving the exit data collected by the door switch sensing device.
- the processor 31 is used to compare the generation times of the person returning state and the person leaving state when the collection device includes the door switch sensing device, based on the comparison result. Determine if the target area is occupied. Different from the previous embodiment, the cloud device generates the status of someone coming back when it receives the entry data, and generates the status that someone leaves when it receives the data going out. Determining whether there is a person in the target area based on the comparison result can help to improve the accuracy of determining whether there is a person in the target area.
- the above solution can reduce the false wake-up rate.
- the present application also provides a device wake-up device, comprising a state determination module and a mode indication module, the state determination module is configured for the decision-making device to determine the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein , the state of the device to be awakened indicates whether the device to be awakened is allowed to wake up; the mode indicating module is configured to indicate whether the device to be awakened wakes up in the voice interaction mode based on the state of the device to be awakened in response to a wakeup confirmation request sent by the device to be awakened.
- the personnel situation in the target area is determined based on the personnel detection information in the target area sent by the cloud device.
- the collecting device includes at least one of a door switch sensing device, an image collecting device, and a target sensing device
- the collected data includes access and door data collected by the door switch sensing device, and image data collected by the image collecting device and at least one of sensing data of the target sensing device.
- the person detection information of the target area includes at least one of the following: the person detection information corresponding to the door switch sensing device obtained based on the entry and exit data; the image acquisition result obtained based on the portrait detection result of the image data Person detection information corresponding to the device; based on the sensing data, the personnel detection information corresponding to the target sensing device is obtained.
- the person detection information corresponding to the door switch sensing device includes: someone coming back state and someone leaving state, the someone coming back state is generated by the cloud device receiving the door entry data collected by the door switch sensing device, and the someone leaving state It is generated by the cloud device receiving the exit data collected by the door switch sensing device; the personnel analysis module is specifically configured to use the generation times of the state of someone returning and the state of leaving when the collection device includes the door switch sensing device. Determines whether the target area is occupied based on the comparison result.
- the state determination module includes a first determination sub-module configured to determine the state of the device to be woken up as a wake-up allowed state when there are people in the target area; the state determination module includes a second determination sub-module , which is configured to determine the state of the device to be woken up as a wakeup-inhibiting state when there is no one in the target area.
- the mode indicating module includes a first indicating sub-module configured to instruct the device to be woken up to execute a wake-up voice interaction mode when the state of the device to be woken up is a state allowing wake-up; the mode indicating module includes a first The second instructing submodule is configured to instruct the device to be woken up not to perform the wake-up voice interaction mode when the state of the device to be woken up is the wake-up prohibited state.
- the wake-up confirmation request is generated when the device to be woken up collects audio data and detects that the audio data contains preset words;
- the first indication sub-module includes an audio detection unit configured to be woken up when the device is to wake up.
- the audio data contained in the wake-up confirmation request is detected;
- the first indication sub-module includes a wake-up indication unit, which is configured to indicate that the audio data contains a preset word when it is detected. The device to be woken up executes the wake-up voice interaction mode.
- the decision-making device includes at least one of the following features: the decision-making device is located in the target area, and the processing capability of the decision-making device is stronger than that of the device to be awakened; and/or, the decision-making device and the device to be awakened use short-range wireless communication for communication The communication is either connected on the same local area network; and/or the target area is a home area.
- the present application also provides a computer program product, which, when running on a terminal device, enables the terminal device to execute the steps in any of the foregoing device wake-up method embodiments.
- the specific implementation form of the computer program product is not limited.
- the computer program product can be implemented as a smart refrigerator application program, and can be installed in the smart refrigerator through factory pre-installation or user customization, so that the smart refrigerator can be used as a decision-making device and a home area such as smart door locks, cameras, etc.
- the smart devices are linked to perform the steps in any of the above-mentioned device wake-up method embodiments. Other situations can be deduced by analogy, and no examples are given here.
- the disclosed method and apparatus may be implemented in other manners.
- the device implementations described above are only illustrative.
- the division of modules or units is only a logical function division. In actual implementation, there may be other divisions.
- multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented.
- the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
- the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
- the integrated unit if implemented as a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium.
- the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the methods of the various embodiments of the present application.
- the aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electric Clocks (AREA)
- Lock And Its Accessories (AREA)
Abstract
A device wake-up method, comprising: a decision device determining, on the basis of personnel conditions in a target area, a state of a device to be woken up in the target area, wherein the state of the device to be woken up represents whether the device to be woken up is allowed to be woken up (S21); and in response to a wake-up acknowledgement request sent by the device to be woken up, instructing, on the basis of the state of the device to be woken up, the device to be woken up to wake up or not wake up a voice interaction mode (S22). The method can reduce a false wake-up rate. Also provided are a device wake-up apparatus and system, an electronic device, a storage medium, and a computer program product.
Description
本申请要求于2021年04月23日提交的申请号为2021104412640,发明名称为“设备唤醒方法及系统、电子设备和存储介质”的中国专利申请的优先权,其通过引用方式全部并入本申请。This application claims the priority of the Chinese patent application with the application number 2021104412640 filed on April 23, 2021 and the invention title is "Device Wake-up Method and System, Electronic Device and Storage Medium", which is fully incorporated into this application by reference .
本申请涉及一种信息技术领域,具体涉及一种设备唤醒方法及系统、电子设备和存储介质。The present application relates to the field of information technology, and in particular, to a device wake-up method and system, an electronic device and a storage medium.
随着物联网(Internet of Things,IoT)技术的发展以及WiFi6、蓝牙mesh等技术的普及,诸如插座、照明灯、电饭煲等越来越多的终端设备通过网络实现互联。随着终端设备的不断增多,通过诸如手机APP(即应用程序)、面板等传统控制方式,已逐渐无力应付越来越复杂的设备交互。在此情形下,语音交互越来越受到人们的追捧。然而,在实际应用过程中,语音交互有可能产生误唤醒,如在没有人监管的情况下,烤箱被误唤醒,由此可能会产生重大安全隐患。有鉴于此,如何降低误唤醒率成为亟待解决的问题。With the development of Internet of Things (IoT) technology and the popularization of WiFi6, Bluetooth mesh and other technologies, more and more terminal devices such as sockets, lamps, rice cookers, etc. are interconnected through the network. With the increasing number of terminal devices, traditional control methods such as mobile phone APPs (that is, application programs), panels, etc., are gradually unable to cope with increasingly complex device interactions. In this situation, voice interaction is more and more sought after by people. However, in the actual application process, voice interaction may cause false wake-up. For example, the oven is falsely woken up without human supervision, which may cause major safety hazards. In view of this, how to reduce the false wake-up rate has become an urgent problem to be solved.
【发明内容】[Content of the invention]
本申请提供一种设备唤醒方法及系统、电子设备和存储介质,以降低误唤醒率。The present application provides a device wake-up method and system, an electronic device and a storage medium to reduce the false wake-up rate.
为解决上述技术问题,本申请采用的一个技术方案是:一种设备唤醒方法,包括:决策设备基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态,其中,待唤醒设备的状态表示待唤醒设备是否允许唤醒;响应于待唤醒设备发送的唤醒确认请求,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互模式。In order to solve the above technical problem, a technical solution adopted in the present application is: a device wake-up method, comprising: a decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein the state of the device to be awakened Indicates whether the device to be awakened is allowed to wake up; in response to the wakeup confirmation request sent by the device to be awakened, based on the state of the device to be awakened, it indicates whether the device to be awakened wakes up in voice interaction mode.
根据本申请一实施方式,目标区域的人员情况是基于云端设备发送的目标区域的人员检测信息确定的。According to an embodiment of the present application, the personnel situation in the target area is determined based on the personnel detection information in the target area sent by the cloud device.
根据本申请一实施方式,在基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态之前,方法还包括:接收云端设备基于采集数据得到的目标区域的人员检测信息,其中,采集数据为采集设备对目标区域采集得到的;基于人员检测信息,得到目标区域的人员情况。According to an embodiment of the present application, before determining the state of the device to be awakened in the target area based on the personnel situation in the target area, the method further includes: receiving personnel detection information of the target area obtained by the cloud device based on the collected data, wherein the collected data It is collected from the target area by the collection device; based on the personnel detection information, the personnel situation in the target area is obtained.
根据本申请一实施方式,采集设备包括门开关感应设备、图像采集设备和目标感应设备中的至少一种,采集数据包括门开关感应设备采集到的进出门数据、图像采集设备采集到的图像数据、目标感应设备的感应数据中的至少一者。According to an embodiment of the present application, the collection device includes at least one of a door switch sensing device, an image collection device, and a target sensing device, and the collected data includes entry and exit data collected by the door switch sensing device, and image data collected by the image collection device. and at least one of sensing data of the target sensing device.
根据本申请一实施方式,目标区域的人员检测信息,包括以下至少一者:基于进出门数据,而得到的门开关感应设备对应的人员检测信息;基于图像数据的人像检测结果,而得到的图像采集设备对应的人员检测信息;基于感应数据,而得到的目标感应设备对应的人员检测信息。According to an embodiment of the present application, the person detection information in the target area includes at least one of the following: the person detection information corresponding to the door switch sensing device obtained based on the entry and exit data; the image obtained based on the portrait detection result of the image data The personnel detection information corresponding to the device is collected; based on the sensing data, the personnel detection information corresponding to the target sensing device is obtained.
根据本申请一实施方式,门开关感应设备对应的人员检测信息,包括:有人回来状态和有人离开状态,有人回来状态是云端设备接收到门开关感应设备采集到的进门数据而生成的,有人离开状态是云端设备接收到门开关感应设备采集到的出门数据而生成的,基于人员检测信息,得到目标区域的人员情况,包括:在采集设备包括门开关感应设备的情况下,比较有人回来状态和有人离开状态的生成次数,基于比较结果确定目标区域是否有人。According to an embodiment of the present application, the person detection information corresponding to the door switch sensing device includes: someone coming back state and someone leaving state. The status is generated by the cloud device receiving the exit data collected by the door switch sensor device. Based on the personnel detection information, the personnel situation in the target area can be obtained, including: when the collection device includes the door switch sensor device, compare the status of someone coming back and The number of times the person left state is generated, based on the comparison result to determine whether there is a person in the target area.
根据本申请一实施方式,基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态,包括:在目标区域有人的情况下,将待唤醒设备的状态确定为允许唤醒状态;在目标区域无人的情况下,将待唤醒设备的状态确定为禁止唤醒状态。According to an embodiment of the present application, determining the state of the device to be woken up in the target area based on the personnel situation in the target area includes: when there are people in the target area, determining the state of the device to be woken up as a wake-up allowed state; in the target area In the case of no one, the state of the device to be woken up is determined as the state of prohibiting wake-up.
根据本申请一实施方式,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互 模式,包括:在待唤醒设备的状态为允许唤醒状态的情况下,指示待唤醒设备执行唤醒语音交互模式;在待唤醒设备的状态为禁止唤醒状态的情况下,指示待唤醒设备不执行唤醒语音交互模式。According to an embodiment of the present application, instructing the device to be woken up whether to wake up the voice interaction mode based on the state of the device to be woken up includes: in the case that the state of the device to be woken up is the wake-up allowed state, instructing the device to be woken up to execute the wake-up voice interaction mode; In the case that the state of the device to be woken up is the wake-up prohibited state, the device to be woken up is instructed not to perform the wake-up voice interaction mode.
根据本申请一实施方式,唤醒确认请求是待唤醒设备采集到音频数据并检测到音频数据包含预设词语的情况下生成的;在待唤醒设备的状态为允许唤醒状态的情况下,指示待唤醒设备执行唤醒语音交互模式,包括:在待唤醒设备的状态为允许唤醒状态的情况下,对唤醒确认请求包含的音频数据进行检测;在检测到音频数据包含预设词语的情况下,指示待唤醒设备执行唤醒语音交互模式。According to an embodiment of the present application, the wake-up confirmation request is generated when the device to be woken up collects audio data and detects that the audio data contains preset words; when the state of the device to be woken up is the wake-up allowed state, the device to be woken up indicates that the device is to be woken up. The device executes the wake-up voice interaction mode, including: in the case that the state of the device to be woken up is the wake-up allowed state, detecting the audio data contained in the wake-up confirmation request; in the case of detecting that the audio data contains preset words, indicating the to-be-awakened state The device implements the wake-up voice interaction mode.
根据本申请一实施方式,决策设备包括以下至少一种特征:决策设备位于目标区域中,决策设备的处理能力强于待唤醒设备;和/或,决策设备与待唤醒设备采用短程无线通信方式进行通信或者连接在同一局域网;和/或,目标区域为家庭区域。According to an embodiment of the present application, the decision-making device includes at least one of the following features: the decision-making device is located in the target area, and the processing capability of the decision-making device is stronger than that of the device to be awakened; and/or, the decision-making device and the device to be awakened use short-range wireless communication for communication. The communication is either connected on the same local area network; and/or the target area is a home area.
为解决上述技术问题,本申请采用的另一个技术方案是:一种电子设备,包括处理器、存储器和通信电路,存储器和通信电路耦接至处理器;存储器存储有程序指令,处理器用于执行程序指令以实现上述方案中的设备唤醒方法。In order to solve the above technical problem, another technical solution adopted in this application is: an electronic device, comprising a processor, a memory and a communication circuit, the memory and the communication circuit are coupled to the processor; the memory stores program instructions, and the processor is used for executing Program instructions to implement the device wake-up method in the above solution.
为解决上述技术问题,本申请采用的又一个技术方案是:一种计算机可读存储介质,存储有能够被处理器运行的程序指令,程序指令用于实现上述方案中的设备唤醒方法。To solve the above technical problem, another technical solution adopted in the present application is: a computer-readable storage medium storing program instructions that can be run by a processor, and the program instructions are used to implement the device wake-up method in the above solution.
为解决上述技术问题,本申请采用的又一个技术方案是:一种设备唤醒系统,包括相互连接的决策设备和待唤醒设备,其中,决策设备为上述方案中的电子设备,待唤醒设备位于目标区域中,且能够在唤醒语音交互模式的情况下,执行在目标区域接收到语音指令。In order to solve the above technical problem, another technical solution adopted in the present application is: a device wake-up system, including a decision-making device and a device to be woken up connected to each other, wherein the decision-making device is the electronic device in the above scheme, and the device to be woken up is located at the target. In the area, and can be executed in the case of waking up the voice interaction mode, the voice command is received in the target area.
根据本申请一实施方式,设备唤醒系统还包括连接决策设备的云端设备,云端设备用于向决策设备发送目标区域的人员检测信息,人员检测信息用于确认人员情况。According to an embodiment of the present application, the device wake-up system further includes a cloud device connected to the decision-making device, and the cloud device is used to send the personnel detection information of the target area to the decision-making device, and the personnel detection information is used to confirm the personnel situation.
根据本申请一实施方式,设备唤醒系统还包括位于目标区域的采集设备,采集设备与云端设备连接,用于获得目标区域的采集数据,并将采集数据发送给云端设备,云端设备用于基于采集数据确定目标区域的人员检测信息。According to an embodiment of the present application, the device wake-up system further includes a collection device located in the target area, and the collection device is connected to the cloud device to obtain the collection data of the target area and send the collected data to the cloud device, and the cloud device is used for collecting data based on the collection The data determines the person detection information in the target area.
为解决上述技术问题,本申请采用的又一技术方案是:一种设备唤醒装置,包括状态确定模块和模式指示模块,状态确定模块被配置用于供决策设备基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态,其中,待唤醒设备的状态表示待唤醒设备是否允许唤醒;模式指示模块被配置用于响应于待唤醒设备发送的唤醒确认请求,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互模式。In order to solve the above-mentioned technical problems, another technical solution adopted in the present application is: a device wake-up device, comprising a state determination module and a mode indication module, and the state determination module is configured for decision-making equipment to determine the target based on the personnel situation in the target area. The state of the device to be woken up in the area, where the state of the device to be woken up indicates whether the device to be woken up is allowed to wake up; the mode indication module is configured to respond to a wake-up confirmation request sent by the device to be woken up, based on the state of the device to be woken up, indicating Whether to wake up the device to wake up the voice interaction mode.
为解决上述技术问题,本申请采用的又一技术方案是:一种计算机程序产品,该计算机程序产品在终端设备上运行时,使得终端设备执行上述方案中的设备唤醒方法。In order to solve the above technical problem, another technical solution adopted in this application is: a computer program product, when the computer program product runs on a terminal device, the terminal device can execute the device wake-up method in the above solution.
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。其中:In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort. in:
图1是本申请设备唤醒系统一实施例的框架示意图;1 is a schematic diagram of a framework of an embodiment of a device wake-up system of the present application;
图2是本申请设备唤醒方法一实施例的流程示意图;2 is a schematic flowchart of an embodiment of a device wake-up method of the present application;
图3是本申请电子设备一实施例的框架示意图;3 is a schematic diagram of a framework of an embodiment of an electronic device of the present application;
图4是本申请计算机可读存储介质一实施例的框架示意图。FIG. 4 is a schematic diagram of a framework of an embodiment of a computer-readable storage medium of the present application.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。可以理解的是,此处所描述的具体实施例仅用于解释本申请,而非对本申请的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本申请相关的部分而非全部结构。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有 其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, the drawings only show some but not all the structures related to the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work, all belong to the protection scope of the present application.
本申请设备唤醒方法公开实施例中,决策设备通过目标区域内的人员情况来确定位于目标区域内待唤醒设备的状态,且该状态表示待唤醒设备是允许唤醒,还是不允许唤醒,并响应于来自待唤醒设备的唤醒确认请求,基于待唤醒设备的状态,来指示待唤醒设备是否唤醒语音交互模式,由于待唤醒设备的状态是决策设备基于目标区域内的人员情况而确定,故能够有利于提高待唤醒设备的状态的准确性,即能够有利于提高确定待唤醒设备是否允许唤醒的准确性,相较于响应于唤醒确认请求直接唤醒语音交互模式而言,通过结合来自待唤醒设备的唤醒确认请求以及待唤醒设备的状态,共同指示待唤醒设备是否唤醒语音交互模式,能够有利于降低误唤醒率。In the disclosed embodiments of the device wake-up method of the present application, the decision-making device determines the state of the device to be woken up in the target area according to the situation of the people in the target area, and the state indicates whether the device to be woken up is allowed to wake up or not allowed to wake up, and responds to The wake-up confirmation request from the device to be awakened indicates whether the device to be awakened wakes up in the voice interaction mode based on the state of the device to be awakened. Since the state of the device to be awakened is determined by the decision-making device based on the situation of the people in the target area, it can be beneficial to Improving the accuracy of the state of the device to be woken up can help to improve the accuracy of determining whether the device to be woken up is allowed to wake up. Compared with the direct wake-up voice interaction mode in response to the wake-up confirmation request, by combining the wake-up from the device to be woken up The confirmation request and the status of the device to be awakened together indicate whether the device to be awakened wakes up in the voice interaction mode, which can help reduce the false wake-up rate.
请参阅图1,图1是本申请设备唤醒系统一实施例的框架示意图。如图1所示,设备唤醒系统包括决策设备以及待唤醒设备,且决策设备以及待唤醒设备之间相互连接,以确保两者之间的交互通信。具体而言,决策设备可以为可实现本申请中任一设备唤醒方法实施例的电子设备,其具体电路框架可以参阅本申请电子设备实施例的相关描述,在此暂不赘述。请继续参阅图1,待唤醒设备可以位于目标区域内,且若唤醒语音交互模式,则待唤醒设备能够执行在目标区域内接收到的语音指令。Please refer to FIG. 1 . FIG. 1 is a schematic diagram of a framework of an embodiment of a device wake-up system of the present application. As shown in FIG. 1 , the device wake-up system includes a decision-making device and a device to be woken up, and the decision-making device and the device to be woken up are connected to each other to ensure interactive communication between the two. Specifically, the decision-making device may be an electronic device that can implement any of the device wake-up method embodiments in this application, and its specific circuit framework can refer to the relevant descriptions of the electronic device embodiments in this application, which will not be repeated here. Please continue to refer to FIG. 1 , the device to be awakened may be located in the target area, and if the voice interaction mode is awakened, the device to be awakened can execute the voice command received in the target area.
需要说明的是,待唤醒设备可以包括但不限于:诸如智能插座、智能灯具、扫地机器人等智能家居设备,以及诸如电饭锅、冰箱、烤箱等家电设备,在此不做限定。不失一般性地,智能插座若唤醒语音交互模式,则能够执行诸如“断开通路”、“闭合通路”等语音指令,从而能够在执行语音指令“闭合通路”的情形下,为插在智能插座上的电器(如,热水器)通电,或者能够在执行语音指令“断开通路”的情形下,为插在智能插座上的电器(如,热水器)断电,其他待唤醒设备可以以此类推,在此不再一一举例。It should be noted that the devices to be woken up may include, but are not limited to, smart home devices such as smart sockets, smart lamps, and sweeping robots, and home appliances such as rice cookers, refrigerators, and ovens, which are not limited here. Without loss of generality, if the smart socket wakes up the voice interaction mode, it can execute voice commands such as "disconnect the channel" and "close the channel", so that when the voice command "close the channel" is executed, The electrical appliance (eg, water heater) on the socket is powered on, or the appliance (eg, the water heater) plugged into the smart socket can be powered off by executing the voice command "disconnect the circuit", and other devices to be woken up can be deduced by analogy , and no more examples will be given here.
在一个实施场景中,为了提高决策设备的执行效率,以快速且精准地确定是否指示待唤醒设备去唤醒语音交互模式,决策设备的处理能力可以强于待唤醒设备。例如,决策设备的CPU(Central Processing Unit,中央处理器)的核心数、线程数以及频率可以大于待唤醒设备。决策设备可以包括但不限于:电视机、NAS(Network Attached Storage,网络附属存储)、机顶盒等等,在此不做限定。In an implementation scenario, in order to improve the execution efficiency of the decision-making device and quickly and accurately determine whether to instruct the device to be woken up to wake up the voice interaction mode, the processing capability of the decision-making device may be stronger than that of the device to be woken up. For example, the number of cores, the number of threads and the frequency of the CPU (Central Processing Unit, central processing unit) of the decision-making device may be greater than that of the device to be awakened. Decision-making devices may include, but are not limited to: televisions, NAS (Network Attached Storage, network attached storage), set-top boxes, etc., which are not limited here.
在一个实施场景中,决策设备与待唤醒设备两者之间具体可以通过短程无线通信方式来进行通信,或者,决策设备以及待唤醒设备之间具体也可以通过短程无线通信方式连接在同一局域网内。短程无线通信方式具体可以包括但不限于:蓝牙、ZigBee(即紫蜂协议)等等,在此不做限定。In an implementation scenario, the decision-making device and the device to be woken up can communicate through short-range wireless communication, or the decision-making device and the device to be woken up can also be connected in the same local area network through short-range wireless communication. . The short-range wireless communication manner may specifically include, but is not limited to, Bluetooth, ZigBee (ie, ZigBee protocol), etc., which are not limited herein.
在一个实施场景中,如前所述,待唤醒设备可以位于目标区域内,为了进一步确保待唤醒设备与决策设备之间的顺畅通信,决策设备也可以设置于目标区域内。In an implementation scenario, as mentioned above, the device to be awakened may be located in the target area. In order to further ensure smooth communication between the device to be awakened and the decision-making device, the decision-making device may also be set in the target area.
在一个实施场景中,目标区域具体可以包括但不限于家庭区域,即本公开实施例中的设备唤醒系统具体可以部署于家居环境中。如,诸如电饭锅、电冰箱、烤箱等待唤醒设备可以位于家庭区域的厨房内,而诸如智能插座、智能灯具等待唤醒设备可以根据需要部署在家庭区域的客厅、卧室内,在此不做限定。In an implementation scenario, the target area may specifically include, but is not limited to, a home area, that is, the device wake-up system in the embodiment of the present disclosure may be specifically deployed in a home environment. For example, waiting-to-wake devices such as rice cookers, refrigerators, and ovens can be located in the kitchen of the home area, while wait-to-wake devices such as smart sockets and smart lamps can be deployed in the living room and bedroom of the home area as required, which is not limited here. .
在一个实施场景中,设备唤醒系统可以仅包含一个决策设备,如,在目标区域的面积较小的情况下,待唤醒设备分布较为密集,在此情形下,仅部署一个决策设备即可与所有待唤醒设备实现可靠连接;或者,请继续参阅图1,如图1所示,设备唤醒系统也可以包含多个(如,2个、3个等等)决策设备,每个决策设备可以连接有至少一个(如,1个、2个、3个等等)待唤醒设备。决策设备所连接的待唤醒设备具体可以根据决策设备以及待唤醒设备之间的相对位置进行设置,例如,对于书房内的决策设备“NAS”而言,其所连接的待唤醒设备可以包括:书房内的智能插座、书房内的智能灯具,对于客厅内的决策设备“电视机”而言,其所连接的待唤醒设备可以包括:客厅内的扫地机器人、客厅内的智能插座、客厅内的智能灯具,其他决策设备可以以此类推,在此不再一一举例;或者,决策设备所链接的待唤醒设备具体也可以直接由用户进行配置,例如,用户可以直接配置 卧室内的决策设备“机顶盒”与卧室内的智能插座、卧室内的空调以及卧室内的智能灯具连接。上述两种方式在实际应用时,可以任选其一,在此不做限定。In an implementation scenario, the device wake-up system may include only one decision-making device. For example, when the target area is small, the devices to be woken up are densely distributed. In this case, only one decision-making device can be deployed with all the devices. The device to be woken up achieves a reliable connection; alternatively, please continue to refer to Figure 1. As shown in Figure 1, the device wake-up system can also include multiple (eg, 2, 3, etc.) decision-making devices, and each decision-making device can be connected to a At least one (eg, 1, 2, 3, etc.) devices to wake up. The device to be woken up connected to the decision-making device can be specifically set according to the relative position between the decision-making device and the device to be woken up. For example, for the decision-making device "NAS" in the study room, the connected devices to be woken up may include: study room For the smart sockets in the living room and the smart lamps in the study room, for the decision-making device "TV" in the living room, the connected devices to be woken up can include: sweeping robots in the living room, smart sockets in the living room, and smart devices in the living room. Lamps and other decision-making devices can be deduced in the same way, and no examples will be given here; alternatively, the device to be woken up linked to the decision-making device can also be directly configured by the user, for example, the user can directly configure the decision-making device in the bedroom. "Connect with the smart socket in the bedroom, the air conditioner in the bedroom, and the smart lighting in the bedroom. In practical application, one of the above two methods can be selected, which is not limited here.
在一个实施场景中,如前所述,决策设备通过目标区域的人员情况来确定位于目标区域内的待唤醒设备的状态,为了提高人员情况的准确性,如图1所示,设备唤醒系统还可以进一步包括位于目标区域内的采集设备,且采集设备用于获取得到目标区域内的采集数据,该采集数据用来确定目标区域内的人员情况。需要说明的是,目标区域的人员情况具体可以包括但不限于:目标区域内是否有人,如人员情况可以包括:目标区域内有人,或者,人员情况可以包括:目标区域内无人,在此不做限定。In an implementation scenario, as mentioned above, the decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area. In order to improve the accuracy of the personnel situation, as shown in Figure 1, the device wake-up system also It may further include a collection device located in the target area, and the collection device is used to obtain the collection data in the target area, and the collection data is used to determine the situation of the personnel in the target area. It should be noted that the personnel situation in the target area may specifically include, but is not limited to, whether there are people in the target area. For example, the personnel situation may include: there are people in the target area, or the personnel situation may include: no one is in the target area, which is not described here. Do limit.
在一个具体的实施场景中,采集设备可以包括但不限于门开关感应设备、图像采集设备和目标感应设备中的至少一者。需要说明的是,门开关感应设备可以包括但不限于门锁,门锁具体可以包括但不限于:指纹锁、密码锁、门卡锁、虹膜锁等,图像采集设备可以包括但不限于摄像头,摄像头可以包括但不限于:卡片式摄像头、球形摄像头等等,目标感应设备可以包括但不限于红外感应设备等等,红外感应设备可以包括但不限于:红外热释电传感器等等,在此不做限定。In a specific implementation scenario, the acquisition device may include, but is not limited to, at least one of a door switch sensing device, an image acquisition device, and a target sensing device. It should be noted that door switch sensing devices may include but are not limited to door locks, door locks may specifically include but are not limited to: fingerprint locks, password locks, door card locks, iris locks, etc., and image capture devices may include but are not limited to cameras, Cameras can include but are not limited to: card cameras, spherical cameras, etc., target sensing devices can include but are not limited to infrared sensing devices, etc., infrared sensing devices can include but are not limited to: infrared pyroelectric sensors, etc. Do limit.
在另一个具体的实施场景中,如前所述,采集设备可以包括但不限于门开关感应设备、图像采集设备、目标感应设备等,在此情形下,采集数据可以包括但不限于门开关感应设备采集得到的进出门数据、图像采集设备拍摄得到的图像数据、目标感应设备感应得到的感应数据等,在此基础上,可以基于其中一者,或者结合其中两者及以上,来确定目标区域内的人员情况。具体可以参阅下述公开实施例中的相关描述,在此暂不赘述。In another specific implementation scenario, as mentioned above, the collection devices may include but are not limited to door switch sensing devices, image collection devices, target sensing devices, etc. In this case, the collected data may include but not limited to door switch sensing devices The entry and exit data collected by the device, the image data captured by the image collection device, and the sensing data sensed by the target sensing device, etc. On this basis, the target area can be determined based on one of them, or a combination of two or more of them. personnel inside. For details, reference may be made to the related descriptions in the following disclosed embodiments, which are not repeated here.
需要说明的是,采集设备与待唤醒设备并非对立的个体,待唤醒设备中也可以包括采集设备,如,待唤醒设备可以包括:电饭锅、扫地机器人、智能插座、摄像头,与前述智能插座类似地,若摄像头唤醒语音交互模式,则能够执行诸如“删除本地录像”、“保存本地录像至云端”等语音指令,从而能在执行语音指令“删除本地录像”的情形下,删除摄像头本地所存储的录像,而在执行语音指令“保存本地录像至云端”的情形下,将摄像头本地所存储的录像保存至云端,进一步地,摄像头也可以作为采集设备,用于采集图像数据,以便根据图像数据,确定人员情况,具体确定方式可以参阅下述公开实施例中相关描述,在此暂不赘述。当然,待唤醒设备中也可以不包括采集设备,如,待唤醒设备可以包括:电饭锅、扫地机器人和智能插座,而采集设备可以包括门锁和红外感应设备,在此不做限定。It should be noted that the collection device and the device to be woken up are not opposite individuals, and the device to be woken up may also include the collection device. For example, the device to be woken up may include: rice cookers, sweeping robots, smart sockets, cameras, and the aforementioned smart sockets Similarly, if the camera wakes up the voice interaction mode, it can execute voice commands such as "delete local video", "save local video to the cloud", etc., so that when the voice command "delete local video" is executed, the local camera can be deleted. In the case of executing the voice command "Save local video to the cloud", the video stored locally by the camera is saved to the cloud. Further, the camera can also be used as a collection device to collect image data, so that according to the image Data, determine the personnel situation, and the specific determination method can refer to the relevant descriptions in the following disclosed embodiments, which will not be repeated here for the time being. Of course, the devices to be woken up may not include collection devices. For example, the devices to be woken up may include rice cookers, sweeping robots, and smart sockets, and the collection devices may include door locks and infrared sensing devices, which are not limited here.
在一个实施场景中,决策设备可以直接基于采集设备获取得到的采集数据来确定得到目标区域的人员情况,如此能够有利于尽可能地缩短决策是否唤醒过程中的通信链路,有利于降低确定是否唤醒的时延。In an implementation scenario, the decision-making device can directly determine the personnel situation in the target area based on the collection data obtained by the collection device, which can help shorten the communication link in the process of deciding whether to wake up as much as possible. Wake-up delay.
在另一个实施场景中,请结合参阅图1,为了降低决策设备的处理负荷,设备唤醒系统中还可以包括云端设备(如,服务器等等),该云端设备可以与决策设备以及采集设备连接,在此基础上,云端设备可以从采集设备获取到采集数据,并基于采集数据确定得到目标区域的人员检测信息,进一步将目标区域的人员检测信息发送给决策设备,以供决策设备通过目标区域的人员检测信息来确定目标区域的人员情况,并通过目标区域的人员情况,确定待唤醒设备的状态。也就是说,一方面云端设备与采集设备相连,以获取到目标区域的采集数据,并基于采集数据确定目标区域的人员检测信息,另一方面云端设备也和决策设备相连,以将人员检测信息发送给决策设备,以便决策设备根据人员检测信息确定人员情况,从而确定待唤醒设备的状态,由于云端设备相较于决策设备往往具有更强的处理能力,使其能够运行更为复杂精确的数学模型来处理采集数据,以提高人员情况的准确性,从而通过云端设备、决策设备、采集设备三者共同协作,能够有利于提高确定得到的待唤醒设备的状态的准确性,并降低决策设备的处理负荷。In another implementation scenario, please refer to Fig. 1, in order to reduce the processing load of the decision-making device, the device wake-up system may also include a cloud device (such as a server, etc.), and the cloud device can be connected with the decision-making device and the collection device. On this basis, the cloud device can obtain the collection data from the collection device, and determine the personnel detection information in the target area based on the collected data, and further send the personnel detection information in the target area to the decision-making device for the decision-making device to pass the target area. The personnel detection information is used to determine the personnel situation in the target area, and through the personnel situation in the target area, the state of the device to be awakened is determined. That is to say, on the one hand, the cloud device is connected to the collection device to obtain the collection data of the target area, and based on the collected data, the personnel detection information of the target area is determined; Send it to the decision-making device, so that the decision-making device can determine the situation of the personnel based on the personnel detection information, thereby determining the state of the device to be awakened. Compared with the decision-making device, the cloud device often has stronger processing capabilities, enabling it to run more complex and accurate mathematics. Model to process the collected data to improve the accuracy of the personnel situation, so that through the cooperation of cloud equipment, decision equipment, and collection equipment, it can help to improve the accuracy of the determined state of the device to be woken up, and reduce the decision-making equipment. processing load.
上述实施例已表明决策设备、待唤醒设备、采集设备以及云端设备之间的连接关系、数据交互,以及各自的功能作用。下面请参阅图2,图2是本申请设备唤醒方法一实施例 的流程示意图。具体而言,可以包括如下步骤:The above embodiments have shown the connection relationship, data interaction, and their respective functions among the decision-making device, the device to be woken up, the collection device, and the cloud device. Please refer to FIG. 2 below. FIG. 2 is a schematic flowchart of an embodiment of a device wake-up method of the present application. Specifically, the following steps can be included:
步骤S21:决策设备基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态。Step S21: The decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area.
本公开实施例中,待唤醒设备的状态用于表示待唤醒设备是允许唤醒,还是不允许唤醒,具体可以参阅前述公开实施例中相关描述,在此不再赘述。In the embodiment of the present disclosure, the state of the device to be woken up is used to indicate whether the device to be woken up is allowed to wake up or not allowed to wake up. For details, reference may be made to the relevant descriptions in the aforementioned disclosed embodiments, which will not be repeated here.
在一个实施场景中,如前述公开实施例所述,目标区域的人员情况具体可以基于采集设备针对目标区域的采集数据来确定。如,若采集设备包括门开关感应设备,则采集数据可以包括门开关感应设备采集得到的进出门数据;而若采集设备包括图像采集设备,则采集数据可以包括图像采集设备拍摄得到的图像数据;而若采集设备包括目标感应设备,则采集数据可以包括目标感应设备感应得到的感应数据,在此不做限定。In an implementation scenario, as described in the foregoing disclosed embodiments, the personnel situation in the target area may be specifically determined based on the data collected by the collection device for the target area. For example, if the collection device includes a door switch sensing device, the collected data may include entry and exit data collected by the door switch sensing device; and if the collection device includes an image capture device, the collected data may include image data captured by the image capture device; However, if the collection device includes a target sensing device, the collected data may include sensing data sensed by the target sensing device, which is not limited herein.
在一个实施场景中,如前述公开实施例所述,决策设备可以直接基于采集数据,获取得到目标区域的人员检测信息,在此基础上,再基于获取得到的人员检测信息,确定目标区域的人员情况。In an implementation scenario, as described in the aforementioned disclosed embodiments, the decision-making device may obtain the personnel detection information in the target area directly based on the collected data, and on this basis, determine the personnel in the target area based on the obtained personnel detection information. Happening.
在另一个实施场景中,如前述公开实施例所述,为了降低决策设备的处理负荷以及提高人员情况的准确性,也可以由云端设备基于采集设备获取得到的采集数据,得到目标区域的人员检测信息,从而决策设备可以接收云端设备由采集数据所获取到的人员检测信息,并基于该人员检测信息,确定目标区域的人员情况,以通过云端设备、决策设备以及采集设备三端共同协作,来确定待唤醒设备是否唤醒语音交互模式。In another implementation scenario, as described in the aforementioned disclosed embodiments, in order to reduce the processing load of the decision-making device and improve the accuracy of the personnel situation, the cloud device can also obtain the personnel detection in the target area based on the collection data obtained by the collection device. information, so that the decision-making device can receive the personnel detection information obtained by the cloud device from the collected data, and based on the personnel detection information, determine the personnel situation in the target area, so as to cooperate with the cloud device, the decision-making device and the collection device. Determines whether the device to be woken wakes up in voice interaction mode.
需要说明的是,人员检测信息可以包括但不限于:进出门信息等,在此不做限定。进一步地,无论是由云端设备获取人员检测信息,还是由决策设备直接获取人员检测信息,均可以根据不同采集设备对目标区域的不同采集数据来确定人员检测信息。It should be noted that the personnel detection information may include but is not limited to: entry and exit information, etc., which are not limited here. Further, whether the person detection information is obtained by the cloud device or the person detection information is directly obtained by the decision device, the personnel detection information can be determined according to different collection data of the target area by different collection devices.
以采集设备包括门开关感应设备为例,在此情形下,可以基于门开关感应设备采集的进出门数据,获取到门开关感应设备对应的人员检测信息,为了便于与其他采集设备对应的人员检测信息进行区分,可以将门开关感应设备对应的人员检测信息称为第一人员检测信息。Taking the collection device including the door switch sensing device as an example, in this case, the person detection information corresponding to the door switch sensing device can be obtained based on the entry and exit data collected by the door switch sensing device, in order to facilitate the detection of people corresponding to other collection devices. The information is distinguished, and the person detection information corresponding to the door switch sensing device can be called the first person detection information.
在一个实施场景中,以前述三端共同协作为例,在云端设备接收到门开关感应设备所采集到的进门数据时可以生成有人回来状态,而在云端设备接收到门开关感应设备采集得到的出门数据时可以生成有人离开状态,在此情形下,前述第一人员检测信息具体可以包括:有人回来状态和有人离开状态,具体可以包括有人回来状态的生成次数H以及有人离开状态的生成次数I。以门开关感应设备是指纹门锁为例,在门开关感应设备采集到指纹而开锁时,可以认为接收到一次进门数据,而在门开关感应设备未采集到指纹即开锁时,可以认为接收到一次出门数据;或者,以门开关感应设备是密码锁为例,在门开关感应设备采集到正确的输入密码而开锁时,可以认为接收到一次进门数据,而在门开关感应设备未采集到密码直接开锁时,可以认为接收到一次出门数据,其他门锁可以以此类推,在此不再一一举例。In an implementation scenario, taking the aforementioned three-terminal cooperation as an example, when the cloud device receives the door entry data collected by the door switch sensing device, it can generate a status of someone coming back, and the cloud device receives the data collected by the door switch sensing device. When going out data, a person leaving state can be generated. In this case, the aforementioned first person detection information may specifically include: someone returning state and someone leaving state, and specifically may include the generation number H of someone returning state and the generation number I of someone leaving state . Taking the door switch sensing device as a fingerprint door lock as an example, when the door switch sensing device collects the fingerprint and unlocks the door, it can be considered that a door entry data is received, and when the door switch sensing device does not collect the fingerprint and the lock is unlocked, it can be considered that the door is received. One-time exit data; or, taking the door switch sensing device as a password lock as an example, when the door switch sensing device collects the correct input password and unlocks the lock, it can be considered that one-time entry data is received, but the door switch sensing device does not collect the password. When the lock is directly unlocked, it can be considered that one time out data is received, and other door locks can be deduced by analogy, and no examples will be given here.
在另一个实施场景中,如前所述,第一人员检测信息具体可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I,在此情形下,可以比较有人回来状态的生成次数H以及有人离开状态的生成次数I,并基于比较结果来确定人员情况,即目标区域是否有人。具体地,在有人回来状态的生成次数H大于有人离开状态的生成次数I的情况下,可以确定目标区域有人,反之可以确定目标区域无人。如,有人回来状态的生成次数为4次,即门锁记录到4次利用指纹、密码等开锁,而有人离开状态的生成次数为3次,即门锁记录到3次不利用任何指纹、密码等而直接开锁,则可以确定目标区域有人;或者,有人回来状态的生成次数为4次,有人离开状态的生成次数也为4次,则可以认为大门共经历了4次完整的“进门-出门”动作,故可以确定目标区域无人。其他情况可以以此类推,在此不再一一举例。In another implementation scenario, as mentioned above, the first person detection information may specifically include: the generation times H of the person returning state and the generation number I of the person leaving state. In this case, the generation times of the person returning state can be compared. H and the generation number I of the person leaving the state, and based on the comparison result, determine the person situation, that is, whether there is a person in the target area. Specifically, in the case where the generation times H of the person returning state is greater than the generation number I of the person leaving state, it can be determined that the target area is occupied, otherwise it can be determined that the target area is unoccupied. For example, the number of times that someone has come back is 4 times, that is, the door lock is recorded 4 times using fingerprints, passwords, etc. to unlock, and the number of times that someone has left is 3 times, that is, the door lock is recorded 3 times without using any fingerprints, passwords, etc. If the lock is opened directly after waiting, it can be determined that there are people in the target area; or, the number of times that someone has returned to the state is 4, and the number of times that someone has left the state is also 4 times, it can be considered that the door has experienced a total of 4 complete "in-door-out". ” action, so it can be determined that there is no one in the target area. Other situations can be deduced by analogy, and no examples are given here.
以采集设备包括图像采集设备为例,在此情形下,可以基于图像采集设备采集得到的图像数据的人像检测结果,获取到图像采集设备对应的人员检测信息,为了便于与其他采 集设备对应的人员检测信息进行区分,可以将图像采集设备对应的人员检测信息称为第二人员检测信息。Taking the acquisition device including the image acquisition device as an example, in this case, the person detection information corresponding to the image acquisition device can be obtained based on the portrait detection results of the image data collected by the image acquisition device, in order to facilitate the personnel corresponding to other acquisition devices. The detection information is distinguished, and the person detection information corresponding to the image acquisition device may be referred to as the second person detection information.
在一个实施场景中,图像采集设备的拍摄范围可以覆盖整个目标区域,可以对图像采集设备采集得到的图像数据进行人像检测,得到人像检测结果,人像检测结果具体可以包括图像数据中是否存在人像,在此情形下,前述第二人员检测信息具体可以包括人像检测结果。进一步地,可以直接基于第二人员检测信息,确定得到人员情况。如,对图像数据进行人像检测,可以得到人像检测结果,该人像检测结果可以包括图像数据存在人像,此时可以认为第二人员检测信息包括图像数据存在人像,从而可以直接确定人员情况为目标区域有人;或者,对图像数据进行人像检测,可以得到人像检测结果,该人像检测结果可以包括图像数据不存在人像,此时可以认为第二人员检测信息包括图像数据不存在人像,从而可以直接确定人员情况为目标区域无人。In an implementation scenario, the shooting range of the image acquisition device may cover the entire target area, and the image data collected by the image acquisition device may be subjected to portrait detection to obtain a portrait detection result. The portrait detection result may specifically include whether there is a portrait in the image data, In this case, the aforementioned second person detection information may specifically include a portrait detection result. Further, the situation of the person may be determined directly based on the second person detection information. For example, by performing portrait detection on the image data, a portrait detection result can be obtained. The portrait detection result may include the presence of a portrait in the image data. At this time, it can be considered that the second person detection information includes the presence of a portrait in the image data, so that the situation of the person can be directly determined as the target area. Or, by performing portrait detection on the image data, a portrait detection result can be obtained, and the portrait detection result may include that there is no portrait in the image data. At this time, it can be considered that the second person detection information includes the image data and there is no portrait, so that the person can be directly determined. The situation is that there is no one in the target area.
在另一个实施场景中,图像采集设备的拍摄范围也可以仅覆盖目标区域的门口,则可以对图像采集设备采集得到的图像数据进行人像检测,得到人像检测结果,人像检测结果具体可以包括图像数据中是否存在人像,若存在人像是进门还是出门,在此情形下,前述第二人员检测信息具体可以包括人像检测结果。进一步地,可以比较存在人像进门的次数和存在人像出门的次数,并基于比较结果来确定人员情况,即确定目标区域是否有人。如,对图像数据进行人像检测,得到人像检测结果,该人像检测结果可以包括存在人像,且存在人像进门,且经统计,目前存在人像进门的次数为H,存在人像出门的次数为I,则若H大于I,则可以认为人员情况包括目标区域有人,否则可以认为人员情况包括目标区域无人。In another implementation scenario, the shooting range of the image acquisition device may only cover the doorway of the target area, and then the image data collected by the image acquisition device may be subjected to portrait detection to obtain a portrait detection result. The portrait detection result may specifically include image data Whether there is a portrait in the , and if there is a portrait, whether it is entering the door or going out, in this case, the aforementioned second person detection information may specifically include the portrait detection result. Further, it is possible to compare the number of times that the presence of a portrait enters the door and the number of times that there is a presence of a portrait to go out, and based on the comparison result, determine the personnel situation, that is, determine whether there is a person in the target area. For example, performing portrait detection on the image data to obtain a portrait detection result, the portrait detection result may include the presence of a portrait, and the presence of a portrait entering the door, and after statistics, the number of times that there is a portrait entering the door is H, and the number of times that there is a portrait going out is 1, then If H is greater than I, it can be considered that the personnel situation includes that the target area is occupied, otherwise it can be considered that the personnel situation includes that the target area is unoccupied.
以采集设备包括目标感应设备为例,在此情形下,可以基于目标感应设备感应得到的感应数据,获取到目标感应设备对应的人员检测信息,为了便于与其他采集设备对应的人员检测信息进行区分,可以将目标感应设备对应的人员检测信息称为第三人员检测信息。Taking the collection device including the target sensing device as an example, in this case, the personnel detection information corresponding to the target sensing device can be obtained based on the sensing data sensed by the target sensing device, in order to facilitate the distinction from the personnel detection information corresponding to other collection devices. , the person detection information corresponding to the target sensing device may be referred to as the third person detection information.
在一个实施场景中,可以在门内、门外分别部署目标感应设备,每次先接收到门外目标感应设备感应得到的感应数据再接收到门内目标感应设备感应得到的感应数据,则可以生成有人回来状态,而每次先接收到门内目标感应设备感应得到的感应数据再接收到门外目标感应设备感应得到的感应数据,则可以生成有人离开状态,在此情形下,前述第三人员检测信息具体可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I。In an implementation scenario, target sensing devices can be deployed inside the door and outside the door, and each time the sensing data sensed by the target sensing device outside the door is received first, and then the sensing data sensed by the target sensing device inside the door, can be The state of someone returning is generated, and each time the sensing data sensed by the target sensing device inside the door is received first, and then the sensing data sensed by the target sensing device outside the door, the state that someone has left can be generated. In this case, the above-mentioned third The person detection information may specifically include: the generation times H of the state where someone came back and the generation number I of the state where someone left.
在另一个实施场景中,如前所述,第三人员检测信息具体可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I,在此情形下,可以比较有人回来状态的生成次数H以及有人离开状态的生成次数I,并基于比较结果来确定人员情况,即目标区域是否有人。具体地,在有人回来状态的生成次数H大于有人离开状态的生成次数I的情况下,可以确定目标区域有人,反之可以确定目标区域无人。具体可以参阅前述相关描述,在此不再赘述。In another implementation scenario, as mentioned above, the third person detection information may specifically include: the generation times H of the state where someone came back and the number I generated when the person left the state. In this case, the generation times of the state where someone came back can be compared. H and the generation number I of the person leaving the state, and based on the comparison result, determine the person situation, that is, whether there is a person in the target area. Specifically, in the case where the generation times H of the person returning state is greater than the generation number I of the person leaving state, it can be determined that the target area is occupied, otherwise it can be determined that the target area is unoccupied. For details, reference may be made to the foregoing related descriptions, which will not be repeated here.
需要说明的是,为了进一步提高人员情况的准确性,可以结合多种采集设备对应的采集数据共同确定人员情况,从而通过结合多模态的采集数据,能够有利于减少单模态的采集数据确定人员情况可能造成的误差,提高人员情况的准确性。It should be noted that, in order to further improve the accuracy of the personnel situation, the personnel situation can be jointly determined by combining the collected data corresponding to a variety of acquisition devices, so that by combining the multimodal acquisition data, it can be beneficial to reduce the single-modal acquisition data determination. Errors that may be caused by personnel conditions and improve the accuracy of personnel conditions.
以采集设备包括门开关感应设备和图像采集设备为例,其中,图像采集设备的拍摄范围可以仅覆盖目标区域的门口,也可以覆盖整个目标区域,在此情形下,基于门开关感应设备采集得到的进出门数据,可以获取到前述第一人员检测信息,并基于图像采集设备采集得到的图像数据的人像检测结果,可以获取到前述第二人员检测信息,从而可以结合第一人员检测信息和第二人员检测信息,确定得到人员情况(即目标区域是否有人)。Taking the acquisition device including door switch sensing device and image acquisition device as an example, the shooting range of the image acquisition device can only cover the doorway of the target area, or can cover the entire target area. According to the entry and exit data, the aforementioned first person detection information can be obtained, and based on the portrait detection result of the image data collected by the image acquisition device, the aforementioned second person detection information can be obtained, so that the first person detection information and the second person detection information can be combined. Two people detect the information to determine the situation of the people (that is, whether there are people in the target area).
在一个实施场景中,如前所述,在图像采集设备的拍摄范围覆盖整个目标区域的情况下,第二人员检测信息可以包括目标区域内是否有人,且第一人员检测信息可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I,通过比较生成次数H和生成次数I,可以确定得到一个初始的人员情况A(即目标区域是否有人)。进一步地,可以利 用第二人员检测信息校验上述人员情况A,得到最终的人员情况B。如,用户利用指纹开门进入目标区域,故生成次数H为1次,此时门尚未关闭,且由于用户意识到有东西落在目标区域之外而直接出门,门锁未检测到不利用指纹而直接开门的动作(即并未检测到屋内解锁的动作),故生成次数I仍为0,由于生成次数H大于生成次数I,从而判定为目标区域有人,与实际情况不相符。也就是说,在实际应用时,由门锁的采集数据所确定的人员情况可能存在误差,故可以利用第二检测信息将上述目标区域有人的人员情况进行校正,得到最终的人员情况(即目标区域无人)。In an implementation scenario, as described above, in the case that the shooting range of the image acquisition device covers the entire target area, the second person detection information may include whether there is a person in the target area, and the first person detection information may include: someone comes back The generation times H of the state and the generation times I of people leaving the state, by comparing the generation times H and the generation times I, an initial personnel situation A (that is, whether there is a person in the target area) can be determined to be obtained. Further, the above-mentioned personnel situation A can be verified by using the second personnel detection information to obtain the final personnel situation B. For example, the user uses the fingerprint to open the door to enter the target area, so the number of generation H is 1. At this time, the door has not been closed, and because the user realizes that something falls outside the target area and directly goes out, the door lock does not detect that the door lock does not use the fingerprint. The action of opening the door directly (that is, the action of unlocking the house is not detected), so the generation number I is still 0. Since the generation number H is greater than the generation number I, it is determined that there is a person in the target area, which is inconsistent with the actual situation. That is to say, in actual application, there may be errors in the personnel situation determined by the collected data of the door lock, so the second detection information can be used to correct the personnel situation in the above-mentioned target area to obtain the final personnel situation (that is, the target area). area unoccupied).
在另一个实施场景中,如前所述,在图像采集设备的拍摄范围仅覆盖目标区域的门口的情况下,第二人员检测信息可以包括目前存在人像进门的次数为H以及存在人像出门的次数为I,且第一人员检测信息可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I,通过比较生成次数H和生成次数I,可以确定得到一个初始的人员情况C(即目标区域是否有人)。进一步地,可以利用第二人员检测信息校验上述人员情况C,得到最终的人员情况D。如,用户利用指纹开门进入目标区域,故生成次数H为1次,此时门已关闭,用户准备出门聚会时,不利用指纹直接开门(即检测到屋内解锁的动作),故生成次数I为1,并在即将关门时,接到聚会取消的通知,用户回到目标区域内并关门,由于生成次数H等于生成次数I,故判定为目标区域无人,与实际情况不相符。也就是说,在实际应用时,由门锁的采集数据所确定的人员情况可能存在误差,故可以利用第二检测信息将上述目标区域无人的人员情况进行校正,得到最终的人员情况(即目标区域有人)。In another implementation scenario, as mentioned above, in the case that the shooting range of the image acquisition device only covers the doorway of the target area, the second person detection information may include the current number of times that a person enters the door and the number of times that a person exits the door. is 1, and the first personnel detection information may include: the generation times H of the state that someone came back and the generation times I of the state that someone left, and by comparing the generation times H and the generation times I, it can be determined to obtain an initial personnel situation C (that is, the target whether the area is occupied). Further, the above-mentioned personnel situation C can be verified by using the second personnel detection information, and the final personnel situation D can be obtained. For example, the user uses the fingerprint to open the door to enter the target area, so the number of generation H is 1 time, and the door is closed at this time. When the user is going to go out for a party, he does not use the fingerprint to directly open the door (that is, the action of unlocking the house is detected), so the number of generation I is 1. When the door is about to close, the user receives a notification of the cancellation of the party, and the user returns to the target area and closes the door. Since the number of generation H is equal to the number of generation I, it is determined that there is no one in the target area, which is inconsistent with the actual situation. That is to say, in actual application, there may be errors in the personnel situation determined by the collected data of the door lock, so the second detection information can be used to correct the unmanned personnel situation in the above target area to obtain the final personnel situation (ie target area is occupied).
以采集设备包括门开关感应设备、目标感应设备和图像采集设备为例,其中,目标感应设备可以包括分别部署于门内和门外的门内目标感应设备和门外目标感应设备,图像采集设备的拍摄范围可以覆盖整个目标区域,也可以仅覆盖目标区域的门口,在此情形下,基于门开关感应设备采集得到的进出门数据,可以获取到前述第一人员检测信息,基于图像采集设备采集得到的图像数据的人像检测结果,可以获取到前述第二人员检测结果,并基于目标感应设备感应得到的感应数据,可以获取到前述第三人员检测信息,如前所述,第一人员检测信息可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I,且第三人员检测信息也可以包括:有人回来状态的生成次数H以及有人离开状态的生成次数I。在此基础上,可以结合第一人员检测信息、第二人员检测信息和第三人员检测信息,确定得到人员情况(即目标区域是否有人)。Taking the acquisition device including door switch sensing device, target sensing device and image acquisition device as an example, the target sensing device may include in-door target sensing device and out-door target sensing device respectively deployed in the door and outside the door, and the image acquisition device The shooting range can cover the entire target area, or only the doorway of the target area. In this case, based on the entry and exit data collected by the door switch sensing device, the aforementioned first person detection information can be obtained. The portrait detection result of the obtained image data can obtain the aforementioned second person detection result, and based on the sensing data sensed by the target sensing device, the aforementioned third person detection information can be obtained. As mentioned above, the first person detection information It can include: the generation times H of someone returning state and the generation number I of someone leaving state, and the third person detection information can also include: the generation number H of someone returning state and the generation number I of someone leaving state. On this basis, the first personnel detection information, the second personnel detection information and the third personnel detection information can be combined to determine the personnel situation (that is, whether there is a person in the target area).
在一个实施场景中,可以比较第一人员检测信息中有人回来状态的生成次数H以及有人离开状态的生成次数I,得到比较结果A,与此同时,可以比较第三人员检测信息中有人回来状态的生成次数H以及有人离开状态的生成次数I,得到比较结果B,若比较结果A和比较结果B一致(即第一人员检测信息和第三人员检测信息中生成次数H均大于生成次数I,或者,第一人员检测信息和第三人员检测信息中生成次数H均不大于生成次数I),则可以直接基于比较结果A或比较结果B,确定目标区域是否有人。具体确定目标区域是否有人的方式,可以参阅前述相关描述,在此不再赘述;反之,若比较结果A和比较结果B不一致,则可以继续基于摄像头采集到的图像数据的人像检测结果,获取到第二人员检测信息,并基于第二人员检测信息,确定目标区域是否有人,具体确定目标区域是否有人的方式,可以参阅前述相关描述,在此不再赘述。In an implementation scenario, the generation times H of the person returning state and the generation number I of the person leaving state in the first person detection information can be compared to obtain the comparison result A, and at the same time, the person returning state in the third person detection information can be compared. The generation times H and the generation times I of someone leaving the state are obtained, and the comparison result B is obtained. If the comparison result A and the comparison result B are consistent (that is, the generation times H in the first person detection information and the third person detection information are greater than the generation times I, Alternatively, if the generation times H in the first person detection information and the third person detection information are not greater than the generation times I), it is possible to directly determine whether there is a person in the target area based on the comparison result A or the comparison result B. For the specific method of determining whether there is a person in the target area, you can refer to the above-mentioned related descriptions, which will not be repeated here; on the contrary, if the comparison result A and the comparison result B are inconsistent, the portrait detection results based on the image data collected by the camera can continue to be obtained. The second person detection information, and based on the second person detection information, determine whether there is a person in the target area, and the specific method of determining whether there is a person in the target area can refer to the foregoing related descriptions, which will not be repeated here.
在另一个实施场景中,可以比较第一人员检测信息和第三人员检测信息中有人回来状态的生成次数H是否相同,得到比较结果C,并比较第一人员检测信息和第三人员检测信息中有人离开状态的生成次数I是否相同,得到比较结果D,若比较结果C和比较结果D均表示比较为相同,则可以直接基于上述比较结果A或者比较结果B确定目标区域是否有人,具体确定目标区域是否有人的方式,可以参阅前述相关描述,在此不再赘述;反之,若比较结果C和比较结果D中任一者表示比较为不相同,则可以继续基于图像采集设备采集到的图像数据的人像检测结果,获取到第二人员检测信息,并基于第二人员检测信息,确定目标区域是否有人,具体确定目标区域是否有人的方式,可以参阅前述相关描述,在 此不再赘述。In another implementation scenario, the first person detection information and the third person detection information can be compared to see if the number of times H of people coming back is the same, a comparison result C can be obtained, and the first person detection information and the third person detection information can be compared. Whether the generation times I of the person leaving the state are the same, the comparison result D is obtained. If both the comparison result C and the comparison result D indicate that the comparison is the same, it is possible to directly determine whether there is a person in the target area based on the above comparison result A or comparison result B, and specifically determine the target. For the method of whether there is a person in the area, you can refer to the above-mentioned related description, which will not be repeated here; on the contrary, if any one of the comparison result C and the comparison result D indicates that the comparison is different, you can continue to use the image data collected by the image collection device. The second person detection information is obtained, and based on the second person detection information, it is determined whether there is a person in the target area, and the specific method of determining whether there is a person in the target area can be referred to the foregoing related descriptions, which will not be repeated here.
需要说明的是,如前所述,通过采集设备获取到的采集数据,可以由云端设备(或者决策设备)得到人员检测信息,并由决策设备进一步基于人员检测信息,确定目标区域的人员情况(即目标区域是否有人),决策设备进一步可以根据人员情况,来确定目标区域内的待唤醒设备的状态。具体地,若目标区域有人,则可以将待唤醒设备的状态相应确定为允许唤醒状态,反之,若目标区域无人,则可以将待唤醒设备的状态相应确定为禁止唤醒状态。It should be noted that, as mentioned above, the collection data obtained by the collection device can obtain personnel detection information from the cloud device (or decision-making device), and the decision-making device further determines the personnel situation in the target area based on the personnel detection information ( That is, whether there is a person in the target area), the decision-making device can further determine the state of the device to be awakened in the target area according to the personnel situation. Specifically, if there is a person in the target area, the state of the device to be woken up may be determined as the wake-up allowed state; otherwise, if there is no one in the target area, the state of the device to be woken up may be determined as the wake-up prohibited state.
如前所述,人员情况可以包括:目标区域有人、目标区域无人共两种情况,为了进一步降低误唤醒率,人员情况可以进一步包括:目标区域有人且处于活动状态,目标区域有人且处于睡眠状态、目标区域无人共三种情况。仍以采集设备包括图像采集设备为例,其中,图像采集设备的拍摄范围可以覆盖整个目标区域,在此情形下,基于图像采集设备采集得到的图像数据的人像检测结果,可以获取到前述第二人员检测结果,且第二人员检测信息可以包括是否有人以及人是处于活动状态还是睡眠状态。在此基础上,可以利用第二人员检测信息,确定得到人员情况。As mentioned above, the personnel situation may include two situations: the target area is occupied and the target area is unmanned. In order to further reduce the false wake-up rate, the personnel situation may further include: the target area is occupied and in an active state, and the target area is occupied and in sleep. There are three situations: status and target area unmanned. Still taking the acquisition device including the image acquisition device as an example, the shooting range of the image acquisition device can cover the entire target area, in this case, based on the portrait detection result of the image data collected by the image acquisition device, the aforementioned second can be obtained. The person detection result, and the second person detection information may include whether there is a person and whether the person is in an active state or a sleep state. On this basis, the second person detection information can be used to determine the situation of the person.
在一个实施场景中,可以对图像采集设备采集得到的图像数据进行人像检测,得到人像检测结果,人像检测结果具体可以包括图像数据中是否有人以及人是处于活动状态,还是处于睡眠状态,在此情形下,前述第二人员检测信息具体可以包括人像检测结果。进一步地,可以直接基于第二人员检测信息,确定得到人员情况。如,对图像数据进行人像检测,可以得到人像检测结果,该人像检测结果可以包括目标区域有人且人处于睡眠状态,此时可以直接确定人员情况为目标区域有人且处于睡眠状态;或者,对图像数据进行人像检测,可以得到人像检测结果,该人像检测结果可以包括目标区域无人,此时可以直接确定人员情况为目标区域无人;或者,对图像数据进行人像检测,可以得到人像检测结果,该人像检测结果可以包括目标区域有人且处于活动状态。In one implementation scenario, a portrait detection may be performed on the image data collected by the image acquisition device to obtain a portrait detection result. The portrait detection result may specifically include whether there is a person in the image data and whether the person is in an active state or a sleeping state. Here In this case, the aforementioned second person detection information may specifically include a portrait detection result. Further, the situation of the person may be determined directly based on the second person detection information. For example, by performing portrait detection on the image data, a portrait detection result can be obtained. The portrait detection result can include that the target area is occupied and the person is in a sleeping state. At this time, it can be directly determined that the person is in the target area and is in a sleeping state; The data is subjected to portrait detection, and the portrait detection result can be obtained. The portrait detection result can include no one in the target area. At this time, it can be directly determined that the personnel situation is no one in the target area; or, by performing portrait detection on the image data, the portrait detection result can be obtained. The portrait detection result may include that the target area is occupied and active.
需要说明的是,如前所述,通过采集设备获取到的采集数据,可以由云端设备(或者决策设备)得到人员检测信息,并由决策设备进一步基于人员检测信息,确定目标区域的人员情况,决策设备进一步可以根据人员情况,来确定目标区域内的待唤醒设备的状态。具体地,若目标区域有人且处于活动状态,则可以将待唤醒设备的状态相应确定为允许唤醒状态,而若目标区域有人且处于睡眠状态,则可以将待唤醒设备的状态相应确定为禁止唤醒状态,若目标区域无人,则可以将待唤醒设备的状态相应确定为禁止唤醒状态。It should be noted that, as mentioned above, the collection data obtained by the collection device can obtain personnel detection information from the cloud device (or the decision-making device), and the decision-making device further determines the personnel situation in the target area based on the personnel detection information. The decision-making device may further determine the state of the device to be awakened in the target area according to the personnel situation. Specifically, if the target area is occupied and in an active state, the state of the device to be woken up may be determined as a wake-up allowed state, and if the target area is in a sleep state, the state of the device to be woken up may be determined as a wake-up prohibited state. If there is no one in the target area, the state of the device to be woken up can be determined as the state of prohibiting wake-up accordingly.
步骤S22:响应于待唤醒设备发送的唤醒确认请求,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互模式。Step S22: In response to the wake-up confirmation request sent by the device to be woken up, based on the state of the device to be woken up, indicate whether the device to be woken up wakes up in the voice interaction mode.
在一个实施场景中,待唤醒设备一旦采集到音频数据,就可以生成唤醒确认请求。如,待唤醒设备采集得到音频数据“断开通路”,或者采集到音频数据“开始扫地”,或者采集到音频数据“开始煮饭”,即可生成唤醒确定请求。In an implementation scenario, once the device to be woken up collects audio data, it can generate a wake-up confirmation request. For example, a wake-up confirmation request can be generated when the device to be woken collects audio data "disconnected", or collects audio data "starts sweeping", or collects audio data "starts cooking".
在另一个实施场景中,为了提高生成唤醒确认请求的准确性,避免决策设备频繁响应唤醒确认请求,在采集到音频数据之后,待唤醒设备还可以检测音频数据中是否含有预设词语,若含有预设词语,则可以生成唤醒确认请求,否则可以不生成唤醒确认请求。预设词语具体可以设置为日常生活中不太可能使用的短语,如,可以设置为“XX语音助手”、“XX生活助手”等等,在此不做限定。如,待唤醒设备采集到音频数据“XX语音助手,请把卧室内智能插座断开通路”,则由于音频数据中含有预设词语“XX语音助手”,待唤醒设备可以生成唤醒确认请求,或者,待唤醒设备采集得到音频数据“今天这部电影不错”,则由于音频数据中未含有预设词语“XX语音助手”,待唤醒设备可以不生成唤醒确认请求。其他情况可以以此类推,在此不再一一举例。In another implementation scenario, in order to improve the accuracy of generating the wake-up confirmation request and prevent the decision-making device from frequently responding to the wake-up confirmation request, after collecting the audio data, the device to be woken up can also detect whether the audio data contains preset words. If the word is preset, the wake-up confirmation request may be generated, otherwise, the wake-up confirmation request may not be generated. The preset words can be specifically set to phrases that are unlikely to be used in daily life, for example, can be set to "XX voice assistant", "XX life assistant", etc., which are not limited here. For example, if the device to wake up collects the audio data "XX voice assistant, please disconnect the smart socket in the bedroom", since the audio data contains the preset word "XX voice assistant", the device to wake up can generate a wake-up confirmation request, or , the device to be woken up collects the audio data "This movie is good today", since the audio data does not contain the preset word "XX voice assistant", the device to be woken up may not generate a wake-up confirmation request. Other situations can be deduced by analogy, and no examples are given here.
在一个实施场景中,决策设备若接收到来自待唤醒设备的唤醒确认请求,则可以结合待唤醒设备的状态,共同指示待唤醒设备此时是否唤醒语音交互模式,即指示执行唤醒语音交互模式,或者指示不执行唤醒语音交互模式。需要说明的是,若指示执行唤醒语音交 互模式,则意味着待唤醒设备将切换为“已唤醒设备”,此时可以响应用户的语音指令,而若指示不执行唤醒语音交互模式,则意味着待唤醒设备不会切换为“已唤醒设备”,即待唤醒设备,此时仍不可以响应用户的语音指令。具体地,在待唤醒设备的状态确定为上述允许唤醒状态的情形下,可以指示待唤醒设备去执行上述唤醒语音交互模式,反之,在待唤醒设备的状态确定为上述禁止唤醒状态的情形下,可以指示待唤醒设备不去执行上述唤醒语音交互模式。In an implementation scenario, if the decision-making device receives a wake-up confirmation request from the device to be woken up, it can jointly indicate whether the device to be woken up wakes up the voice interaction mode at this time, that is, instructs to execute the wake-up voice interaction mode, in combination with the state of the device to be woken up. Or indicate that the wake-up voice interaction mode is not performed. It should be noted that if the wake-up voice interaction mode is instructed, it means that the device to be woken up will be switched to "awakened device", which can respond to the user's voice command, and if it is instructed not to perform the wake-up voice interaction mode, it means that the wake-up voice interaction mode is not executed. The device to be woken up will not be switched to "awakened device", that is, the device to be woken up still cannot respond to the user's voice command. Specifically, in the case where the state of the device to be woken up is determined to be the above-mentioned wake-up allowed state, the device to be woken up may be instructed to execute the wake-up voice interaction mode; on the contrary, in the case that the state of the device to be woken up is determined to be the above-mentioned wake-up prohibited state, The device to be woken up can be instructed not to execute the above-mentioned wake-up voice interaction mode.
在另一个实施场景中,如前所述,若采集到音频数据,且音频数据中含有预设词语,则待唤醒设备可以生成唤醒确认请求。进一步地,待唤醒设备可以将音频数据一同打包至唤醒确认请求,若待唤醒设备为禁止唤醒状态,则决策设备可以指示待唤醒设备不去执行上述唤醒语音交互模式,而若待唤醒设备为允许唤醒状态,则决策设备可以进一步对唤醒上述音频数据进行检测,若也检测到预设词语,则决策设备可以指示待唤醒设备去执行上述唤醒语音交互模式。上述方式,待唤醒设备在采集到音频数据且也检测到音频数据含有预设词语的情况下,生成唤醒确认请求且唤醒确认请求含有音频数据,并进一步由决策设备对唤醒确认请求内的音频数据进行二次检测,并在二次检测也确定音频数据内含有预设词语的情形下,指示待唤醒设备去执行唤醒语音交互模式,从而能够有利于降低对音频数据内预设词语的误检率,进而能够有利于进一步降低误唤醒率。In another implementation scenario, as described above, if audio data is collected and contains preset words, the device to be woken up may generate a wake-up confirmation request. Further, the device to be woken up can package the audio data into the wake-up confirmation request. If the device to be woken up is in a state of prohibiting wake-up, the decision-making device can instruct the device to be woken up not to perform the above-mentioned wake-up voice interaction mode, and if the device to be woken up is allowed to wake up. In the wake-up state, the decision-making device can further detect the above-mentioned wake-up audio data, and if the preset words are also detected, the decision-making device can instruct the device to be woken up to execute the above-mentioned wake-up voice interaction mode. In the above manner, when the device to be woken up collects audio data and also detects that the audio data contains preset words, it generates a wake-up confirmation request and the wake-up confirmation request contains audio data, and the decision-making device further verifies the audio data in the wake-up confirmation request. Perform secondary detection, and instruct the device to be awakened to execute the wake-up voice interaction mode when the secondary detection also determines that the audio data contains preset words, which can help reduce the false detection rate of preset words in the audio data , which can further reduce the false wake-up rate.
上述方案,决策设备通过目标区域内的人员情况来确定位于目标区域内待唤醒设备的状态,且该状态表示待唤醒设备是允许唤醒,还是不允许唤醒,并响应于来自待唤醒设备的唤醒确认请求,基于待唤醒设备的状态,来指示待唤醒设备是否唤醒语音交互模式,由于待唤醒设备的状态是决策设备基于目标区域内的人员情况而确定,故能够有利于提高待唤醒设备的状态的准确性,即能够有利于提高确定待唤醒设备是否允许唤醒的准确性,相较于响应于唤醒确认请求直接唤醒语音交互模式而言,通过结合来自待唤醒设备的唤醒确认请求以及待唤醒设备的状态,共同指示待唤醒设备是否唤醒语音交互模式,能够有利于降低误唤醒率。In the above solution, the decision-making device determines the state of the device to be awakened in the target area based on the situation of the people in the target area, and the state indicates whether the device to be awakened is allowed to wake up or not allowed to wake up, and responds to the wake-up confirmation from the device to be awakened Request, based on the state of the device to be awakened, to indicate whether the device to be awakened wakes up in the voice interaction mode. Since the state of the device to be awakened is determined by the decision-making device based on the situation of the people in the target area, it can help to improve the state of the device to be awakened. Accuracy, that is, it can help to improve the accuracy of determining whether the device to be woken up is allowed to wake up. Compared with the voice interaction mode of directly waking up in response to the wake-up confirmation request, by combining the wake-up confirmation request from the device to be woken up and the wake-up confirmation request of the device to be awakened. state, and together indicate whether the device to be woken wakes up in the voice interaction mode, which can help reduce the false wake-up rate.
请参阅图3,图3是本申请电子设备30一实施例的框架示意图。如图3所示,电子设备30可以包括处理器31、存储器32以及通信电路33,存储器32和通信电路33与处理器31耦接;存储器32存储有程序指令,处理器31用于执行程序指令以实现上述任一设备唤醒方法实施例中的步骤。具体地,电子设备30可以包括但不限于:电视机、NAS、机顶盒等等,在此不做限定。Please refer to FIG. 3 , which is a schematic diagram of a framework of an embodiment of an electronic device 30 of the present application. As shown in FIG. 3 , the electronic device 30 may include a processor 31, a memory 32, and a communication circuit 33. The memory 32 and the communication circuit 33 are coupled to the processor 31; the memory 32 stores program instructions, and the processor 31 is used for executing the program instructions. In order to implement the steps in any of the foregoing device wake-up method embodiments. Specifically, the electronic device 30 may include, but is not limited to, a television, a NAS, a set-top box, etc., which is not limited herein.
处理器31还可以称为CPU(Central Processing Unit,中央处理单元),处理器31可能是一种集成电路芯片,具有信号的处理能力。处理器31还可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。通用处理器可以是微处理器或者该处理器31也可以是任何常规的处理器等。The processor 31 may also be referred to as a CPU (Central Processing Unit, central processing unit), and the processor 31 may be an integrated circuit chip with signal processing capability. The processor 31 may also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. A general purpose processor may be a microprocessor or the processor 31 may be any conventional processor or the like.
本公开实施例中,处理器31用于基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态,其中,待唤醒设备的状态表示待唤醒设备是否允许唤醒;处理器31用于控制通信电路33及其自身响应于待唤醒设备发送的唤醒确认请求,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互模式。In the embodiment of the present disclosure, the processor 31 is configured to determine the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein the state of the device to be awakened indicates whether the device to be awakened is allowed to wake up; the processor 31 is configured to control The communication circuit 33 and itself, in response to the wake-up confirmation request sent by the device to be woken up, indicate whether the device to be woken up wakes up in the voice interaction mode based on the state of the device to be woken up.
上述方案,决策设备通过目标区域内的人员情况来确定位于目标区域内待唤醒设备的状态,且该状态表示待唤醒设备是允许唤醒,还是不允许唤醒,并响应于来自待唤醒设备的唤醒确认请求,基于待唤醒设备的状态,来指示待唤醒设备是否唤醒语音交互模式,由于待唤醒设备的状态是决策设备基于目标区域内的人员情况而确定,故能够有利于提高待唤醒设备的状态的准确性,即能够有利于提高确定待唤醒设备是否允许唤醒的准确性,相较于响应于唤醒确认请求直接唤醒语音交互模式而言,通过结合来自待唤醒设备的唤醒确认请求以及待唤醒设备的状态,共同指示待唤醒设备是否唤醒语音交互模式,能够有利于 降低误唤醒率。In the above solution, the decision-making device determines the state of the device to be awakened in the target area based on the situation of the people in the target area, and the state indicates whether the device to be awakened is allowed to wake up or not allowed to wake up, and responds to the wake-up confirmation from the device to be awakened Request, based on the state of the device to be awakened, to indicate whether the device to be awakened wakes up in the voice interaction mode. Since the state of the device to be awakened is determined by the decision-making device based on the situation of the people in the target area, it can help to improve the state of the device to be awakened. Accuracy, that is, it can help to improve the accuracy of determining whether the device to be woken up is allowed to wake up. Compared with the voice interaction mode of directly waking up in response to the wake-up confirmation request, by combining the wake-up confirmation request from the device to be woken up and the wake-up confirmation request of the device to be awakened. state, and together indicate whether the device to be woken wakes up in the voice interaction mode, which can help reduce the false wake-up rate.
在一些公开实施例中,目标区域的人员情况是基于云端设备发送的目标区域的人员检测信息确定的。区别于前述实施例,由云端设备确定目标区域的人员检测信息,能够将确认人员检测信息等较大运算量的工作交由云端设备执行,一来可以有效降低决策设备的运算负荷,二来也能够在云端设备部署更为精细的数学运算模型,有利于提高人员情况的准确性。In some disclosed embodiments, the personnel situation in the target area is determined based on the personnel detection information in the target area sent by the cloud device. Different from the previous embodiments, the cloud device determines the personnel detection information of the target area, and the cloud device can perform the work of large computational workload such as confirming the personnel detection information, which can effectively reduce the computational load of the decision-making device and also The ability to deploy more sophisticated mathematical operation models on cloud devices is conducive to improving the accuracy of personnel conditions.
在一些公开实施例中,处理器31用于控制通信电路33接收云端设备基于采集数据得到的目标区域的人员检测信息,其中,采集数据为采集设备对目标区域采集得到的;处理器31用于基于人员检测信息,得到目标区域的人员情况。区别于前述实施例,由云端设备获取到采集数据,并基于采集数据确定得到目标区域内的人员情况,进一步将目标区域内的人员情况发送给决策设备,以供决策设备通过目标区域的人员情况来确定待唤醒设备的状态,由于云端设备相较于决策设备往往具有更强的处理能力,使其能够运行更为复杂精确的数学模型来处理采集数据,以提高人员情况的准确性,从而能够有利于提高确定得到的待唤醒设备的状态的准确性,并降低决策设备的处理负荷。In some disclosed embodiments, the processor 31 is configured to control the communication circuit 33 to receive the person detection information of the target area obtained by the cloud device based on the collected data, wherein the collected data is obtained by the collection device from the target area; the processor 31 is configured to Based on the personnel detection information, the personnel situation in the target area is obtained. Different from the foregoing embodiments, the collection data is acquired by the cloud device, and based on the collected data, the situation of people in the target area is determined, and the situation of people in the target area is further sent to the decision-making device for the decision-making device to pass through the target area. To determine the state of the device to be woken up, because the cloud device often has stronger processing power than the decision-making device, it can run a more complex and accurate mathematical model to process the collected data, so as to improve the accuracy of the personnel situation, so as to be able to It is beneficial to improve the accuracy of determining the obtained state of the device to be woken up, and reduce the processing load of the decision-making device.
在一些公开实施例中,采集设备包括门开关感应设备、图像采集设备和目标感应设备中的至少一种,采集数据包括门开关感应设备采集到的进出门数据、图像采集设备采集到的图像数据、目标感应设备的感应数据中的至少一者。区别于前述实施例,采集设备包括门开关感应设备、图像采集设备和目标感应设备中的至少一者,且采集数据包括门开关感应设备采集到的进出门数据、图像采集设备采集到的图像数据、目标感应设备的感应数据中的至少一者,故能够有利于融合多模态的采集数据来确定人员情况,从而能够有利于进一步提高人员情况的准确性。In some disclosed embodiments, the collecting device includes at least one of a door switch sensing device, an image collecting device, and a target sensing device, and the collected data includes access and door data collected by the door switch sensing device, and image data collected by the image collecting device and at least one of sensing data of the target sensing device. Different from the foregoing embodiments, the collection device includes at least one of a door switch sensing device, an image collection device, and a target sensing device, and the collected data includes entry and exit data collected by the door switch sensing device, and image data collected by the image collection device. , at least one of the sensing data of the target sensing device, so it can be beneficial to integrate multi-modal acquisition data to determine the personnel situation, thereby further improving the accuracy of the personnel situation.
在一些公开实施例中,目标区域的人员检测信息包括以下至少一者:基于进出门数据,而得到的门开关感应设备对应的人员检测信息;基于图像数据的人像检测结果,而得到的图像采集设备对应的人员检测信息;基于感应数据,而得到的目标感应设备对应的人员检测信息。区别于前述实施例,目标区域的人员检测信息包括门开关感应设备相对应的人员检测信息、图像采集设备相对应的人员检测信息以及目标感应设备相对应的人员检测信息中的至少一者,即能够基于不同模态的采集数据,进而有利于基于多模态采集数据得到人员检测信息,有利于提高人员情况的准确性。In some disclosed embodiments, the person detection information of the target area includes at least one of the following: the person detection information corresponding to the door switch sensing device obtained based on the entry and exit data; the image acquisition result obtained based on the portrait detection result of the image data Person detection information corresponding to the device; based on the sensing data, the personnel detection information corresponding to the target sensing device is obtained. Different from the foregoing embodiments, the personnel detection information of the target area includes at least one of personnel detection information corresponding to the door switch sensing device, personnel detection information corresponding to the image acquisition device, and personnel detection information corresponding to the target sensing device, that is, It is possible to collect data based on different modalities, which is beneficial to obtain personnel detection information based on the multimodal acquisition data, and is beneficial to improve the accuracy of personnel conditions.
在一些公开实施例中,门开关感应设备对应的人员检测信息包括:有人回来状态和有人离开状态,有人回来状态是云端设备接收到门开关感应设备采集到的进门数据而生成的,有人离开状态是云端设备接收到门开关感应设备采集到的出门数据而生成的,处理器31用于在采集设备包括门开关感应设备的情况下,比较有人回来状态和有人离开状态的生成次数,基于比较结果确定目标区域是否有人。区别于前述实施例,云端设备接收到进门数据就生成有人回来状态,而接收到出门数据就生成有人离开状态,在此基础上,再比较有人回来状态以及有人离开状态两者的生成次数,并基于比较结果来确定目标区域是否有人,能够有利于提高确定目标区域是否有人的准确性。In some disclosed embodiments, the person detection information corresponding to the door switch sensing device includes: someone coming back state and someone leaving state, the someone coming back state is generated by the cloud device receiving the door entry data collected by the door switch sensing device, and the someone leaving state It is generated by the cloud device receiving the exit data collected by the door switch sensing device. The processor 31 is used to compare the generation times of the person returning state and the person leaving state when the collection device includes the door switch sensing device, based on the comparison result. Determine if the target area is occupied. Different from the previous embodiment, the cloud device generates the status of someone coming back when it receives the entry data, and generates the status that someone leaves when it receives the data going out. Determining whether there is a person in the target area based on the comparison result can help to improve the accuracy of determining whether there is a person in the target area.
在一些公开实施例中,处理器31用于在目标区域有人的情况下,将待唤醒设备的状态确定为允许唤醒状态;处理器31用于在目标区域无人的情况下,将待唤醒设备的状态确定为禁止唤醒状态。区别于前述实施例,若目标区域有人,将待唤醒设备的状态相应地确定成允许唤醒状态,而若目标区域无人,将待唤醒设备的状态相应地确定成禁止唤醒状态,能够有利于降低误唤醒率。In some disclosed embodiments, the processor 31 is configured to determine the state of the device to be woken up as a state allowing wake-up when there are people in the target area; the processor 31 is configured to set the device to be woken up when there is no one in the target area The state is determined to be the wake-up disabled state. Different from the foregoing embodiments, if there is a person in the target area, the state of the device to be awakened is determined to be in the wake-up allowed state accordingly, and if there is no one in the target area, the state of the device to be awakened is determined to be in the state of prohibition of wake-up accordingly, which can help reduce the false wake rate.
在一些公开实施例中,处理器31用于在待唤醒设备的状态为允许唤醒状态的情况下,指示待唤醒设备执行唤醒语音交互模式;处理器31用于在待唤醒设备的状态为禁止唤醒状态的情况下,指示待唤醒设备不执行唤醒语音交互模式。区别于前述实施例,若待唤醒设备确定成允许唤醒状态,则指示待唤醒设备去执行上述唤醒语音交互模式,而若待唤醒设备确定成为禁止唤醒状态,则指示待唤醒设备不去执行上述唤醒语音交互模式,故能够 有利于降低误唤醒率。In some disclosed embodiments, the processor 31 is configured to instruct the device to be woken up to execute the wake-up voice interaction mode when the state of the device to be woken up is the wake-up enabled state; the processor 31 is configured to instruct the device to be woken up to prohibit wake-up in the state of the device to be woken up. In the case of the state, it indicates that the device to be woken up does not execute the wake-up voice interaction mode. Different from the foregoing embodiments, if the device to be awakened is determined to be in the wake-up allowed state, the device to be awakened is instructed to execute the above-mentioned wake-up voice interaction mode, and if the device to be awakened is determined to be in the wake-up-prohibited state, the device to be awakened is instructed not to perform the above-mentioned wake-up. Voice interaction mode, so it can help to reduce the false wake-up rate.
在一些公开实施例中,唤醒确认请求是待唤醒设备采集到音频数据并检测到音频数据包含预设词语的情况下生成的,处理器31用于在待唤醒设备的状态为允许唤醒状态的情况下,对唤醒确认请求包含的音频数据进行检测;处理器31用于在检测到音频数据包含预设词语的情况下,指示待唤醒设备执行唤醒语音交互模式。区别于前述实施例,在采集到音频数据且也检测到音频数据含有预设词语的情况下,待唤醒设备生成唤醒确认请求,且唤醒确认请求含有音频数据,并进一步由决策设备对该音频数据进行二次检测,并在二次检测也确定含有预设词语的情况下,决策设备指示待唤醒设备去执行唤醒语音交互模式,从而能够有利于降低对音频数据内预设词语的误检率,进而能够有利于进一步降低误唤醒率。In some disclosed embodiments, the wake-up confirmation request is generated when the to-be-awakened device collects audio data and detects that the audio data contains preset words, and the processor 31 is configured to use the processor 31 when the state of the to-be-awakened device is the wake-up allowed state Next, the audio data included in the wake-up confirmation request is detected; the processor 31 is configured to instruct the device to be woken up to execute the wake-up voice interaction mode when it is detected that the audio data includes a preset word. Different from the foregoing embodiments, when audio data is collected and it is also detected that the audio data contains preset words, the device to be woken up generates a wake-up confirmation request, and the wake-up confirmation request contains audio data, and the decision-making device further determines the audio data. Perform secondary detection, and in the case where the secondary detection also determines that the preset words are contained, the decision-making device instructs the device to be awakened to execute the wake-up voice interaction mode, which can help reduce the false detection rate of preset words in the audio data, This can further reduce the false wake-up rate.
请参阅图4,图4是本申请计算机可读存储介质40一实施例的框架示意图。计算机可读存储介质40存储有能够被处理器运行的程序指令41,程序指令41用于实现上述任一设备唤醒方法实施例中的步骤。Please refer to FIG. 4 , which is a schematic diagram of a framework of an embodiment of a computer-readable storage medium 40 of the present application. The computer-readable storage medium 40 stores program instructions 41 that can be executed by the processor, and the program instructions 41 are used to implement the steps in any of the foregoing embodiments of the device wake-up method.
上述方案,能够降低误唤醒率。The above solution can reduce the false wake-up rate.
该存储装置具体可以为U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等可以存储程序指令的介质,或者也可以为存储有该程序指令的服务器,该服务器可将存储的程序指令发送给其他设备运行,或者也可以自运行该存储的程序指令。Specifically, the storage device may be a medium that can store program instructions, such as a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, or also It can be a server that stores the program instructions, and the server can send the stored program instructions to other devices for running, or can also run the stored program instructions by itself.
此外,本申请还提供一种设备唤醒装置,包括状态确定模块和模式指示模块,状态确定模块被配置用于供决策设备基于目标区域的人员情况,确定目标区域中的待唤醒设备的状态,其中,待唤醒设备的状态表示待唤醒设备是否允许唤醒;模式指示模块被配置用于响应于待唤醒设备发送的唤醒确认请求,基于待唤醒设备的状态,指示待唤醒设备是否唤醒语音交互模式。In addition, the present application also provides a device wake-up device, comprising a state determination module and a mode indication module, the state determination module is configured for the decision-making device to determine the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein , the state of the device to be awakened indicates whether the device to be awakened is allowed to wake up; the mode indicating module is configured to indicate whether the device to be awakened wakes up in the voice interaction mode based on the state of the device to be awakened in response to a wakeup confirmation request sent by the device to be awakened.
在一些公开实施例中,目标区域的人员情况是基于云端设备发送的目标区域的人员检测信息确定的。In some disclosed embodiments, the personnel situation in the target area is determined based on the personnel detection information in the target area sent by the cloud device.
在一些公开实施例中,设备唤醒装置还包括信息接收模块,被配置用于接收云端设备基于采集数据得到的目标区域的人员检测信息,其中,采集数据为采集设备对目标区域采集得到的;设备唤醒装置还包括人员分析模块,被配置用于基于人员检测信息,得到目标区域的人员情况。In some disclosed embodiments, the device wake-up device further includes an information receiving module configured to receive personnel detection information of the target area obtained by the cloud device based on the collected data, wherein the collected data is obtained by the collection device from the target area; the device The wake-up device further includes a personnel analysis module, which is configured to obtain the personnel situation in the target area based on the personnel detection information.
在一些公开实施例中,采集设备包括门开关感应设备、图像采集设备和目标感应设备中的至少一种,采集数据包括门开关感应设备采集到的进出门数据、图像采集设备采集到的图像数据、目标感应设备的感应数据中的至少一者。In some disclosed embodiments, the collecting device includes at least one of a door switch sensing device, an image collecting device, and a target sensing device, and the collected data includes access and door data collected by the door switch sensing device, and image data collected by the image collecting device and at least one of sensing data of the target sensing device.
在一些公开实施例中,目标区域的人员检测信息包括以下至少一者:基于进出门数据,而得到的门开关感应设备对应的人员检测信息;基于图像数据的人像检测结果,而得到的图像采集设备对应的人员检测信息;基于感应数据,而得到的目标感应设备对应的人员检测信息。In some disclosed embodiments, the person detection information of the target area includes at least one of the following: the person detection information corresponding to the door switch sensing device obtained based on the entry and exit data; the image acquisition result obtained based on the portrait detection result of the image data Person detection information corresponding to the device; based on the sensing data, the personnel detection information corresponding to the target sensing device is obtained.
在一些公开实施例中,门开关感应设备对应的人员检测信息包括:有人回来状态和有人离开状态,有人回来状态是云端设备接收到门开关感应设备采集到的进门数据而生成的,有人离开状态是云端设备接收到门开关感应设备采集到的出门数据而生成的;人员分析模块具体被配置用于在采集设备包括门开关感应设备的情况下,利用有人回来状态和有人离开状态的生成次数,基于比较结果确定目标区域是否有人。In some disclosed embodiments, the person detection information corresponding to the door switch sensing device includes: someone coming back state and someone leaving state, the someone coming back state is generated by the cloud device receiving the door entry data collected by the door switch sensing device, and the someone leaving state It is generated by the cloud device receiving the exit data collected by the door switch sensing device; the personnel analysis module is specifically configured to use the generation times of the state of someone returning and the state of leaving when the collection device includes the door switch sensing device. Determines whether the target area is occupied based on the comparison result.
在一些公开实施例中,状态确定模块包括第一确定子模块,被配置用于在目标区域有人的情况下,将待唤醒设备的状态确定为允许唤醒状态;状态确定模块包括第二确定子模块,被配置用于在目标区域无人的情况下,将待唤醒设备的状态确定为禁止唤醒状态。In some disclosed embodiments, the state determination module includes a first determination sub-module configured to determine the state of the device to be woken up as a wake-up allowed state when there are people in the target area; the state determination module includes a second determination sub-module , which is configured to determine the state of the device to be woken up as a wakeup-inhibiting state when there is no one in the target area.
在一些公开实施例中,模式指示模块包括第一指示子模块,被配置用于在待唤醒设备的状态为允许唤醒状态的情况下,指示待唤醒设备执行唤醒语音交互模式;模式指示模块 包括第二指示子模块,被配置用于在待唤醒设备的状态为禁止唤醒状态的情况下,指示待唤醒设备不执行唤醒语音交互模式。In some disclosed embodiments, the mode indicating module includes a first indicating sub-module configured to instruct the device to be woken up to execute a wake-up voice interaction mode when the state of the device to be woken up is a state allowing wake-up; the mode indicating module includes a first The second instructing submodule is configured to instruct the device to be woken up not to perform the wake-up voice interaction mode when the state of the device to be woken up is the wake-up prohibited state.
在一些公开实施例中,唤醒确认请求是待唤醒设备采集到音频数据并检测到音频数据包含预设词语的情况下生成的;第一指示子模块包括音频检测单元,被配置用于在待唤醒设备的状态为允许唤醒状态的情况下,对唤醒确认请求包含的音频数据进行检测;第一指示子模块包括唤醒指示单元,被配置用于在检测到音频数据包含预设词语的情况下,指示待唤醒设备执行唤醒语音交互模式。In some disclosed embodiments, the wake-up confirmation request is generated when the device to be woken up collects audio data and detects that the audio data contains preset words; the first indication sub-module includes an audio detection unit configured to be woken up when the device is to wake up. When the state of the device is the wake-up allowed state, the audio data contained in the wake-up confirmation request is detected; the first indication sub-module includes a wake-up indication unit, which is configured to indicate that the audio data contains a preset word when it is detected. The device to be woken up executes the wake-up voice interaction mode.
在一些公开实施例中,决策设备包括以下至少一种特征:决策设备位于目标区域中,决策设备的处理能力强于待唤醒设备;和/或,决策设备与待唤醒设备采用短程无线通信方式进行通信或者连接在同一局域网;和/或,目标区域为家庭区域。In some disclosed embodiments, the decision-making device includes at least one of the following features: the decision-making device is located in the target area, and the processing capability of the decision-making device is stronger than that of the device to be awakened; and/or, the decision-making device and the device to be awakened use short-range wireless communication for communication The communication is either connected on the same local area network; and/or the target area is a home area.
此外,本申请还提供一种计算机程序产品,其在终端设备上运行时,使得终端设备执行上述任一设备唤醒方法实施例中步骤。在本申请实施例中,不限定计算机程序产品的具体实现形态。示例性地,计算机程序产品可以实现为智能冰箱应用程序,并可以通过出厂预装或用户自定义等方式安装于智能冰箱,从而智能冰箱可以作为决策设备与家庭区域中诸如智能门锁、摄像头等智能设备联动,执行上述任一设备唤醒方法实施例中步骤。其他情况可以以此类推,在此不再一一举例。In addition, the present application also provides a computer program product, which, when running on a terminal device, enables the terminal device to execute the steps in any of the foregoing device wake-up method embodiments. In the embodiments of the present application, the specific implementation form of the computer program product is not limited. Exemplarily, the computer program product can be implemented as a smart refrigerator application program, and can be installed in the smart refrigerator through factory pre-installation or user customization, so that the smart refrigerator can be used as a decision-making device and a home area such as smart door locks, cameras, etc. The smart devices are linked to perform the steps in any of the above-mentioned device wake-up method embodiments. Other situations can be deduced by analogy, and no examples are given here.
在本申请所提供的几个实施例中,应该理解到,所揭露的方法和装置,可以通过其它的方式实现。如,以上所描述的装置实施方式仅仅是示意性的,如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed method and apparatus may be implemented in other manners. For example, the device implementations described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other divisions. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施方式方案的目的。Units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this implementation manner.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器(processor)执行本申请各个实施方式方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented as a software functional unit and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the methods of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .
以上所述仅为本申请的实施方式,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above description is only an embodiment of the present application, and is not intended to limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied to other related technologies Fields are similarly included within the scope of patent protection of this application.
Claims (17)
- 一种设备唤醒方法,其特征在于,包括:A device wake-up method, comprising:决策设备基于目标区域的人员情况,确定所述目标区域中的待唤醒设备的状态,其中,所述待唤醒设备的状态表示所述待唤醒设备是否允许唤醒;The decision-making device determines the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein the state of the device to be awakened indicates whether the device to be awakened is allowed to wake up;响应于所述待唤醒设备发送的唤醒确认请求,基于所述待唤醒设备的状态,指示所述待唤醒设备是否唤醒语音交互模式。In response to the wake-up confirmation request sent by the device to be woken up, based on the state of the device to be woken up, it is indicated whether the device to be woken up wakes up in the voice interaction mode.
- 根据权利要求1所述的方法,其特征在于,所述目标区域的人员情况是基于云端设备发送的所述目标区域的人员检测信息确定的。The method according to claim 1, wherein the personnel situation in the target area is determined based on personnel detection information in the target area sent by a cloud device.
- 根据权利要求2所述的方法,其特征在于,在所述基于目标区域的人员情况,确定所述目标区域中的待唤醒设备的状态之前,所述方法还包括:The method according to claim 2, wherein before determining the state of the device to be awakened in the target area based on the personnel situation in the target area, the method further comprises:接收云端设备基于采集数据得到的所述目标区域的人员检测信息,其中,所述采集数据为采集设备对目标区域采集得到的;Receiving the personnel detection information of the target area obtained by the cloud device based on the collected data, wherein the collected data is obtained by the collection device from the target area;基于所述人员检测信息,得到所述目标区域的人员情况。Based on the personnel detection information, the personnel situation in the target area is obtained.
- 根据权利要求3所述的方法,其特征在于,所述采集设备包括门开关感应设备、图像采集设备和目标感应设备中的至少一种,所述采集数据包括所述门开关感应设备采集到的进出门数据、所述图像采集设备采集到的图像数据、所述目标感应设备的感应数据中的至少一者。The method according to claim 3, wherein the collecting device comprises at least one of a door switch sensing device, an image collecting device and a target sensing device, and the collected data includes data collected by the door switch sensing device. At least one of entry and exit data, image data collected by the image collection device, and sensing data of the target sensing device.
- 根据权利要求4所述的方法,其特征在于,所述目标区域的人员检测信息包括以下至少一者:The method according to claim 4, wherein the person detection information of the target area includes at least one of the following:基于所述进出门数据,而得到的所述门开关感应设备对应的人员检测信息;Person detection information corresponding to the door switch sensing device obtained based on the entry and exit data;基于所述图像数据的人像检测结果,而得到的所述图像采集设备对应的人员检测信息;Person detection information corresponding to the image acquisition device obtained based on the portrait detection result of the image data;基于所述感应数据,而得到的所述目标感应设备对应的人员检测信息。Person detection information corresponding to the target sensing device is obtained based on the sensing data.
- 根据权利要求5所述的方法,其特征在于,所述门开关感应设备对应的人员检测信息包括:有人回来状态和有人离开状态,所述有人回来状态是所述云端设备接收到所述门开关感应设备采集到的进门数据而生成的,所述有人离开状态是所述云端设备接收到所述门开关感应设备采集到的出门数据而生成的;The method according to claim 5, wherein the person detection information corresponding to the door switch sensing device comprises: a person returning state and a person leaving state, and the person returning state is that the cloud device receives the door switch generated by the door entry data collected by the sensing device, and the person leaving state is generated by the cloud device receiving the exit data collected by the door switch sensing device;所述基于所述人员检测信息,得到所述目标区域的人员情况,包括:The obtaining of the personnel situation in the target area based on the personnel detection information includes:在所述采集设备包括门开关感应设备的情况下,利用所述有人回来状态和有人离开状态的生成次数,基于比较结果确定所述目标区域是否有人。In the case where the collection device includes a door switch sensing device, whether there is a person in the target area is determined based on the comparison result by using the generation times of the person returning state and the person leaving state.
- 根据权利要求1至6任一项所述的方法,其特征在于,所述基于目标区域的人员情况,确定所述目标区域中的待唤醒设备的状态,包括:The method according to any one of claims 1 to 6, wherein the determining the state of the device to be awakened in the target area based on the personnel situation in the target area comprises:在所述目标区域有人的情况下,将所述待唤醒设备的状态确定为允许唤醒状态;In the case that there is a person in the target area, determining the state of the device to be woken up as a wake-up allowed state;在所述目标区域无人的情况下,将所述待唤醒设备的状态确定为禁止唤醒状态。In the case that there is no one in the target area, the state of the device to be woken up is determined to be a wake-up prohibited state.
- 根据权利要求1至7任一项所述的方法,其特征在于,所述基于所述待唤醒设备的状态,指示所述待唤醒设备是否唤醒语音交互模式,包括:The method according to any one of claims 1 to 7, wherein the indicating whether the device to be awakened wakes up the voice interaction mode based on the state of the device to be awakened comprises:在所述待唤醒设备的状态为允许唤醒状态的情况下,指示所述待唤醒设备执行唤醒所述语音交互模式;In the case that the state of the device to be woken up is a wake-up allowed state, instructing the device to be woken up to execute the wake-up voice interaction mode;在所述待唤醒设备的状态为禁止唤醒状态的情况下,指示所述待唤醒设备不执行唤醒所述语音交互模式。In the case that the state of the device to be woken up is a wakeup-prohibited state, the device to be woken up is instructed not to wake up the voice interaction mode.
- 根据权利要求8所述的方法,其特征在于,所述唤醒确认请求是所述待唤醒设备采集到音频数据并检测到所述音频数据包含预设词语的情况下生成的;The method according to claim 8, wherein the wake-up confirmation request is generated when the device to be woken up collects audio data and detects that the audio data contains preset words;所述在所述待唤醒设备的状态为允许唤醒状态的情况下,指示所述待唤醒设备执行唤醒所述语音交互模式,包括:The instructing the device to be woken up to execute the wake-up voice interaction mode when the state of the device to be woken up is a wake-up allowed state, including:在所述待唤醒设备的状态为允许唤醒状态的情况下,对所述唤醒确认请求包含的所述音频数据进行检测;In the case that the state of the device to be woken up is a state of allowing wake-up, detecting the audio data included in the wake-up confirmation request;在检测到所述音频数据包含所述预设词语的情况下,指示所述待唤醒设备执行唤醒所 述语音交互模式。In the case that it is detected that the audio data contains the preset word, the device to be woken up is instructed to perform waking up the voice interaction mode.
- 根据权利要求1至9任一项所述的方法,其特征在于,所述决策设备包括以下至少一种特征:所述决策设备位于所述目标区域中,所述决策设备的处理能力强于所述待唤醒设备;The method according to any one of claims 1 to 9, wherein the decision-making device includes at least one of the following features: the decision-making device is located in the target area, and the decision-making device has a stronger processing capability than the decision-making device. Describe the device to be woken up;和/或,所述决策设备与所述待唤醒设备采用短程无线通信方式进行通信或者连接在同一局域网;And/or, the decision-making device and the device to be woken up communicate by means of short-range wireless communication or are connected in the same local area network;和/或,所述目标区域为家庭区域。And/or, the target area is a home area.
- 一种设备唤醒装置,其特征在于,包括:A device wake-up device, characterized in that it includes:状态确定模块,被配置用于供决策设备基于目标区域的人员情况,确定所述目标区域中的待唤醒设备的状态,其中,所述待唤醒设备的状态表示所述待唤醒设备是否允许唤醒;a state determination module, configured for the decision-making device to determine the state of the device to be awakened in the target area based on the personnel situation in the target area, wherein the state of the device to be awakened indicates whether the device to be awakened is allowed to wake up;模式指示模块,被配置用于响应于所述待唤醒设备发送的唤醒确认请求,基于所述待唤醒设备的状态,指示所述待唤醒设备是否唤醒语音交互模式。The mode indicating module is configured to, in response to the wake-up confirmation request sent by the device to be woken up, indicate whether the device to be woken up wakes up in the voice interaction mode based on the state of the device to be woken up.
- 一种电子设备,其特征在于,包括处理器、存储器和通信电路,存储器和通信电路耦接至处理器;存储器存储有程序指令,处理器用于执行程序指令以实现权利要求1至10任一项所述的设备唤醒方法。An electronic device, characterized in that it comprises a processor, a memory and a communication circuit, wherein the memory and the communication circuit are coupled to the processor; the memory stores program instructions, and the processor is used to execute the program instructions to realize any one of claims 1 to 10 The device wake-up method.
- 一种计算机可读存储介质,其特征在于,存储有能够被处理器运行的程序指令,程序指令用于实现权利要求1至10任一项所述的设备唤醒方法。A computer-readable storage medium, characterized in that it stores program instructions that can be executed by a processor, and the program instructions are used to implement the device wake-up method according to any one of claims 1 to 10.
- 一种设备唤醒系统,其特征在于,包括相互连接的决策设备和待唤醒设备,其中,所述决策设备为权利要求12所述的电子设备,所述待唤醒设备位于目标区域中,且能够在唤醒语音交互模式的情况下,执行在所述目标区域接收到语音指令。A device wake-up system, characterized in that it includes a decision-making device and a device to be woken up that are connected to each other, wherein the decision-making device is the electronic device according to claim 12, and the device to be woken up is located in a target area and can be In the case of waking up the voice interaction mode, execute the voice command received in the target area.
- 根据权利要求14所述的系统,其特征在于,还包括连接所述决策设备的云端设备,所述云端设备用于向所述决策设备发送所述目标区域的人员检测信息,所述人员检测信息用于确定人员情况。The system according to claim 14, further comprising a cloud device connected to the decision-making device, wherein the cloud device is configured to send the personnel detection information of the target area to the decision-making device, the personnel detection information Used to determine personnel status.
- 根据权利要求15所述的系统,其特征在于,还包括位于所述目标区域的采集设备,所述采集设备与所述云端设备连接,用于获得所述目标区域的采集数据,并将所述采集设备发送给所述云端设备;所述云端设备用于基于所述采集数据确定所述目标区域的人员检测信息。The system according to claim 15, further comprising a collection device located in the target area, the collection device is connected to the cloud device, and is used to obtain the collection data of the target area, and the The collection device is sent to the cloud device; the cloud device is configured to determine the personnel detection information of the target area based on the collected data.
- 一种计算机程序产品,其特征在于,所述计算机程序产品在终端设备上运行时,使得所述终端设备执行权利要求1至10任一项所述的设备唤醒方法。A computer program product, characterized in that, when the computer program product runs on a terminal device, the terminal device is made to execute the device wake-up method according to any one of claims 1 to 10.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110441264.0 | 2021-04-23 | ||
CN202110441264.0A CN114678016A (en) | 2021-04-23 | 2021-04-23 | Device wake-up method and system, electronic device and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022222847A1 true WO2022222847A1 (en) | 2022-10-27 |
Family
ID=82070557
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/086914 WO2022222847A1 (en) | 2021-04-23 | 2022-04-14 | Device wake-up method and system, electronic device, and storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN114678016A (en) |
WO (1) | WO2022222847A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115457955B (en) * | 2022-07-29 | 2024-10-22 | 青岛海尔科技有限公司 | Decision method and device for distributed wakeup, storage medium and electronic device |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106842356A (en) * | 2017-01-17 | 2017-06-13 | 云丁网络技术(北京)有限公司 | There is nobody detection method and its detecting system a kind of interior |
CN106940530A (en) * | 2017-03-14 | 2017-07-11 | 胡渐佳 | appliance control system based on intelligent door lock |
CN107291451A (en) * | 2017-05-25 | 2017-10-24 | 深圳市冠旭电子股份有限公司 | Voice awakening method and device |
CN108231079A (en) * | 2018-02-01 | 2018-06-29 | 北京百度网讯科技有限公司 | For the method, apparatus, equipment and computer readable storage medium of control electronics |
CN109871238A (en) * | 2019-01-02 | 2019-06-11 | 百度在线网络技术(北京)有限公司 | Voice interactive method, device and storage medium |
CN109920420A (en) * | 2019-03-08 | 2019-06-21 | 四川长虹电器股份有限公司 | A kind of voice wake-up system based on environment measuring |
KR20210011146A (en) * | 2019-07-22 | 2021-02-01 | 이동욱 | Apparatus for providing a service based on a non-voice wake-up signal and method thereof |
CN112634894A (en) * | 2020-12-25 | 2021-04-09 | 苏州思必驰信息科技有限公司 | Awakening method, awakening device and terminal |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11035940B2 (en) * | 2015-07-17 | 2021-06-15 | Origin Wireless, Inc. | Method, apparatus, and system for wireless proximity and presence monitoring |
CN104811595A (en) * | 2015-04-08 | 2015-07-29 | 合肥君正科技有限公司 | Network monitor camera and working method thereof |
CN106301866B (en) * | 2015-05-12 | 2020-07-10 | 杭州海康威视数字技术股份有限公司 | Target object statistical method and device |
CN106603969A (en) * | 2016-11-04 | 2017-04-26 | 乐视控股(北京)有限公司 | Video monitoring method, device and system and detection device |
CN111199211A (en) * | 2019-12-31 | 2020-05-26 | 武汉星巡智能科技有限公司 | Intelligent monitoring equipment with infrared awakening function, monitoring method and storage medium |
CN111626593A (en) * | 2020-05-26 | 2020-09-04 | 上海明略人工智能(集团)有限公司 | Personnel detection method and system |
CN112420051A (en) * | 2020-11-18 | 2021-02-26 | 青岛海尔科技有限公司 | Equipment determination method, device and storage medium |
CN112634897B (en) * | 2020-12-31 | 2022-10-28 | 青岛海尔科技有限公司 | Equipment awakening method and device, storage medium and electronic device |
-
2021
- 2021-04-23 CN CN202110441264.0A patent/CN114678016A/en active Pending
-
2022
- 2022-04-14 WO PCT/CN2022/086914 patent/WO2022222847A1/en active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106842356A (en) * | 2017-01-17 | 2017-06-13 | 云丁网络技术(北京)有限公司 | There is nobody detection method and its detecting system a kind of interior |
CN106940530A (en) * | 2017-03-14 | 2017-07-11 | 胡渐佳 | appliance control system based on intelligent door lock |
CN107291451A (en) * | 2017-05-25 | 2017-10-24 | 深圳市冠旭电子股份有限公司 | Voice awakening method and device |
CN108231079A (en) * | 2018-02-01 | 2018-06-29 | 北京百度网讯科技有限公司 | For the method, apparatus, equipment and computer readable storage medium of control electronics |
CN109871238A (en) * | 2019-01-02 | 2019-06-11 | 百度在线网络技术(北京)有限公司 | Voice interactive method, device and storage medium |
CN109920420A (en) * | 2019-03-08 | 2019-06-21 | 四川长虹电器股份有限公司 | A kind of voice wake-up system based on environment measuring |
KR20210011146A (en) * | 2019-07-22 | 2021-02-01 | 이동욱 | Apparatus for providing a service based on a non-voice wake-up signal and method thereof |
CN112634894A (en) * | 2020-12-25 | 2021-04-09 | 苏州思必驰信息科技有限公司 | Awakening method, awakening device and terminal |
Also Published As
Publication number | Publication date |
---|---|
CN114678016A (en) | 2022-06-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11132881B2 (en) | Electronic devices capable of communicating over multiple networks | |
US10615995B2 (en) | Smart panel device and method | |
US9990788B2 (en) | Systems and methods for anticipatory locking and unlocking of a smart-sensor door lock | |
US10047971B2 (en) | Home automation system | |
US10481561B2 (en) | Managing home automation system based on behavior | |
US10593174B1 (en) | Automatic setup mode after disconnect from a network | |
US20150138353A1 (en) | Smart doorbell with energy saving method | |
US11240474B1 (en) | Reporting connectivity problems for electronic devices | |
US10380854B1 (en) | Automated smart doorbell device and method | |
CN107993656A (en) | Speech identifying function awakening method and device | |
US20240249575A1 (en) | Electronic lock, system, and take over lock module, and method of managing the same | |
WO2022222847A1 (en) | Device wake-up method and system, electronic device, and storage medium | |
CN111552189A (en) | Method for starting scene mode, intelligent home controller and storage medium | |
US11546951B1 (en) | Touchless setup mode initiation for networked devices | |
CN109976184A (en) | A kind of smart home system based on wireless sensor network | |
US11032128B2 (en) | Using a local hub device as a substitute for an unavailable backend device | |
CN216211205U (en) | Household intelligent security system based on Internet of things | |
US11032762B1 (en) | Saving power by spoofing a device | |
CN207946900U (en) | A kind of anti-theft alarm system of Internet of Things multi-Source Events Fusion processing | |
CA3104823A1 (en) | Network activity validation | |
CN106485859A (en) | A kind of home security control system | |
Mahammad et al. | An Efficient Home Automation and Security System using Arduino and 1-Sheffield | |
CN111311786A (en) | Intelligent door lock system and intelligent door lock control method thereof | |
CN213876864U (en) | System for intelligence lock is long-range unblanked | |
TWI626807B (en) | Indoor electrical control system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22790955 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22790955 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22790955 Country of ref document: EP Kind code of ref document: A1 |