CN113870856A - Public place digital people defense false wake-up method, related device and storage medium - Google Patents
Public place digital people defense false wake-up method, related device and storage medium Download PDFInfo
- Publication number
- CN113870856A CN113870856A CN202111212386.9A CN202111212386A CN113870856A CN 113870856 A CN113870856 A CN 113870856A CN 202111212386 A CN202111212386 A CN 202111212386A CN 113870856 A CN113870856 A CN 113870856A
- Authority
- CN
- China
- Prior art keywords
- information
- awakening
- wake
- digital
- living body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 84
- 230000007123 defense Effects 0.000 title claims abstract description 41
- 230000002452 interceptive effect Effects 0.000 claims description 76
- 230000004044 response Effects 0.000 claims description 74
- 238000004891 communication Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 6
- 230000003213 activating effect Effects 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 35
- 238000005265 energy consumption Methods 0.000 abstract description 9
- 230000002618 waking effect Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 4
- 230000037007 arousal Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000009223 counseling Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/02—Feature extraction for speech recognition; Selection of recognition unit
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a digital people defense false wake-up method in public places, a related device and a storage medium, wherein the method comprises the following steps: collecting audio information and living body face information in real time; judging whether the preliminary awakening information and the deep awakening information are collected in sequence or not based on the audio information, and judging whether the living body face information is detected or not; if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected, controlling the digital person to awaken; the digital person is controlled to wake up only after the conditions are respectively met, and in addition, the deep wake-up information is wake-up inquiry information output after the initial wake-up information is acquired and corresponding wake-up determination information; that is, after the preliminary wake-up information is obtained, a question and answer process with the user is required to confirm the requirement of the user for waking up the digital person; the user is not awakened by audio or face images in a unilateral mode, so that the false awakening rate is reduced, and the energy consumption of the digital person is reduced.
Description
Technical Field
The invention belongs to the technical field of artificial intelligence, and particularly relates to a digital people defense false wake-up method in a public place, a related device and a storage medium.
Background
With the continuous progress of scientific technology and the continuous development of digital human technology, digital people gradually enter thousands of households, and a plurality of digital people appear in the market, so that convenience and fun are brought to the life of people.
With the development of social productivity and the improvement of living standard, people have used more and more time for leisure and entertainment, thereby greatly promoting the development of service industry. In recent years, public places such as airports and malls have seen dramatic increases in population mobility.
At present, the probability of false awakening of digital people in public places is very high only by adopting infrared human body monitoring, and only by adopting key information to awaken, because personnel communication information and broadcast information in the places are everywhere, the probability of false awakening is also very high. That is, the digital person is in the wake-up state for a long time, the false wake-up rate is large, and the energy consumption is large.
Disclosure of Invention
In view of the above, the present invention provides a method, a related apparatus and a storage medium for digital people anti-false-wake-up in public places, which are used to reduce the false-wake-up rate and reduce the energy consumption of digital people.
The application discloses in a first aspect a public place digital people air defense false awakening method, which comprises the following steps:
collecting audio information and living body face information in real time;
judging whether primary awakening information and deep awakening information are collected in sequence or not based on the audio information, and judging whether the living body face information is detected or not; the deep awakening information is awakening inquiry information output after the initial awakening information is collected, and awakening determining information corresponding to the deep awakening information;
and if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected, controlling the digital person to awaken.
Optionally, in the method for digital people defense false wake-up in public places, determining whether to sequentially acquire preliminary wake-up information and deep wake-up information based on the audio information includes:
judging whether preset awakening keyword information is acquired or not based on the audio information; the awakening keyword information is the preliminary awakening information;
if yes, starting an interactive response mode and outputting awakening inquiry information;
and judging whether awakening determination information corresponding to the awakening inquiry information is acquired or not based on the audio information.
Optionally, in the method for digital people anti-error waking in a public place, starting an interactive response mode and outputting wake-up inquiry information includes:
starting the interactive response mode;
and outputting awakening inquiry information after starting the preset duration of the interactive response mode.
Optionally, in the method for digital people defense false wake-up in public places, after the preset duration of the interactive response mode is started, the method for outputting wake-up inquiry information includes:
and if the consultation information of the user is acquired within the preset duration of starting the interactive response mode, outputting awakening inquiry information based on the consultation information.
Optionally, in the method for digital people defense false wake-up in public places, after the preset duration of the interactive response mode is started, the method for outputting wake-up inquiry information includes:
and if the consultation information of the user is not acquired within the preset duration for starting the interactive response mode, outputting preset awakening inquiry information.
Optionally, in the method for digital people anti-false wake-up in public places, controlling the digital people to wake up includes:
activating a network communication mode; and starts to pick up sound and send to the server for digital man service.
Optionally, in the method for digital people defense false wake-up in public places, determining whether the living body face information is detected includes:
judging whether the face image information is the face image information of the front of the user or not based on the face image information acquired when the living body face information is acquired in real time;
if so, determining that the living body face information is detected; if not, determining that the living body face information is not detected.
The application second aspect discloses a public place digit people's air defense mistake awakening device includes:
the acquisition module is used for acquiring audio information and living body face information in real time;
the judging module is used for judging whether primary awakening information and deep awakening information are collected in sequence or not based on the audio information and judging whether the living body face information is detected or not; the deep awakening information is awakening determining information corresponding to awakening inquiry information output after the initial awakening information is acquired;
and the awakening module is used for controlling the digital person to awaken if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected.
Optionally, in the digital people defense mistake awakening device for public places, the determining module includes:
the first judgment unit is used for judging whether preset awakening keyword information is acquired or not based on the audio information; the awakening keyword information is the preliminary awakening information;
the interactive response module is used for starting an interactive response mode and outputting awakening inquiry information if the judgment result of the judgment unit is positive;
the first judging unit is further configured to judge whether wake-up determining information corresponding to the wake-up inquiry information is acquired based on the audio information.
Optionally, in the digital people defense mistake awakening device in the public place, when the interactive response module is used to start the interactive response mode and output the awakening inquiry information, the interactive response module is specifically used to:
starting the interactive response mode;
and outputting awakening inquiry information after starting the preset duration of the interactive response mode.
Optionally, in the digital people defense mistake awakening device in the public place, the interactive response module is configured to, after starting the preset duration of the interactive response mode, specifically configured to:
and if the consultation information of the user is acquired within the preset duration of starting the interactive response mode, outputting awakening inquiry information based on the consultation information.
Optionally, in the digital people air defense false wake-up device in the public place, the interactive response module is specifically configured to, after starting the preset duration of the interactive response mode, output wake-up inquiry information:
and if the consultation information of the user is not acquired within the preset duration for starting the interactive response mode, outputting preset awakening inquiry information.
Optionally, in the above digital people mistake proofing wake-up device in a public place, the wake-up module is configured to control the digital people to wake up, and specifically configured to:
activating a network communication mode; and starts to pick up sound and send to the server for digital man service.
Optionally, in the digital people defense mistake awakening device for public places, the determining module further includes:
the second judgment unit is used for judging whether the face image information is the face image information of the front of the user or not based on the face image information acquired when the living body face information is acquired in real time;
if so, determining that the living body face information is detected; if not, determining that the living body face information is not detected.
A third aspect of the present application discloses an electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement a public space digital people guard wake-up method as described in any of the first aspects of the present application.
A fourth aspect of the present application discloses a storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method for digital personal guard against false wake-up in public places according to any of the first aspect of the present application.
According to the technical scheme, the digital people defense false wake-up method in the public place comprises the following steps: the method comprises the following steps: collecting audio information and living body face information in real time; judging whether the preliminary awakening information and the deep awakening information are collected in sequence or not based on the audio information, and judging whether the living body face information is detected or not; if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected, controlling the digital person to awaken; the digital person is controlled to wake up only after the conditions are respectively met, and in addition, the deep wake-up information is wake-up inquiry information output after the initial wake-up information is acquired and corresponding wake-up determination information; that is, after the preliminary wake-up information is obtained, a question and answer process with the user is required to confirm the requirement of the user for waking up the digital person; the user is not awakened by audio or face images in a unilateral mode, so that the false awakening rate is reduced, and the energy consumption of the digital person is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of an application environment applicable to an embodiment of the present application;
fig. 2 is a flowchart of a digital people defense false wake-up method in a public place according to an embodiment of the present invention;
FIG. 3 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 4 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 5 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 6 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 7 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 8 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 9 is a flowchart of another method for digital personal defense false wake-up in public places according to an embodiment of the present invention;
FIG. 10 is a schematic diagram of a digital personal defense false wake-up apparatus for public places according to an embodiment of the present invention;
fig. 11 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application environment suitable for the embodiment of the present application. The data processing method provided by the embodiment of the application can be applied to the interactive system 100 shown in fig. 1. The interactive system 100 comprises a terminal device 101 and a server 102, wherein the server 102 is in communication connection with the terminal device 101. The server 102 may be a conventional server or a cloud server, and is not limited herein.
The terminal device 101 may be various electronic devices that have a display screen, a data processing module, a camera, an audio input/output function, and the like, and support data input, including but not limited to a smart phone, a tablet computer, a laptop portable computer, a desktop computer, a self-service terminal, a wearable electronic device, and the like. Specifically, the data input may be inputting voice based on a voice module provided on the electronic device, inputting characters based on a character input module, and the like. Specifically, the terminal device 101 may be a digital person in the following embodiments.
The terminal device 101 may have a client application installed thereon, and the user may be based on the client application (for example, APP, wechat applet, etc.), wherein the dialog digitizer of this embodiment is also a client application configured in the terminal device 101. A user may register a user account in the server 102 based on the client application program, and communicate with the server 102 based on the user account, for example, the user logs in the user account in the client application program, inputs information through the client application program based on the user account, and may input text information or voice information, and the like, after receiving information input by the user, the client application program may send the information to the server 102, so that the server 102 may receive the information, process and store the information, and the server 102 may also receive the information and return a corresponding output information to the terminal device 101 according to the information.
In some embodiments, the apparatus for processing the data to be recognized may also be disposed on the terminal device 101, so that the terminal device 101 can interact with the user without relying on the server 102 to establish communication, and in this case, the interactive system 100 may only include the terminal device 101.
The embodiment of the application provides a public place digital civil defense false awakening method, which is used for solving the problems that in the prior art, a digital person only adopts infrared human body monitoring and has very high false awakening probability in a public place, and only adopts key information to awaken, and because personnel communication information and broadcast information in the place are everywhere, the false awakening probability is also very high. Namely, the digital person is in the awakening state for a long time, the false awakening rate is high, and the energy consumption is high.
Referring to fig. 2, the digital people defense false wake-up method in the public place comprises the following steps:
s101, collecting audio information and living body face information in real time.
It should be noted that the digital person has an acquisition device, for example, an audio collector acquires audio information, and a face collector acquires face information of a living body.
The living body face information may include a living body face image. The image may be a two-dimensional image, a three-dimensional image, an infrared image, etc., and is not particularly limited herein, and may be determined according to actual situations, which are within the scope of the present application.
S102, whether the primary awakening information and the deep awakening information are collected in sequence or not is judged based on the audio information, and whether the living body face information is detected or not is judged.
Specifically, the step S102 can be divided into two judgments; if both the two determination results are yes, it can be said that the determination result in step S102 is that the preliminary wake-up information and the deep wake-up information are sequentially acquired and the living body face information is detected.
It should be noted that the specific process of determining whether to sequentially acquire the preliminary wake-up information and the deep wake-up information based on the audio information may be: and converting the collected audio information into character information, and judging whether the character information contains the preliminary awakening information and the deep awakening information.
The deep awakening information is awakening inquiry information output after the initial awakening information is collected, and awakening determining information corresponding to the deep awakening information is obtained.
That is, after the preliminary wake-up information is collected, wake-up inquiry information is output; after the awakening inquiry information is output, whether awakening determination information corresponding to the awakening inquiry information is acquired or not is judged according to the currently acquired audio information.
This whether gather preliminary awakening information and degree of depth awakening information's specific process in proper order based on audio information judgement, no longer give unnecessary details here one by one, and it can to decide according to actual conditions, all is in the protection scope of this application.
The specific process of determining whether the living body face information is detected may be: judging whether the acquired face image meets a preset condition or not; the preset conditions may include: the face ratio of the face collected, whether the face is living body information, and the like.
The specific process of judging whether the living body face information is detected is not repeated one by one, and the specific process is determined according to actual conditions and is within the protection range of the application.
The two determination steps in step S102 are parallel, that is, they have no precedence relationship. Therefore, in step S102, when the two determination results are yes at the same time, it may be determined that the preliminary wake-up information and the deep wake-up information are sequentially collected and the living body face information is detected.
Or setting the time difference between the two judgments; specifically, if any one of the determination results is yes and the other determination result is yes within the preset time, it is determined that the preliminary wake-up information and the deep wake-up information are sequentially acquired and the living body face information is detected.
If the preliminary wake-up information and the deep wake-up information are sequentially collected and the living body face information is detected, step S103 is executed.
And S103, controlling the digital person to wake up.
It should be noted that after the digital person is awakened, the digital person can provide the corresponding service for the user.
If the user provides the consultation of the credit card transaction process to the digital person, the digital person shows the credit card transaction process to the user. Specifically, the flow can be displayed on the display of the digital person, and the audio of the credit card transaction flow can be output at the same time.
It should be noted that step S101 is acquired in real time, that is, the actions of steps S102 and S103 do not affect the execution of step S101. Similarly, since the data is collected in real time in step S101, the judgment in step S102 is also performed in real time to keep pace with the judgment in step S101, and all the collected data is judged.
In practical applications, if the preliminary wake-up information and the deep wake-up information are not sequentially collected, or the living body face information is detected, the step S103 is not executed.
In the embodiment, audio information and living body face information are collected in real time; judging whether the preliminary awakening information and the deep awakening information are collected in sequence or not based on the audio information, and judging whether the living body face information is detected or not; if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected, controlling the digital person to awaken; the digital person is controlled to wake up only after the conditions are respectively met, and in addition, the deep wake-up information is wake-up inquiry information output after the initial wake-up information is acquired and corresponding wake-up determination information; that is, after the preliminary wake-up information is obtained, a question and answer process with the user is required to confirm the requirement of the user for waking up the digital person; the user is not awakened by audio or face images in a unilateral mode, so that the false awakening rate is reduced, and the energy consumption of the digital person is reduced.
In the above embodiment, the determining whether the preliminary wake-up information and the deep wake-up information are sequentially collected based on the audio information in step S102, referring to fig. 3, includes:
s201, judging whether preset awakening keyword information is acquired or not based on the audio information.
Wherein, the awakening keyword information is preliminary awakening information.
The awakening keyword information can be the name of the digital person, such as 'little one' and the like; of course, other information may be available, and is not specifically limited herein, and all of which are within the scope of the present application as the case may be.
The wake-up key information may be multiple, such as: "one little", "you good", etc.; of course, there may be one; the method is not particularly limited, and is within the scope of the present application as appropriate.
If it is determined whether preset wakeup keyword information is collected based on the audio information, step S202 is performed.
S202, starting an interactive response mode and outputting awakening inquiry information.
It should be noted that, an interactive response module is arranged inside the digital person, and the interactive response module is controlled to start, so that the interactive response mode can be started.
The digital person may have two levels of arousal; such as preliminary arousals and deep arousals. The wake-up in step S103 is a deep wake-up.
Specifically, the digital person can comprise an acquisition module, an interactive response module and a network communication module. When the digital person is powered on, the acquisition module continuously works.
When the interactive response module is started, the digital person is in primary awakening; at the moment, the energy consumption of the digital person is larger than that of the acquisition module only when the acquisition module works.
When the network communication modules are all started, the digital person is in deep awakening; at this time, the energy consumption of the digital person is larger than that of the primary awakening.
S203, judging whether awakening determining information corresponding to the awakening inquiry information is acquired or not based on the audio information.
That is, in the interactive response mode, the digital person can interact with the user to determine whether deep wake-up is required by inquiring and receiving the response of the user.
It should be noted that, if the corresponding wake-up determination information is acquired within the first time period after the wake-up inquiry information is output, it is determined that deep wake-up is required. And if the corresponding awakening determination information or the awakening cancellation information is not acquired within the first time after the awakening inquiry information is output, determining that deep awakening is not needed.
If the wake-up inquiry information is: asking you about a question that you want to consult? The wake-up determination information may be: yes, right, etc. words with certainty; the wake-up cancellation information may be: words and phrases with negativity are not used, not equal.
Of course, each piece of information is not limited to the above description, and is not repeated here, and all of them are within the protection scope of the present application, depending on the actual situation.
In this embodiment, a two-stage wake-up manner is adopted for wake-up, where deep wake-up is performed after the digital person obtains the determination information corresponding to the inquiry information, so as to avoid false wake-up of the digital person and reduce power consumption of the digital person.
In practical applications, referring to fig. 4, the specific process of step S202 may be:
s301, starting an interactive response mode.
And S302, outputting awakening inquiry information after the preset duration of the interactive response mode is started.
That is, the wake-up inquiry information is not directly output after the interactive response mode is started, but the wake-up inquiry information is output after the preset time duration is waited.
The value of the preset duration is not specifically limited herein, and is determined according to the actual situation, and is within the protection scope of the present application.
Of course, the present application does not exclude the scheme of directly outputting the wake-up inquiry information after the interactive response mode is started, and the details are not repeated here any more, and all are within the protection scope of the present application depending on the actual situation.
For example, an interactive response mode is initiated, and after one minute of initiating the interactive response mode, "do you determine to wake up small? "wake-up inquiry information.
The above process is only an example, and is not described herein any more, and all of them are within the scope of the present application, depending on the actual situation.
In this embodiment, the wake-up inquiry information is output after the preset duration of the interactive response mode is started, but the wake-up inquiry information is not output immediately, and the preset duration may be reserved for data processing.
In practical application, referring to fig. 5, the specific process of step S302 is:
s401, judging whether the consultation information of the user is collected within the preset time length for starting the interactive response mode.
The specific value of the preset duration is not specifically limited herein, and is determined according to the actual situation, and is within the protection scope of the present application.
If the consultation information of the user is collected within the preset time length for starting the interactive response mode, the step S402 is executed.
S402, awakening inquiry information based on the consultation information is output.
Specifically, the wake-up inquiry information is mainly used to determine the user's requirement, that is, if the consultation information is acquired, it is determined whether the consultation information is the information that the user needs to consult the digital person.
For example, a user says "consult credit card transaction flow" to a digital person; that is, the user's counseling information is: and (5) performing credit card transaction flow. At this time, the digital person outputs "whether to determine to consult the credit card transaction flow" to the user; that is, the wake-up inquiry information based on the inquiry information is: whether it is determined to consult the credit card transaction process.
In this embodiment, by judging whether the consultation information of the user is collected within the preset duration of starting the interactive response mode, and outputting the awakening inquiry information based on the consultation information when the consultation information of the user is collected within the preset duration of starting the interactive response mode, the awakening inquiry information output by the digital person is related to the consultation information of the user, so that the digital person is humanized.
In practical application, referring to fig. 6, the specific working process of step S302 is:
s501, judging whether the consultation information of the user is collected within the preset time for starting the interactive response mode.
If the consultation information of the user is not collected within the preset time length for starting the interactive response mode, the step S502 is executed.
And S502, outputting preset awakening inquiry information.
Specifically, the wake-up inquiry information is mainly used to determine the wake-up requirement of the user, that is, if the inquiry information is not collected, it is necessary to determine whether the user needs to wake up the digital person.
The preset wake-up inquiry information may be: do you determine to wake up a little one; of course, the preset wake-up inquiry information is not limited to the above example, and is not described herein again, and all of them are within the protection scope of the present application depending on the actual situation.
In this embodiment, by judging whether the consultation information of the user is collected within the preset duration for starting the interactive response mode, and when the consultation information of the user is not collected within the preset duration for starting the interactive response mode, outputting the preset awakening inquiry information; that is, default wake-up inquiry information of the digital person is set, so that the interaction information of the digital person and the user is clear.
In practical applications, the embodiments of fig. 5 and fig. 6 can be used alone or in combination. Referring to fig. 7, step S501 and step S401 are identical, so that one of them may be omitted, and fig. 7 illustrates the case where step S501 is omitted.
Specifically, the combined process comprises:
s401, judging whether the consultation information of the user is collected within the preset time length for starting the interactive response mode.
If the consultation information of the user is collected within the preset time length for starting the interactive response mode, the step S402 is executed.
S402, awakening inquiry information based on the consultation information is output.
If the consultation information of the user is not collected within the preset time length for starting the interactive response mode, the step S502 is executed.
And S502, outputting preset awakening inquiry information.
In this embodiment, wake-up inquiry information under two conditions is set, that is, wake-up inquiry information output by the digital person is related to inquiry information of the user, or default wake-up inquiry information, so that the digital person is humanized and has corresponding wake-up inquiry information under various conditions.
In the above embodiment, referring to fig. 8 (which is shown on the basis of fig. 7 as an example), the specific process of controlling the digital person to wake up in step S103 is:
s601, activating a network communication mode; and starts to pick up sound and send to the server for digital man service.
It should be noted that the digital person is provided with a network communication module, and the activation of the network communication mode can be realized by controlling the start of the network communication module.
After the network communication mode is activated, the digital person can interact with the network communication module; specifically, the method comprises the following steps.
Specifically, the sound pickup is a process of collecting sound. That is, the digital person sends the collected user consultation information to the server, the server processes the consultation information, and then feeds back a corresponding solution to the digital person, and the digital person displays the solution to the user.
Meanwhile, the server also has a rendering digital person so as to enable the digital person to be closer to a real person. If the virtual face of the digital person is displayed on the display, rendering corresponding expressions, such as a beep mouth, a shy and the like; it is also possible to control the limbs of the digital person to make the digital person more vivid, such as indicating directions by the limbs of the digital person.
In this embodiment, the network communication mode is activated; and the digital man service is carried out by starting pickup and sending the pickup to the server, so that the intelligent service is realized, and the service efficiency of the digital man is improved.
In the above embodiment, referring to fig. 9 (which is shown on the basis of fig. 3 as an example), the specific process involved in step S102 for determining whether the living body face information is detected is as follows:
s701, judging whether the face image information is the front face image information of the user or not based on the face image information acquired when the living body face information is acquired in real time.
If so, determining that the living body face information is detected; if not, the living body face information is judged not to be detected.
The process of judging whether the image information is the face front image information can be realized by judging whether the face image information reaches a preset ratio or not, or whether a connecting line of two eyes is vertical to a nose or not, and the like; whether the judgment is other implementation modes of the face front image information is not repeated here, and the judgment is within the protection scope of the application.
It should be noted that other implementation manners for determining whether the living body face information is detected, such as determining whether the living body face information is the face living body information by pupil detection, are not described herein any more, and are all within the protection scope of the present application.
In this embodiment, based on the face image information acquired when the living body face information is acquired in real time, whether the face image information is the front face image information of the user is determined, and the face image information that the sight directions such as the side face and the like do not point to the digital person is prevented from being used as the living body face information, so that the probability of false awakening is further reduced, and the power consumption of the digital person is reduced.
Another embodiment of the application provides a digital people defense mistake awakening device in a public place.
Referring to fig. 10, the digital personal anti-false wake-up device for public places comprises:
and the acquisition module 10 is used for acquiring audio information and living body face information in real time.
The acquisition module 10 may include an audio acquisition module and a living human face acquisition module;
the audio acquisition module is used for acquiring audio information.
The living body face acquisition module is used for acquiring living body face information.
And the judging module 20 is configured to judge whether the preliminary wake-up information and the deep wake-up information are sequentially collected based on the audio information, and judge whether the living body face information is detected.
The deep awakening information is awakening determining information corresponding to the awakening inquiry information output after the initial awakening information is acquired.
And the awakening module 30 is used for controlling the digital person to awaken if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected.
The working process and principle of each module described above are referred to the above embodiments for details, such as fig. 2, which are not described herein again one by one, and are all within the protection scope of the present application.
In this embodiment, the acquisition module 10 acquires audio information and living body face information in real time; the judgment module 20 judges whether the preliminary wake-up information and the deep wake-up information are sequentially collected based on the audio information, and judges whether the living body face information is detected; if the wake-up module 30 sequentially collects the preliminary wake-up information and the deep wake-up information and detects the living body face information, controlling the digital person to wake up; the digital person is controlled to wake up only after the conditions are respectively met, and in addition, the deep wake-up information is wake-up inquiry information output after the initial wake-up information is acquired and corresponding wake-up determination information; that is, after the preliminary wake-up information is obtained, a question and answer process with the user is required to confirm the requirement of the user for waking up the digital person; the user is not awakened by audio or face images in a unilateral mode, so that the false awakening rate is reduced, and the energy consumption of the digital person is reduced.
Optionally, in the digital people defense mistake awakening device in the public place, the determining module 20 includes:
the first judgment unit is used for judging whether preset awakening keyword information is acquired or not based on the audio information; the wake-up keyword information is preliminary wake-up information.
And the interactive response module is used for starting an interactive response mode and outputting awakening inquiry information if the judgment result of the judgment unit is positive.
The first judging unit is further used for judging whether awakening determining information corresponding to the awakening inquiry information is acquired or not based on the audio information.
For details of the working process and principle of each module unit, refer to the above embodiments, such as fig. 3, which is not described herein again one by one, and are all within the protection scope of the present application.
Optionally, in the digital people defense mistake awakening device in the public place, when the interactive response module is used to start the interactive response mode and output the awakening inquiry information, the interactive response module is specifically used to:
an interactive response mode is initiated.
And outputting awakening inquiry information after the preset duration of the interactive response mode is started.
The interactive response module is used for starting the interactive response mode and outputting the specific process of waking up the inquiry information, for details, refer to the above embodiment, for example, fig. 4, which is not described herein again one by one, and are all within the protection scope of the present application.
Optionally, in the digital people air defense false wake-up device in the public place, the interactive response module is configured to, after a preset duration of the interactive response mode is started, specifically configured to:
and if the consultation information of the user is acquired within the preset duration of starting the interactive response mode, outputting awakening inquiry information based on the consultation information.
The interactive response module is configured to output a specific process of waking up the inquiry information after a preset duration of the interactive response mode is started, for details, refer to the foregoing embodiment, for example, fig. 5, which is not described herein any more, and all of which are within the protection scope of the present application.
Optionally, in the digital civil air defense false wake-up device for public places, after the preset duration of the interactive response mode is started, the interactive response module is specifically configured to:
and if the consultation information of the user is not acquired within the preset duration of starting the interactive response mode, outputting the preset awakening inquiry information.
The interactive response module is configured to output a specific process of waking up the inquiry information after a preset duration of the interactive response mode is started, for details, refer to the foregoing embodiment, for example, fig. 6, which is not described herein any more, and all of which are within the protection scope of the present application.
Optionally, in the above digital people mistake proofing wake-up device in the public place, the wake-up module 30 is specifically configured to, when controlling the digital people to wake up:
activating a network communication mode; and starts to pick up sound and send to the server for digital man service.
The wake-up module 30 is used to control a specific process of waking up the digital person, for details, refer to the above embodiment, such as fig. 8, which is not described herein again one by one, and all are within the protection scope of the present application.
Optionally, in the digital people defense mistake awakening device in the public place, the determining module 20 further includes:
and the second judging unit is used for judging whether the face image information is the face image information of the front of the user or not based on the face image information acquired when the living body face information is acquired in real time.
If so, determining that the living body face information is detected; if not, the living body face information is judged not to be detected.
For details of a specific process and a principle of the second determining unit, refer to the above embodiments, such as fig. 9, which is not described herein again one by one, and are all within the protection scope of the present application.
Another embodiment of the present application provides an electronic device.
Referring to fig. 11, the electronic device includes:
one or more processors 110.
A storage device 120 having one or more programs stored thereon.
The one or more programs, when executed by the one or more processors 110, cause the one or more processors 110 to implement the public space digital people anti-false wake method provided by the embodiments described above.
The working process and principle of the public place digital people defense false wake-up method are referred to the above embodiments for details, which are not repeated herein and are all within the protection scope of the present application.
Another embodiment of the present application provides a storage medium.
The storage medium has a computer program stored thereon, wherein the computer program, when executed by a processor, implements the public place digital people anti-false wake-up method provided by the above embodiments.
The working process and principle of the public place digital people defense false wake-up method are referred to the above embodiments for details, which are not repeated herein and are all within the protection scope of the present application.
Features described in the embodiments in the present specification may be replaced with or combined with each other, and the same and similar portions among the embodiments may be referred to each other, and each embodiment is described with emphasis on differences from other embodiments. In particular, the system or system embodiments are substantially similar to the method embodiments and therefore are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described system and system embodiments are only illustrative, wherein the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A digital people defense mistake awakening method in a public place is characterized by comprising the following steps:
collecting audio information and living body face information in real time;
judging whether primary awakening information and deep awakening information are collected in sequence or not based on the audio information, and judging whether the living body face information is detected or not; the deep awakening information is awakening inquiry information output after the initial awakening information is collected, and awakening determining information corresponding to the deep awakening information;
and if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected, controlling the digital person to awaken.
2. The method for digital people guard against false awakening in public places according to claim 1, wherein judging whether the preliminary awakening information and the deep awakening information are collected in sequence based on the audio information comprises:
judging whether preset awakening keyword information is acquired or not based on the audio information; the awakening keyword information is the preliminary awakening information;
if yes, starting an interactive response mode and outputting awakening inquiry information;
and judging whether awakening determination information corresponding to the awakening inquiry information is acquired or not based on the audio information.
3. The digital personal defense false wake-up method in public places according to claim 2, characterized in that the starting of the interactive response mode and the outputting of the wake-up inquiry information comprise:
starting the interactive response mode;
and outputting awakening inquiry information after starting the preset duration of the interactive response mode.
4. The digital civil air defense false wake-up method in public places according to claim 3, characterized in that after starting the preset duration of the interactive response mode, the wake-up inquiry information is output, including:
and if the consultation information of the user is acquired within the preset duration of starting the interactive response mode, outputting awakening inquiry information based on the consultation information.
5. The digital civil air defense false wake-up method in public places according to claim 3, characterized in that after starting the preset duration of the interactive response mode, the wake-up inquiry information is output, including:
and if the consultation information of the user is not acquired within the preset duration for starting the interactive response mode, outputting preset awakening inquiry information.
6. The method for digital personal defense false wake-up in public places according to any one of claims 1 to 5, characterized in that controlling the digital personal wake-up comprises:
activating a network communication mode; and starts to pick up sound and send to the server for digital man service.
7. The method for digital personal defense and false wake-up in public places according to any one of claims 1 to 5, wherein the step of judging whether the living body face information is detected comprises the following steps:
judging whether the face image information is the face image information of the front of the user or not based on the face image information acquired when the living body face information is acquired in real time;
if so, determining that the living body face information is detected; if not, determining that the living body face information is not detected.
8. The utility model provides a public place digit people prevents mistake awakening device which characterized in that includes:
the acquisition module is used for acquiring audio information and living body face information in real time;
the judging module is used for judging whether primary awakening information and deep awakening information are collected in sequence or not based on the audio information and judging whether the living body face information is detected or not; the deep awakening information is awakening determining information corresponding to awakening inquiry information output after the initial awakening information is acquired;
and the awakening module is used for controlling the digital person to awaken if the initial awakening information and the deep awakening information are sequentially acquired and the living body face information is detected.
9. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the public space digital people mistake proofing wake-up method of any of claims 1-7.
10. A storage medium having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the public space digital people mistake proofing wake-up method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212386.9A CN113870856A (en) | 2021-10-18 | 2021-10-18 | Public place digital people defense false wake-up method, related device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111212386.9A CN113870856A (en) | 2021-10-18 | 2021-10-18 | Public place digital people defense false wake-up method, related device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113870856A true CN113870856A (en) | 2021-12-31 |
Family
ID=79000142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111212386.9A Pending CN113870856A (en) | 2021-10-18 | 2021-10-18 | Public place digital people defense false wake-up method, related device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113870856A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114420121A (en) * | 2022-01-20 | 2022-04-29 | 思必驰科技股份有限公司 | Voice interaction method, electronic device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150112690A1 (en) * | 2013-10-22 | 2015-04-23 | Nvidia Corporation | Low power always-on voice trigger architecture |
| US20190139547A1 (en) * | 2017-11-08 | 2019-05-09 | Alibaba Group Holding Limited | Interactive Method and Device |
| CN111243583A (en) * | 2019-12-31 | 2020-06-05 | 深圳市瑞讯云技术有限公司 | System awakening method and device |
| CN112002320A (en) * | 2020-08-10 | 2020-11-27 | 北京小米移动软件有限公司 | Voice wake-up method and device, electronic equipment and storage medium |
| CN113160815A (en) * | 2021-04-15 | 2021-07-23 | 深圳市欧瑞博科技股份有限公司 | Intelligent control method, device and equipment for voice awakening and storage medium |
-
2021
- 2021-10-18 CN CN202111212386.9A patent/CN113870856A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150112690A1 (en) * | 2013-10-22 | 2015-04-23 | Nvidia Corporation | Low power always-on voice trigger architecture |
| US20190139547A1 (en) * | 2017-11-08 | 2019-05-09 | Alibaba Group Holding Limited | Interactive Method and Device |
| CN111243583A (en) * | 2019-12-31 | 2020-06-05 | 深圳市瑞讯云技术有限公司 | System awakening method and device |
| CN112002320A (en) * | 2020-08-10 | 2020-11-27 | 北京小米移动软件有限公司 | Voice wake-up method and device, electronic equipment and storage medium |
| CN113160815A (en) * | 2021-04-15 | 2021-07-23 | 深圳市欧瑞博科技股份有限公司 | Intelligent control method, device and equipment for voice awakening and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114420121A (en) * | 2022-01-20 | 2022-04-29 | 思必驰科技股份有限公司 | Voice interaction method, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102444165B1 (en) | Apparatus and method for providing a meeting adaptively | |
| KR102498364B1 (en) | Electronic device and method for provideing information in the electronic device | |
| US10706847B2 (en) | Method for operating speech recognition service and electronic device supporting the same | |
| KR101726945B1 (en) | Reducing the need for manual start/end-pointing and trigger phrases | |
| CN107632706B (en) | Application data processing method and system of multi-modal virtual human | |
| EP3642838B1 (en) | Method for operating speech recognition service and electronic device and server for supporting the same | |
| EP3101652A1 (en) | Electronic device for outputting messages and method for controlling the same | |
| CN110060678B (en) | Virtual role control method based on intelligent device and intelligent device | |
| CN110910887B (en) | Voice wake-up method and device | |
| CN110263131B (en) | Reply information generation method, device and storage medium | |
| KR20170033641A (en) | Electronic device and method for controlling an operation thereof | |
| KR102390713B1 (en) | Electronic device and method for providing call service | |
| EP4010833B1 (en) | Machine learning based privacy processing | |
| CN105357653B (en) | A kind of based reminding method and terminal | |
| CN112739507B (en) | Interactive communication realization method, device and storage medium | |
| CN106095421B (en) | A kind of control method and system of virtual reality device | |
| CN107564532A (en) | Awakening method, device, equipment and the computer-readable recording medium of electronic equipment | |
| CN111370004A (en) | Man-machine interaction method, voice processing method and equipment | |
| CN112634895A (en) | Voice interaction wake-up-free method and device | |
| CN113870856A (en) | Public place digital people defense false wake-up method, related device and storage medium | |
| CN111968641B (en) | Voice assistant awakening control method and device, storage medium and electronic equipment | |
| CN111554314B (en) | Noise detection method, device, terminal and storage medium | |
| CN111526244A (en) | Alarm clock processing method and electronic equipment | |
| CN112731176A (en) | Electric quantity prompting method and device, wearable massage equipment and storage medium | |
| CN216565209U (en) | Intelligent mirror based on Internet of things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |