JP2017156869A - Awakening support device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to maintain an awakening state of a user without making the user feel troublesomeness and discomfort.SOLUTION: An output device 90 presents visual stimulus from two positions horizontally separated from each other from a driver. A priming stimulus presentation control unit 22 controls the output device 90 to present priming stimulus that is precedent stimulus of main stimulus at a first position that presents the main stimulus at first before three seconds before making a controller 26 present the main stimulus. The controller 26 controls the output device 90 to present visual stimulus about the main stimulus.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a wakefulness maintaining device and a program, and more particularly to a wakefulness maintaining device for maintaining a user's wakefulness state.

  There is a technology that presents information related to a warning without causing the driver to feel bothersome (Patent Document 1). In this technique, as shown in FIG. 13, a radar that detects a situation around the host vehicle, a display device that displays information related to a warning, a notification device that generates a notification, and the surroundings of the host vehicle detected by the radar On the basis of the judgment on the situation, information related to the warning is displayed on the display device for a short time within the perceived range.

  In addition, there is a technique for displaying alerting information at a frequent accident point or section to the driver without making the driver feel bothersome (Patent Document 2). In this technique, as shown in FIG. 14, an alert display control device that generates alert information based on accident statistical information, generates an alert image based on the alert information, and controls display of the alert image. And a HUD that displays a caution image output from the caution display control device, and the caution display control device displays the caution image while the vehicle is traveling in a high-accident location or section of the vehicle. The display is controlled to be repeatedly displayed with the display duration of the subthreshold perception range.

  In addition, there is a technique for minimizing the confusion caused to the driver when providing the oncoming vehicle display screen and the pedestrian display screen. In this technique, as shown in FIG. 15, even when the image is switched according to the stop / progress of the host vehicle, the image after switching is easily recognized by using the image that is already lightly displayed before the switching as a preceding clue. To be able to.

JP 2005-231381 A JP-A-2005-241516 JP 2006-40119 A

  In the technique disclosed in Patent Document 1, visual information is first displayed in a subliminal manner, and the degree of attention to visual information to be displayed next is emphasized. However, Patent Document 1 simply uses a priming stimulus, and the effect of this priming stimulus can accelerate the recognition of a warning. However, it improves the induction rate (gaze tracking rate) of the subsequent saccade-induced stimulus. It's not like that.

  Further, Patent Document 2 is intended to provoke attention that is not bothersome by subliminal visual information, and does not emphasize the degree of attention to the next stimulus to be displayed.

  The present invention has been made in view of the above circumstances, and provides a wakefulness maintaining apparatus and a program that can maintain a user's wakefulness state without causing the user to feel bothered or uncomfortable. Objective.

  In order to achieve the above object, a wakefulness maintaining apparatus according to a first aspect of the present invention includes a stimulus presentation unit that presents a visual stimulus from at least two positions that are separated from each other in the peripheral vision region of the user. Immediately before the main stimulus is presented by the control means, the control means for presenting the main stimulus by the stimulus presenting means so as to move the user's line of sight in the left-right direction in order to maintain the user's arousal state, Priming stimulus presentation control means for presenting a priming stimulus, which is a preceding stimulus of the main stimulus, to a position corresponding to a position where the main stimulus is first presented by the stimulus presenting means.

  In the wakefulness maintaining apparatus according to the first invention, the stimulus presenting means presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived without burden by the user's vision. May be.

  In the wakefulness maintaining device according to the first invention, the control means may cause the stimulus presentation means to present a visual stimulus so as to cause a saccade movement of the user's eyes.

  Further, the awakening maintenance device according to the second invention is a detection means for detecting a detection object from the front view of the driver of the vehicle, and at least one predetermined place in the front view of the driver on the vehicle, Visual stimulus is presented at each position within the front field of view of the driver and at least one location away from the at least one location in the left-right direction and corresponding to a region where the detection object is detected by the detection means. The stimulus presentation means at a timing corresponding to the timing when the detection object is detected by the detection means so as to move the driver's line of sight in the left-right direction in order to maintain the driver's arousal state Control means for presenting the main stimulus by the means, and immediately before the main stimulus is presented by the control means, the stimulus presentation means The a super is priming stimulation is configured to include a priming stimulus presentation control means for presenting a position corresponding to the position initially presenting the main stimulus.

  In the wakefulness maintaining device according to the second aspect of the invention, the stimulus presenting means may determine the intensity of the visual stimulus at a location other than at least one location corresponding to the region where the detection target is detected by the detection means. You may make it the minimum intensity | strength stimulation which can be perceived.

  Further, in the wakefulness maintaining device according to the second invention, the control means, when a detection object is not detected by the detection means for a predetermined stop period, is provided at each position by the stimulus presentation means. Visual stimuli may be presented.

  In the wakefulness maintaining apparatus according to the second invention, the stimulus presenting means presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived with no visual burden on the driver. May be.

  Further, in the wakefulness maintaining device according to the second invention, the control means presents the visual stimulus for a predetermined rest period, after presenting the visual stimulus by the stimulus presenting means, for a predetermined duration. You may make it control the said stimulus presentation means not to perform.

  In the wakefulness maintaining apparatus according to the second invention, the stimulus presentation means presents the main stimulus or the priming stimulus on a windshield of the vehicle, a room mirror of the vehicle, or a side mirror of the vehicle. You may do it.

  In the wakefulness maintaining device according to the second aspect of the invention, the control means may cause the stimulus presentation means to present a visual stimulus so as to cause a saccade movement of the driver's eyes.

  Further, in the wakefulness maintaining apparatus according to the first and second inventions, the control means includes the order of presentation, the presentation cycle, the presentation start, the presentation stop, and the presentation of the main stimuli presented by the stimulus presentation means. It is also possible to control at least one of the intensity and the color of the presentation.

  In the wakefulness maintaining device according to the first and second inventions, the control means controls the stimulus presenting means so as to repeat the presentation of the main stimulus in a predetermined order at each position. Also good.

  In the wakefulness maintaining device according to the first and second inventions, the stimulus presentation unit may present the main stimulus or the priming stimulus by outputting blue light from each position. .

  The wakefulness maintaining device according to the first and second inventions further includes information detecting means for detecting peripheral information, wherein the priming stimulus presentation control means detects the information as the priming stimulus by the stimulus presenting means. The peripheral information detected by the means may be presented.

  The program of this invention is a program for functioning a computer as each means which comprises said wakefulness maintenance apparatus.

  According to the awakening maintenance device, method, and program of the present invention, the user's arousal state can be maintained without causing the user to feel bothered or uncomfortable.

It is a figure which shows the example of the right-and-left blinking stimulus which can guide saccade. It is a block diagram which shows the structure of the wakefulness maintenance apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows the example of the visual stimulus seen from the driver. It is a block diagram which shows the structure of the wakefulness maintenance apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the wakefulness maintenance process routine in the wakefulness maintenance apparatus which concerns on the 2nd Embodiment of this invention. It is a figure which shows the example of presentation of the visual stimulus in the awakening maintenance apparatus of 2nd Embodiment. It is a figure which shows the result of an experiment example. It is a figure which shows the result of an experiment example. It is a figure which shows the result of an experiment example. In the wakefulness maintenance apparatus of 3rd Embodiment, it is a figure which shows the example of presentation of the visual stimulus in case the speed information of a surrounding vehicle is shown as a priming stimulus. It is a block diagram which shows the structure of the wakefulness maintenance apparatus which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the wakefulness maintenance process routine in the wakefulness maintenance apparatus which concerns on the 3rd Embodiment of this invention. It is a figure which shows an example of a prior art. It is a figure which shows an example of a prior art. It is a figure which shows an example of a prior art.

  Embodiments of the present invention will be described below with reference to the drawings. In the drawings, substantially the same or equivalent components or parts are denoted by the same reference numerals.

<Principle of the invention>

  In the embodiment of the present invention, as shown in FIG. 1, stimuli that can be visually recognized, such as light and display, are output in order or alternately from two or more places that are separated from the left and right in front of a person. Induces directional saccade (impulsive) eye movements. The saccade eye movement is an eye movement peculiar to awakening, and when this eye movement is induced, the reduction of the human arousal state is prevented, and the arousal state can be maintained. In the present embodiment, causing saccade movement to the eyes is defined as saccade eye movement.

  In addition, in the embodiment of the present invention, in order to effectively induce the saccade eye movement, a visual stimulus such that the driver naturally turns his gaze is presented.

  In particular, in the embodiment of the present invention, in order to effectively induce saccade eye movement, a “priming effect” is performed so that a person naturally turns his gaze immediately before saccade-induced visual stimulus presentation. Presents priming visual stimuli that cause The priming effect is known as an effect that the treatment of the subsequent stimulus is promoted or suppressed by the treatment of the preceding stimulus (primer). For example, repeatedly presenting the same stimulus has the effect of reducing the recognition time and increasing the accuracy of the second stimulus. By this effect, the line-of-sight inductivity to the subsequent saccade-induced visual stimulus is enhanced, and the saccade is effectively and naturally induced. In both the priming visual stimulus and the saccade-induced visual stimulus, it is only necessary to induce the saccade eye movement. Therefore, the priming visual stimulus may be presented to the peripheral vision region instead of the central vision of the person, and a stronger stimulus is not necessary. Therefore, it is only necessary to present the stimulus with the intensity (brightness) near the limit that can be visually perceived. Thereby, since the user does not disturb the field of view or feel glare, the user can maintain an awake state without feeling bothersome or uncomfortable.

<Configuration of wakefulness maintaining apparatus according to first embodiment>

  Next, a wakefulness maintaining apparatus according to the first embodiment of the present invention will be described. As shown in FIG. 2, the wakefulness maintaining device 100 according to the first embodiment of the present invention includes a control device 20 and an output device 90. In the first embodiment, a case where the awakening maintenance device is installed in a vehicle will be described.

  The control device 20 includes a priming stimulus presentation control unit 22 and a control unit 26. The control device 20 includes a CPU, a RAM, and a ROM that stores a program for executing a control processing routine described later and various data, and controls the output device 90 by executing the program.

  The output device 90 is configured to blink two positions (first position and second position), and the first position is turned on every second, the second position is turned on, the first position is turned on, and so on. The output device 90 is controlled so as to be lit alternately at the first position and the second position. Here, the shape of the lighting part is, for example, a circular figure having a diameter of 2 cm, and the brightness of the lighting part is a predetermined brightness corresponding to the upper limit of the intensity of the visual stimulus that can be perceived by the driver without any burden. The color of is blue. It should be noted that the lighting color may be other than blue. A driver is an example of a user. Further, lighting at the first position and the second position is an example of a visual stimulus.

  Further, the output device 90 is a device that presents visual stimuli from two positions separated from the left and right of the driver. In the first embodiment, a head-up display unit provided on the front windshield of the driver is provided. Use. Here, as shown in FIG. 3, in the head-up display part of the front windshield of the driver, two positions (first positions) that are separated from each other about the driver front and within the peripheral vision region of the driver. Each of the position and the second position) blinks. Here, the peripheral vision region is a region having an eccentricity of about 5 to 25 degrees in the vertical direction with respect to a linear direction forward from a predetermined line of sight of the driver. In the first embodiment, the head-up display unit of the windshield has a distance of about 80 centimeters from the driver's eyes, and the first position and the second position to be blinked are 10 centimeters left and right with the driver front as the center. The positions are set apart from each other and at a depression angle of 10 degrees with respect to the lower side from the front of the driver.

  The priming stimulus presentation control unit 22 presents the priming stimulus, which is the preceding stimulus of the main stimulus, to the first position where the main stimulus is first presented by the output device 90 three seconds before the main stimulus is presented by the control unit 26. To control. 3 seconds before is an example immediately before. Also, the time for presenting the priming stimulus is, for example, 1 second. The priming stimulus may be the same visual stimulus as the main stimulus. The position where the priming stimulus is presented may be around the first position.

  The control unit 26 controls the output device 90 so that the visual stimulus is presented for the main stimulus. Specifically, the output device 90 is configured to blink two positions (first position and second position), and every 0.5 seconds from the timing when the automobile is detected in the detection target area. The output device 90 is controlled so that the first position is lit, the second position is lit, the first position is lit, and so on alternately at the first position and the second position. Here, the shape of the lighting part is, for example, a circular figure having a diameter of 2 cm, and the brightness of the lighting part is a predetermined brightness corresponding to the upper limit of the intensity of the visual stimulus that can be perceived by the driver without any burden. The color of is blue. In addition, the control unit 26 controls the output device 90 so that the light is alternately turned on at the first position and the second position, and this is repeated for 5 seconds. Note that lighting at the first position and the second position is an example of a visual stimulus. Moreover, 5 seconds is an example of a duration. The duration may be about 3 to 7 seconds. If the duration is too short, the effect is small, and if it is too long, annoyance may increase.

<Operation of the wakefulness maintaining device according to the first embodiment>

  Next, the operation of the wakefulness maintaining device 100 according to the first embodiment of the present invention will be described. First, when the driver turns on the ignition key, the priming stimulus presentation control unit 22 in the control device 20 lights up the first position for 1 second 3 seconds before lighting up by the control unit 26 after a predetermined time has elapsed. And the control part 26 controls the output device 90 so that the control which makes it light at a 1st position and a 2nd position, and the control which is not made to light alternately repeat every 1 minute. Thereby, the driver's awakening state is maintained.

  As described above, according to the wakefulness maintaining apparatus 100 according to the first embodiment, immediately before the main stimulus is presented, control is performed so that the priming stimulus is presented at the first position where the main stimulus is presented first. After that, the driver is bothered and uncomfortable by lighting the driver's line of sight to move left and right at two positions left and right in the peripheral vision area of the driver to maintain the driver's awake state. The driver's awakening state can be maintained without making the driver feel.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  In the first embodiment, the case where the head-up display unit provided on the front windshield of the driver is used as the device for presenting the right visual stimulus and the left visual stimulus of the driver has been described. It is not limited to. For example, by using two or more LED lights or the like to perform control so that two or more visual stimuli are presented, the driver can present the right visual stimulus and the left visual stimulus. Good.

  Further, in the first embodiment, the case where the presentation of the visual stimulus on the right side of the driver and the presentation of the left side visual stimulus are alternately presented every second has been described, but the present invention is not limited to this. . For example, the left and right visual stimuli may be alternately presented every 0.5 seconds or every 2 seconds. However, since a certain latency (150 to 250 ms) is required to start the saccade eye movement, the shortest is about 0.5 seconds. In addition, if the period is too long, the occurrence frequency of saccade eye movement becomes low, so about 2 seconds is the longest.

  Further, in the first embodiment, the output device 90 is controlled for one minute with respect to the control for presenting the visual stimulus, and then the control for not presenting the stimulus for one minute is performed and the control is repeated every minute. However, the present invention is not limited to this. For example, the control may be repeated every 2 minutes or every 30 seconds. Further, it is not necessary to control the stop of the presentation of the visual stimulus.

  In the first embodiment, the case where the visual stimulus is presented from two places has been described. However, the present invention is not limited to this. For example, when a sufficient distance can be secured for saccade eye movement to be induced, visual stimuli may be presented from two or more locations. In this case, the order in which visual stimuli are presented is determined in advance, and the presentation of visual stimuli is repeated periodically in that order.

  Moreover, although the case where the awakening maintenance apparatus 100 is installed in a vehicle was demonstrated in 1st Embodiment, it is not limited to this. For example, you may install in vehicles, such as ships other than a vehicle, and an airplane. Further, by using a small liquid crystal display or the like as the output device, for example, it may be installed so as to be used during OA work in a home or office.

<Configuration of Awakening Maintenance Device According to Second Embodiment>

  Next, a wakefulness maintaining apparatus according to a second embodiment of the present invention will be described. As shown in FIG. 4, the wakefulness maintaining device 200 according to the second embodiment of the present invention includes an imaging device 10, a control device 220, and an output device 90.

  The imaging device 10 captures a range including a detection target area in the right rear and right front of the host vehicle and generates an image signal, and an image signal that is an analog signal generated by the imaging unit A / D converter (not shown) for converting the signal into a digital signal and an image memory (not shown) for temporarily storing the A / D converted image signal.

  The control device 220 includes the discriminator storage unit 18, the detection unit 21, a priming stimulus presentation control unit 222, a control unit 226, a time management unit 228, and a history storage unit 230. The control device 220 includes a CPU, a RAM, and a ROM that stores a program for executing a control processing routine, which will be described later, and various data, and controls the output device 90 by executing the program.

  In the output device 90 of the second embodiment, the intensity of the visual stimulus at a location other than at least one location corresponding to the region where the detection target 21 is detected by the detection unit 21 is the minimum intensity that can be perceived by the driver. Let's be a stimulus.

  In the present embodiment, the position superimposed on the right lane of the traveling lane of the host vehicle is defined as the first position.

  The discriminator storage unit 18 stores a discriminator that is generated by learning in advance and is referred to when the detection unit 21 detects a detection target. In the second embodiment, a case where the detection target is an automobile will be described. A case where the discriminator storage unit 21 is provided in the control device 220 will be described.

  The discriminator used in the second embodiment is learned from a plurality of detection object images and a plurality of non-detection object images. Specifically, first, each of a plurality of detection object images and a plurality of non-detection object images is scanned comprehensively for each of a plurality of windows having different sizes, and each of the partial areas is scanned. get. Next, the feature amount of each partial region is calculated. Next, a learning process is performed based on each feature amount of the partial region and each of the classifications of the images from which the partial region is acquired (whether the image is a detection target object) to learn the discriminator.

  The detection unit 21 determines whether or not the detection target is detected based on the image input from the imaging device 10 and the classifier for detecting the detection target stored in the classifier storage unit 18. judge. When it is determined that the detection target has been detected, the result is output to the control unit 226. Specifically, first, the image input from the imaging device 10 is comprehensively scanned for each of a plurality of windows having different sizes, and each of the partial areas is acquired. Next, the feature amount of each partial region is calculated. Next, based on the feature amount for each partial region and the discriminator for detecting the detection target stored in the discriminator storage unit 18, it is determined whether or not the detection target is detected in the image. To do.

  The priming stimulus presentation control unit 222 receives the notification of the presentation of the visual stimulus from the control unit 226, and immediately before the control unit 226 presents the main stimulus, the output device 90 performs the priming that is the preceding stimulus of the main stimulus. The stimulus is controlled to be presented in a first position where the main stimulus is presented first.

  When the control unit 226 obtains the result of detection of the detection target from the detection unit 21, the control unit 226 inquires the time management unit 228 whether or not the visual stimulus can be presented. When the visual stimulus presentation instruction information is obtained, the control unit 226 performs priming stimulus presentation control. After the priming stimulus presentation control unit 222 presents the priming stimulus, the output device 90 is controlled so that the visual stimulus is presented, and the current time is set to the visual stimulus. It outputs to the time management part 228 as the time which started presentation. In addition, when the detection target is not detected by the detection unit 21, the control unit 226 acquires the visual stimulus presentation instruction information from the time management unit 228, and controls the output device 90 to present the visual stimulus. The current time is output to the time management unit 228 as the time when the presentation of the visual stimulus is started.

  When the time management unit 228 acquires the time at which the presentation of the visual stimulus is started from the control unit 226, the time obtained by adding 5 seconds, which is the presentation period of the visual stimulus, to the time as the presentation end time of the previous visual stimulus. Store in the history storage unit 230. In addition, the time management unit 228 compares the current time with the presentation end time of the previous visual stimulus stored in the history storage unit 230, and the difference is a predetermined stop period, for example, 1 minute 30 seconds or more If there is, visual stimulus presentation instruction information is output to the control unit 226. In addition, when there is an inquiry about whether or not the visual stimulus can be presented from the control unit 226, the time management unit 228 compares the present time with the presentation end time of the previous visual stimulus stored in the history storage unit 230. When the difference is a predetermined pause period, for example, a period longer than 30 seconds, the visual stimulation presentation instruction information is output to the control unit 226.

<Operation of the wakefulness maintaining device according to the second embodiment>

  Next, the operation of the wakefulness maintaining apparatus 200 according to the second embodiment of the present invention will be described. First, when the driver turns on the ignition key, the imaging device 10 starts imaging and outputs to the control device 220 as needed. Then, the control processing routine shown in FIG.

  First, in step S200, the classifier for detecting the detection target object memorize | stored in the classifier memory | storage part 18 is read.

  Next, in step S202, the captured image input from the imaging device 10 is received.

  Next, in step S204, based on the discriminator for detecting the detection target acquired in step S200 and the captured image acquired in step S202, whether or not the detection target is detected in the image is determined. judge. If it is determined that the detection target has been detected, the process proceeds to step S208. On the other hand, when it determines with the detection target object not being detected, it transfers to step S206.

  In step S206, the presentation end time of the previous visual stimulus stored in the history storage unit 230 is read, and the rest period and presentation of the visual stimulus are performed based on the current time and the presentation end time of the previous visual stimulus. Judge whether or not. If no visual stimulus is presented during the rest period, the process proceeds to step S210. On the other hand, when a visual stimulus is presented during the rest period, the process proceeds to step S202, and the process from step S202 is repeated.

  In step S208, the presentation end time of the previous visual stimulus stored in the history storage unit 230 is read and stopped from the presentation end time of the previous visual stimulus based on the current time and the presentation end time of the previous visual stimulus. It is determined whether or not the period has elapsed. If the stop period has elapsed since the last presentation time of the visual stimulus, the process proceeds to step S210. On the other hand, if the stop period has not elapsed since the last presentation time of the visual stimulus, the process proceeds to step S202.

  In step S210, the output device 90 is controlled to present a priming stimulus.

  Next, in step S212, the output device 90 is controlled to present a visual stimulus.

  Next, in step S214, it is determined whether or not a predetermined duration has elapsed since the output device 90 is controlled to present a visual stimulus in step S212. If the predetermined duration has elapsed, the process proceeds to step S216. On the other hand, if the predetermined duration has not elapsed, the process of step S214 is repeated.

  Next, in step S216, the output device 90 is controlled so that the presentation of the visual stimulus is stopped, the process proceeds to step S202, and the process from step S202 is repeated.

<Experimental example>

  As an experimental example, the wakefulness maintaining apparatus according to the second embodiment that presents the priming stimulus and the saccade stimulus according to the timing when the vehicle that is the detection target is detected in the right lane, and the priming stimulus are presented. Without performing the experiment, an experiment is performed using a wakefulness maintenance device that presents only a saccade stimulus (hereinafter, referred to as a comparison wakefulness maintenance device) in accordance with the timing when the vehicle that is the detection target is detected in the right vehicle. The results are shown. FIG. 6 shows examples of priming stimulus presentation and saccade stimulus presentation in the case of using the wakefulness maintaining apparatus according to the second embodiment.

  FIG. 7 shows an experimental example of the state of line-of-sight tracking during priming stimulation and saccade stimulation presentation. FIG. 7 shows an example in which the priming stimulus is repeated once and the saccade stimulus is repeated four times in the presentation of the visual stimulus at the first position and the second position. In FIG. 7, when the driver's line of sight moves to the first position, the abscissa value becomes a large value. FIG. 7 shows that the line of sight is accurately followed.

  FIG. 8 shows the line-of-sight tracking rate when the priming stimulus and the saccade stimulus are presented for 25 minutes. In the example of FIG. 8, s1 indicates line-of-sight tracking when the saccade stimulus is presented four times in the right direction. s2 indicates the line-of-sight tracking rate in the case where the priming stimulation is performed once per minute, the saccade stimulation is performed four times, and the visual stimulation is performed five times in total in the right direction. s1 represents the result of the wakefulness maintaining device to be compared, and s2 represents the result of the wakefulness maintaining device according to the second embodiment. From the result of FIG. 8, it can be seen that the wakefulness maintenance device according to the second embodiment continues to induce saccade eye movements more effectively than the comparison target wakefulness maintenance device even after 25 minutes. Recognize. Actually, after 10 minutes, the value of about 1 or more is maintained (average 1.16), and it seems that the effect appears over time.

  In addition, FIG. 9 shows the long-term eye-close rate per minute (the ratio of the total time of continuous eye closure of 0.5 seconds or more) when simulated driving for 45 minutes using a driving simulator under two stimulation conditions. Shows time change. In the wakefulness maintaining apparatus according to the second embodiment, a result that the wakefulness decrease can be suppressed in the latter half of the experiment is obtained as compared with the case of the comparative wakefulness maintaining apparatus. Note that the vertical axis in FIG. 9 is a long-term eye-close rate per minute (a ratio of the total time of continuous eye closure of 0.5 seconds or more), which is one of the indices representing the arousal state. It can be regarded as a decrease in arousal and occurrence of snoozing.

  As described above, according to the wakefulness maintaining apparatus 200 according to the second embodiment, immediately before the detection target is detected and the main stimulus is presented at the timing corresponding to the timing at which the detection target is detected. In order to maintain the driver's arousal state, the driver's line of sight is moved in the left-right direction after controlling the priming stimulus to be presented at the first position where the main stimulus is presented first. By presenting a visual stimulus at a first position superimposed on the right lane of the vehicle and a second position that is within the driver's forward field of view and separated from the first position in the left-right direction, The user's arousal state can be maintained without causing discomfort.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  In the second embodiment, the case where the stop period is 1 minute 30 seconds and the rest period is 30 seconds has been described, but the present invention is not limited to this. For example, the stop period and the pause period may be set as arbitrary periods.

  Next, a third embodiment will be described. In addition, about the part which becomes the structure and effect | action similar to 1st and 2nd Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  In the third embodiment, when presenting a visual stimulus, the first position is determined according to the position of the detected object to be detected, and the speed information of surrounding vehicles is presented as a priming stimulus. Are different from those of the second embodiment. FIG. 10 shows an example of priming stimulus presentation and saccade stimulus presentation in the case of presenting speed information of surrounding vehicles in the wakefulness maintaining device according to the third embodiment.

<Configuration of Awakening Maintenance Device According to Third Embodiment>

  Next, a wakefulness maintaining apparatus according to a third embodiment of the present invention will be described. As shown in FIG. 11, the wakefulness maintaining device 300 according to the third embodiment of the present invention includes an imaging device 10, a control device 320, and an output device 390.

  The control device 320 includes a discriminator storage unit 18, a detection unit 321, a position storage unit 325, a priming stimulus presentation control unit 322, an information detection unit 324, and a control unit 326.

  The output device 390 is a device that presents visual stimuli from two positions left and right of the driver, and in the third embodiment, a head-up display unit provided on the front windshield of the driver is used. Here, in the head-up display part of the front windshield of the driver, the center position is defined as the second position with the driver front as the center. Further, in the head-up display portion of the front windshield of the driver, the position superimposed on the right lane of the traveling lane of the host vehicle is defined as the first position. Note that the first position changes for each periodic period in which the visual stimulus is presented based on the specific position presenting the visual stimulus input from the control unit 326. When presenting a visual stimulus instructed by the priming stimulus presentation control unit 322, the estimated speed of the detection target estimated by the information detection unit 324 is presented.

  The detection unit 321 determines whether or not the detection target is detected based on the image input from the imaging device 10 and the classifier for detecting the detection target stored in the classifier storage unit 18. judge. Further, when a detection target is detected, the detection unit 321 acquires the coordinate value of the biaxial coordinates where the detection target is detected, and outputs the coordinate value to the control unit 326. In the third embodiment, the viewpoint position of the driver is set as the origin, and the two-axis coordinates using the two axes perpendicular to the traveling direction of the host vehicle are used.

  The information detection unit 324 estimates the speed of the detection target based on the detection target detected by the detection unit 321.

  When the priming stimulus presentation control unit 322 obtains the detection target detection result from the detection unit 321, immediately before the control unit 326 presents the main stimulus, the output device 90 causes the priming stimulus that is a preceding stimulus of the main stimulus. Are controlled to be presented at the first position where the main stimulus is presented first. At this time, the output device 90 is controlled to present the speed estimated by the information detection unit 324 as the priming stimulus.

  The position storage unit 325 stores a correspondence relationship between each of the biaxial coordinate values used in the detection unit 321 and each specific position of the head-up display unit provided on the front windshield of the driver. .

  When the control unit 326 acquires the detection result of the detection target from the detection unit 321, the control unit 326 controls the output device 390 to present the visual stimulus after the presentation by the control of the priming stimulus presentation control unit 322. Specifically, first, the control unit 326 presents a visual stimulus based on the coordinate value at which the detection target input from the detection unit 321 is detected and the correspondence relationship stored in the position storage unit 325. A specific position to be determined is determined as a first position, and further, a second position within the driver's forward field of view and separated from the first position in the left-right direction is determined. Then, the output device 390 is controlled so that the visual stimulus is presented at the determined first position and second position. In addition, you may make a 1st position follow a detection target object by changing a 1st position according to the speed estimated by the information detection part 324. FIG.

<Operation of the wakefulness maintaining device according to the third embodiment>

  Next, the operation of the wakefulness maintaining apparatus 300 according to the third embodiment of the present invention will be described. First, when the driver turns on the ignition key, the imaging device 10 starts imaging and outputs to the control device 320 as needed. Then, the control processing routine shown in FIG.

  In step S300, each of the two-axis coordinate values used in the detection unit 321 stored in the position storage unit 325 and each of the specific positions of the head-up display unit provided on the front windshield of the driver. Read the correspondence.

  In step S204, based on the discriminator for detecting the detection target acquired in step S200 and the captured image acquired in step S202, it is determined whether or not the detection target is detected in the image. If it is determined that the detection target has been detected, the process proceeds to step S302. On the other hand, when it determines with the detection target object not being detected, it transfers to step S101 and repeats the process from step S202 to step S204.

  In step S302, the coordinate value of the position where the detection target is detected is acquired.

  Next, in step S304, based on the correspondence acquired in step S300 and the coordinate value of the detection target acquired in step S302, a specific position of the head-up display unit is determined to be the first position, Further, the second position is determined.

  In step S306, the speed of the detection target is estimated as the peripheral information based on the detection target detected in step S204.

  In step S308, the output device 90 is controlled to present the estimated speed of the detection target estimated in step S306 as the priming stimulus at the first position determined in step S304.

  Next, in step S310, the output device 90 is controlled so that visual stimuli are presented at the first position and the second position determined in step S304.

  As described above, according to the wakefulness maintaining apparatus 300 according to the third embodiment, immediately before the detection target is detected and the main stimulus is presented at the timing corresponding to the timing at which the detection target is detected. Next, after controlling to cause the estimated speed of the detection target to be presented as the priming stimulus to the first position where the main stimulus is presented first, the driver's line of sight is moved in the left-right direction in order to maintain the driver's arousal state As described above, by presenting visual stimuli at the first position and the second position determined based on the position where the detection target is detected, the user's arousal can be achieved without causing the user to feel bothersome or uncomfortable. The state can be maintained.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  Also in the third embodiment, similarly to the second embodiment, the output device is controlled so as not to present the visual stimulus for a certain period from the presentation of the visual stimulus, and the presentation of the visual stimulus for the certain period. Control may be performed so as to present a visual stimulus when no is performed. In this case, the position where the visual stimulus is presented when the visual stimulus is not presented for a certain period of time may be determined in advance or may be presented at the previous presentation position.

DESCRIPTION OF SYMBOLS 10 Imaging device 18 Discriminator memory | storage part 20,220,320 Control apparatus 21,321 Detection part 22,222,322 Priming stimulus presentation control part 26,226,326 Control part 90,390 Output device 100,200,300 Awakening maintenance apparatus 228 Time management unit 230 History storage unit 324 Information detection unit 325 Position storage unit

Claims (16)

Stimulus presenting means for presenting visual stimuli from at least two or more positions separated from each other in the peripheral vision region of the user;
Control means for presenting a main stimulus by the stimulus presenting means so as to move the user's line of sight in the left-right direction in order to maintain the user's arousal state;
Immediately before presenting the main stimulus by the control means, the stimulus presenting means presents a priming stimulus that is a preceding stimulus of the main stimulus at a position corresponding to a position where the main stimulus is first presented. Control means;
A wakefulness maintaining device.   The wakefulness maintaining apparatus according to claim 1, wherein the stimulus presenting unit presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived without a burden by the user's vision.   The wakefulness maintaining apparatus according to claim 1 or 2, wherein the control means causes the stimulus presentation means to present a visual stimulus so as to cause a saccade movement of the eyes of the user. Detection means for detecting a detection object from the front view of the driver of the vehicle;
At least one predetermined position in the front field of view of the driver on the vehicle, and within the front field of view of the driver, separated from the at least one point in the left-right direction, and the detection object is detected by the detection means. A stimulus presentation means for presenting a visual stimulus at each position with at least one location corresponding to the detected region;
Presenting the main stimulus by the stimulus presenting means at a timing corresponding to the timing when the detection target is detected by the detecting means so as to move the driver's line of sight in the left-right direction in order to maintain the driver's arousal state And a control means for causing the priming stimulus, which is a preceding stimulus of the main stimulus, to be in a position corresponding to a position where the main stimulus is first presented by the stimulus presentation means immediately before the main stimulus is presented by the control means. Priming stimulus presentation control means for presenting;
A wakefulness maintaining device.   The said stimulus presentation means makes the intensity | strength of the visual stimulus in places other than the at least 1 place corresponding to the area | region where a detection target is detected by the said detection means to be the stimulus of the minimum intensity | strength which the said driver can perceive. Item 5. The wakefulness maintaining device according to item 4.   6. The control unit according to claim 4 or 5, wherein when the detection target is not detected by the detection unit for a predetermined stop period, the stimulus presentation unit presents the visual stimulus at each position. Awakening maintenance device.   The arousal maintenance according to any one of claims 4 to 6, wherein the stimulus presenting means presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived by the driver's vision without a burden. apparatus.   The control means controls the stimulus presenting means so as not to present the visual stimulus for a predetermined rest period after the visual stimulus is presented by the stimulus presenting means for a predetermined duration. The wakefulness maintaining apparatus according to any one of 4 to 7.   9. The awakening according to claim 4, wherein the stimulus presentation unit presents the main stimulus or the priming stimulus on a windshield of the vehicle, a room mirror of the vehicle, or a side mirror of the vehicle. Maintenance device.   The wakefulness maintaining apparatus according to any one of claims 4 to 9, wherein the control means causes the stimulus presentation means to present a visual stimulus so as to cause a saccade movement of the eyes of the driver.   The control means controls at least one of a presentation order, a presentation cycle, a presentation start, a presentation stop, a presentation strength, and a presentation color of the main stimulus presented by the stimulus presentation means. Item 11. The wakefulness maintaining device according to any one of items 1 to 10.   The wakefulness maintaining apparatus according to any one of claims 1 to 11, wherein the control means controls the stimulus presenting means so as to repeat the presentation of the main stimulus at each position in a predetermined order.   The wakefulness maintenance device according to any one of claims 1 to 12, wherein the stimulus presenting means presents the main stimulus or the priming stimulus by outputting blue light from each position. It further includes information detecting means for detecting peripheral information,
14. The wakefulness maintaining apparatus according to claim 1, wherein the priming stimulus presentation control unit presents the peripheral information detected by the information detection unit as the priming stimulus by the stimulus presentation unit. A stimulus presenting means for presenting a visual stimulus from at least two or more positions separated from each other in the peripheral vision region of the user;
Immediately before the main stimulus is presented by the control means, the control means for presenting the main stimulus by the stimulus presenting means so as to move the user's line of sight in the left-right direction in order to maintain the user's arousal state, Priming stimulus presentation control means for causing the stimulus presenting means to present a priming stimulus that is a preceding stimulus of the main stimulus at a position corresponding to a position where the main stimulus is first presented;
Program to function as. Detection means for detecting a detection object from a front view of a vehicle driver;
At least one predetermined position in the front field of view of the driver on the vehicle, and within the front field of view of the driver, separated from the at least one point in the left-right direction, and the detection object is detected by the detection means. A stimulus presentation means for presenting a visual stimulus at each position with at least one location corresponding to the detected area, and the driver's line of sight to move in the left-right direction to maintain the driver's arousal state, Control means for presenting the main stimulus by the stimulus presenting means at a timing corresponding to the timing at which the detection object is detected by the detecting means, and immediately before the main stimulus is presented by the control means, by the stimulus presenting means, A priming that presents a priming stimulus that is a preceding stimulus of the main stimulus at a position corresponding to a position where the main stimulus is first presented. Stimulus presentation control means,
Program to function as.