US10818294B2

US10818294B2 - Voice activation using a laser listener

Info

Publication number: US10818294B2
Application number: US16/515,539
Authority: US
Inventors: Steven S. GRGAC
Original assignee: Magna Exteriors Inc
Current assignee: Magna Exteriors Inc
Priority date: 2017-02-16
Filing date: 2018-02-16
Publication date: 2020-10-27
Anticipated expiration: 2038-02-16
Also published as: CN110476192A; US20200027461A1; EP3583585A4; EP3583585A1; CA3052240C; CA3052240A1; US11615798B2; WO2018150371A1; EP3654309A1; US20210027782A1

Abstract

A voice activation system for a vehicle. The voice activation system for a vehicle which has at least one sound panel capable of providing vibrations of a user's voice from the outside of the vehicle into an inside area of the vehicle. A laser listening device is operably connected to the panel for receiving vibrations from a user's voice. A controller receives a pre-identified command of the user from the laser listener and operates an action in the vehicle in response thereto.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a National Stage of International Application No. PCT/IB2018/050969, filed Feb. 16, 2019, which claims the benefit of U.S. Provisional Patent Application No. 62/459,914 filed on Feb. 16, 2017. The disclosures of the above applications are incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to a voice activation system for a vehicle that accurately detects operator commands from the outside of the vehicle.

BACKGROUND OF THE INVENTION

Voice command devices are finding more use in society today such as: for calling and controlling phones; searching on the internet from web connected devices; and, the like. Vehicles have harnessed this technology for entering and controlling data in navigation systems and “smart” radio systems often found in passenger vehicles today.

These voice command devices are typically found in the controlled interior of a vehicle where the microphones and electronics necessary to effectively operate the voice controlled device are in a known sound and weather protected environment. Because the area outside a vehicle is unpredictable in both weather and sound, voice control coming from outside of the vehicle has not been readily practical, even though controlling activities such as: opening vehicle doors; starting the vehicle, turning operation and safety lights on and off; emergency alerts or other commands which might be desirable for controlling from the outside of the vehicle are desirable. In addition, microphones mounted on the outside of a vehicle for voice activation are susceptible to water, dust, and dirt that will affect their lifespan and performance. This adds to the complexity of using voice commands from the outside of the vehicle.

Therefore, there remains a need in the art to solve these problems and provide a mechanism for voice control which is reliable for voice control of vehicle functions from outside of the vehicle.

SUMMARY OF THE INVENTION

In accordance with the present invention there is provided a voice activation system for a vehicle. The voice activation system for a vehicle includes providing a vehicle which has at least one sound panel capable of providing vibrations of a user's voice from the outside of the vehicle into an inside area of the vehicle. A laser listening device is operably connected to the panel for receiving said vibrations from a user's voice. A controller is used for receiving a pre-identified command of the user and operating an action in the vehicle in response thereto.

Further areas of applicability of the present invention will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts an overhead schematic view of a vehicle with the laser listening devices positioned relative to the window panels of the vehicle.

FIG. 2 shows an illustrative graph of the different signals received from by the controller.

FIG. 3 is a side view of the rear of a vehicle with the laser listening device located on the exterior of the vehicle.

FIG. 4 depicts an interior perspective view of the inside passenger compartment of a vehicle with the laser listening device mounted to the headliner.

FIG. 5 is a schematic view of an alternate embodiment of a voice activation system.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description of the preferred embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.

In accordance with the present invention there is provided a voice activation system 10 for a vehicle 12. The voice activation system 10 has at least one sound panel which are depicted as the driver side window 14, passenger side window 14′, front windshield 14″ and rear window 14′″. It is within the scope of this invention for the at least one sound panel to be any window of a passenger compartment 13. It is also within the scope of this invention for the at least one sound panel to be an exterior vehicle body panel such as a door panel, lift gate, trunk or any other exterior panel. The at least one sound panel is capable of reverberating vibrations of a user's voice from the outside of the vehicle 12 into an inside area of the vehicle 12.

In FIG. 1 there is a

laser listening device

16, 16′, 16″, 16′″ associated respectively with one of the driver side window 14, passenger side window 14′, front windshield 14″ and rear window 14′″. Each the

laser listening device

16, 16′, 16″, 16′″ is mounted inside of the passenger compartment 13 in a location that allows a clear line of sight between the

laser listening device

16, 16′, 16″, 16′″ and respective at least one sound panel. Examples of mounting locations include but are not limited to the headliner, head rests, mirror housings, door panels, instrument panel etc.

The

laser listening device

16, 16′, 16″, 16′″ uses the

laser beam

18, 18′, 18″, 18′″ projected from a laser source, to detect vibrations from a user's voice that are reverberated by the at least one sound panel. The

laser listening device

16, 16′, 16″, 16′″ includes a

photo sensor

20, 20′, 20″, 20′″ that receives a

reflected beam

22, 22′, 22″, 22′″ off the at least one sound panel, which is received by the

photo sensor

20, 20′, 20″, 20′″. The angle of reflection off the at least one sound panel is ideally 90 degrees or perpendicular to the at least one sound panel, however, it is possible for other angles to be use such as 45 degrees, 70 degrees, 25 degrees or any other suitable angle depending on the particular design requirements. The

laser listening device

16, 16′, 16″, 16′″ then generates a

laser listening signal

23, 23′, 23″, 23′″ to a controller 24 that is indicative of the vibrations detected by the

laser listening device

16, 16′, 16″, 16′″. The

laser listening signal

23, 23′, 23″, 23′″ can be a signal based on the comparison of the

laser beam

18, 18′, 18″, 18′″ and the

reflected beam

22, 22′, 22″, 22′″ using a

comparator

26, 26′, 26″, 26′″ that is part of the

laser listening device

16, 16′, 16″, 16′″ hardware. Alternatively the

laser listening signal

23, 23′, 23″, 23′″ includes two data sets, one being a value for the

laser beam

18, 18′, 18″, 18′″ and a second being a value for the

reflected beam

22, 22′, 22″, 22′″ which are then received by and interpreted by the controller 24.

FIG. 1 depicts one

laser listening device

16, 16′, 16″, 16′″ associated with a single sound panel. However, it is within the scope of this invention for one laser listening device to associate with multiple sound panels using multiple laser beams and photo sensors provided that the single laser listening device is positioned at a location that provide sufficient line of sight with multiple sound panels.

The controller 24 uses the

laser listening signal

23, 23′, 23″, 23′″ to determine the presence of a pre-identified command of the user and then operates an actuator 30 in the vehicle 12 in response to the pre-identified command. The type of actuator 30 can include but is not limited to door unlocking, door opening, window opening, vehicle ignition, vehicle lights, opening rear lift gate or trunk and emergency functions such as sounding the horn and flashing the vehicle lights. The type of command can be preset or learned by the controller 24 using setup software programmed into the controller 24 and will include spoken words like “start”, “open liftgate”, “unlock”, “lock”, “lights on”, “lights off”, “help”, “open windows”, “close windows” or any other verbal commands in any type of spoken language. In order to provide extra security, the voice activation system 10 is optionally programmed to only operate when a key fob or other identification device 28 such as a smartphone is detected within a predetermined distance from the vehicle 12, depicted in FIG. 1 as a perimeter circle 27 around vehicle 12. This will ensure that the voice command being detected is that of the vehicle owner.

In FIG. 1 the controller 24 is depicted to receive the

laser listening signal

23, 23′, 23″, 23′″ from multiple

laser listening devices

16, 16′, 16″, 16′″. The controller 24 has voice activation software programmed thereon that it either preprogrammed with or learns the different commands. The voice activation software can also perform analysis of each

laser listening signal

23, 23′, 23″, 23′″ in order to determination variations in vibrations at each of the sound panels, thereby filtering out ambient noise that can be interpreted as false command signals. FIG. 2 depicts a graph of each

laser listening signal

23, 23′, 23″, 23′″ received by the controller 24 plotted as decibels over time. As shown the laser listening signal 23 has several large peaks that are higher than the lines for laser listening signal 23′, 23″, 23′″. A line 32 has been drawn horizontally across the graph to illustrate that the decibel readings below line 32 are ambient noise readings that the voice activation software program will filter out and ignore as ambient noise, while focusing on the peak values of the laser listening signal 23 to determine if a real command has been given. FIG. 2 contains just one example of the filtering operations performed by the controller 24 using the voice activation software programmed thereon. It is possible that the controller can perform other filtering operations where there are more complex overlapping signal values. It is also within the scope of this invention for the controller to communicate with and utilize pre-existing onboard speech recognition software that resides on other hardware in the vehicle, such as in the vehicle electronic control unit, entertainment unit or other control unit.

In another aspect of the invention shown in FIG. 1 the voice activation system 10 includes a microphone 34 mounted to the exterior of the vehicle 12. The microphone 34 as shown is mounted to a side view mirror and “listens” to sounds outside of the vehicle 12. It is within the scope of this invention for the microphone 34 to be mounted to other locations on the external surface of the vehicle 12 or at locations on the interior of the vehicle 12, for example the microphone 34 can be mounted to bumpers, spoilers, or in the actual body panels of the vehicle 12. The microphone 34 provides a microphone signal 36 to the controller 14 that is interpreted with other data to filter our ambient noise, thereby improving the accuracy of the voice activation system. Additionally microphones are used in combination with the

laser listening devices

16, 16′, 16″, 16′″ at other locations in the vehicle and not just externally on the vehicle. For example in FIG. 3 a microphone 34′ is mounted on the inside surface of a moveable liftgate 36, since when the liftgate 36 is swung open the laser listening device 16′″ might not work because the rear window 14′″ has been swung out of the line of sight for the laser beam 18′″. In such a case the microphone 34′ will be able to “listen” for a command from a user, for example a command to close the liftgate 36 can now be detected.

Also shown in FIG. 3 is a laser listening device 38 mounted to the exterior surface of the vehicle 12. In this embodiment the laser listening device 38 is mounted to a rear spoiler 40 that overhangs the rear window 14′″. It is within the scope of this invention to position the laser listening devices on other external surfaces of the vehicle 12 at other locations that overhang or extend past the at least one sound panel. Additional possible locations include, but are not limited to spoilers, center high mounted stop lamp housings, backup camera housings, door handles, side view mirrors and one exterior door panels.

FIG. 4 depicts a perspective view of the laser listening device 16′″ mounted to a headliner 38 on the inside passenger compartment 13 of the vehicle 12. The laser listening device 16′″ projects the laser beam 18′″ onto the rear window 14′″ of a vehicle liftgate 36. The laser beam 18′″ is reflected creating a reflected beam 22′″ that is detected by the photo sensor 20′″. Also shown in an alternate placement of a laser listening device 40 in a head rest 42, which projects a laser beam and receives a reflected beam onto the rear window 14′″. Such placement can be used in applications where different reflected beam reflection angles are desired.

FIG. 5 is a schematic view of an alternate embodiment of a voice activation system 100. This particular embodiment has an optional closed system in that there is optionally a housing 102 with the sound panel 104 connected to the housing 102 in a way that the sound panel 104 can reverberate vibrations from the exterior environment. To assist in allowing the sound panel 104 to vibrate there is a spring or rubber grommet 106 between the sound panel 104 and a flange of the housing 102. The sound panel 104 can be made of any suitable material that allows sound to reverberate through the sound panel 104 and can include glass, plastic, metal or any other material. At an end of the housing 102 opposite the sound panel 104 there is a laser listening device 116 that has a laser beam source 117 the projects a laser beam 118 toward the surface of the sound panel 104 in a manner similar to the embodiment described above. The laser beam 118 strikes and reflects off the surface of the sound panel 104, thereby creating a reflected beam 122. The reflected beam 122 is detected by a photosensor 120 that is part of the laser listening device. Signals from the photosensor 120 and the laser beam source 117 are optionally send to a comparator 126, which then generates a laser listening signal 123 that is transmitted to a controller 124. The laser listening signal 123 is based on a comparison of the laser beam 118 and the detected reflective beam 122.

Those skilled in the art can now appreciate from the foregoing description that the broad teachings of the present invention can be implemented in a variety of forms. Therefore, while this invention has been described in connection with particular examples thereof, the true scope of the invention should not be so limited, since other modifications will become apparent to the skilled practitioner upon a study of the drawings, specification and following claims.

Claims

What is claimed is:

1. A voice activation system for a vehicle comprising:

a vehicle which includes at least one sound panel capable of reverberating vibrations of a user's voice from the outside of the vehicle;

a laser listening device mounted to the vehicle and producing a laser beam that is projected onto the at least one sound panel, said laser listening device uses the laser beam to detect vibrations from a user's voice that are reverberated by the at least one panel and generating a laser listening signal indicative of the vibrations detected by the laser listening device, wherein the laser listening device further includes a photo sensor for detecting the movement of the at least one sound panel by detecting the reflection of the laser beam off the at least one sound panel; and

a controller for receiving the laser listening signal and determining the presence of a pre-identified command of the user and operating an action in the vehicle in response thereto.

2. The voice activation system for a vehicle of claim 1 wherein the controller is a computer device connect to the vehicle and includes voice activation software programmed onto the controller.

3. The voice activation system for a vehicle of claim 2 wherein said controller also includes control hardware operationally connected to the vehicle for controlling at least one action in the vehicle.

4. The voice activation system for a vehicle of claim 3 wherein the at least one action is one selected from the group including door unlocking, door opening, window opening, vehicle ignition, vehicle lights, opening rear lift gate or trunk, and emergency.

5. The voice activation system of claim 1 wherein the laser beam reflects off the at least one sound panel at an angle of about 90 degrees.

6. The voice activation system of claim 1 wherein the laser listening device is mounted in a headliner of a vehicle passenger compartment and the at least one sound panel is a window of the vehicle passenger compartment.

7. The voice activation system of claim 1 wherein the laser listening device is mounted on an exterior surface of the vehicle and the at least one sound panel is a window of the vehicle.

8. The voice activation system of claim 7 wherein the laser listening device is mounted to one of a spoiler, a center high mounted stop lamp housing, a back-up camera housing and a side view mirror housing.

9. The voice activation system of claim 1 further comprising a microphone mounted to the exterior of the vehicle, configured to detect sound from the outside of the vehicle and generate a listening signal to the controller, wherein the controller receives both the microphone listening signal and the laser listening signal and performs a comparison to filter out ambient noise from outside the vehicle.

10. A voice activation system for a vehicle comprising:

a vehicle which includes a plurality of window panels each having an outside surface exposed to the exterior of the vehicle and an inside surface exposed to an interior of a passenger compartment of the vehicle;

a plurality of laser listening devices located in the interior of the passenger compartment, wherein in each one of the plurality of laser listening devices is operatively positioned relative to the interior surface of a respective one of the plurality of window panels so that the each one of the plurality of laser listening devices can project a laser beam onto the inside surface of the respective one of the plurality of window panels so that the plurality of laser listening device use the laser beam to detect vibrations from a user's voice that are reverberated to the inside surface where the respective one of the plurality of laser listening devices generate a laser listening signal indicative of the vibrations detected by the respective one of the plurality of laser listening devices, wherein the plurality of laser listening devices further include a photo sensor for detecting the movement of the respective one of the plurality of window panels by detecting the reflection of the laser beam off the at least one sound panel; and

a controller for receiving the laser listening signal from each of the plurality of laser listening devices and determining the presence of a pre-identified command of the user and operating an action in the vehicle in response thereto.

11. The voice activation system for a vehicle of claim 10 wherein the controller compares each laser listening signal to determine variations in vibrations at each of the plurality of window panels and filter ambient noise from outside of the vehicle.

12. The voice activation system for a vehicle of claim 10 wherein the controller is a computer device connect to the vehicle and includes voice activation software programmed onto the controller.

13. The voice activation system for a vehicle of claim 12 wherein said controller also includes control hardware operationally connected to the vehicle for controlling at least one action in the vehicle.

14. The voice activation system for a vehicle of claim 13 wherein the at least one action is one selected from the group including door unlocking, door opening, window opening, vehicle ignition, vehicle lights, opening rear lift gate or trunk, and emergency.

15. The voice activation system of claim 10 wherein the laser beam reflects off the respective one of the plurality of window panels at an angle of about 90 degrees.

16. The voice activation system of claim 10 wherein each one of the plurality of laser listening devices is mounted in a headliner of the interior of the vehicle passenger compartment.

17. The voice activation system of claim 10 wherein each one of the plurality of laser listening devices is mounted on an exterior surface of the vehicle.

18. The voice activation system of claim 17 wherein each one of the plurality of laser listening devices is mounted to one of a spoiler, a center high mounted stop lamp housing, a back-up camera housing and a side view mirror housing.

19. The voice activation system of claim 10 further comprising a microphone mounted to the exterior of the vehicle, configured to detect sound from the outside of the vehicle and generate a listening signal to the controller, wherein the controller receives both the microphone listening signal and the laser listening signal from each one of the plurality of laser listening devices and performs a comparison to filter out ambient noise from outside the vehicle.

20. A voice activation system for a vehicle comprising:

a laser listening device mounted to the vehicle and producing a laser beam that is projected onto the at least one sound panel, said laser listening device uses the laser beam to detect vibrations from a user's voice that are reverberated by the at least one panel and generating a laser listening signal indicative of the vibrations detected by the laser listening device;

a controller for receiving the laser listening signal and determining the presence of a pre-identified command of the user and operating an action in the vehicle in response thereto; and

a microphone mounted to the exterior of the vehicle, configured to detect sound from the outside of the vehicle and generate a listening signal to the controller, wherein the controller receives both the microphone listening signal and the laser listening signal and performs a comparison to filter out ambient noise from outside the vehicle.

21. The voice activation system for a vehicle of claim 20 wherein the controller is a computer device connect to the vehicle and includes voice activation software programmed onto the controller.

22. The voice activation system for a vehicle of claim 21 wherein said controller also includes control hardware operationally connected to the vehicle for controlling at least one action in the vehicle.

23. The voice activation system for a vehicle of claim 22 wherein the at least one action is one selected from the group including door unlocking, door opening, window opening, vehicle ignition, vehicle lights, opening rear lift gate or trunk, and emergency.

24. The voice activation system of claim 20 wherein the laser listening device further includes a photo sensor for detecting the movement of the at least one sound panel by detecting the reflection of the laser beam off the at least one sound panel.

25. The voice activation system of claim 20 wherein the laser beam reflects off the at least one sound panel at an angle of about 90 degrees.

26. The voice activation system of claim 20 wherein the laser listening device is mounted in a headliner of a vehicle passenger compartment and the at least one sound panel is a window of the vehicle passenger compartment.

27. The voice activation system of claim 20 wherein the laser listening device is mounted on an exterior surface of the vehicle and the at least one sound panel is a window of the vehicle.

28. The voice activation system of claim 27 wherein the laser listening device is mounted to one of a spoiler, a center high mounted stop lamp housing, a back-up camera housing and a side view mirror housing.

29. A voice activation system for a vehicle comprising:

a plurality of laser listening devices located in the interior of the passenger compartment, wherein in each one of the plurality of laser listening devices is operatively positioned relative to the interior surface of a respective one of the plurality of window panels so that the each one of the plurality of laser listening devices can project a laser beam onto the inside surface of the respective one of the plurality of window panels so that the plurality of laser listening device use the laser beam to detect vibrations from a user's voice that are reverberated to the inside surface where the respective one of the plurality of laser listening devices generate a laser listening signal indicative of the vibrations detected by the respective one of the plurality of laser listening devices;

a controller for receiving the laser listening signal from each of the plurality of laser listening devices and determining the presence of a pre-identified command of the user and operating an action in the vehicle in response thereto; and

a microphone mounted to the exterior of the vehicle, configured to detect sound from the outside of the vehicle and generate a listening signal to the controller, wherein the controller receives both the microphone listening signal and the laser listening signal from each one of the plurality of laser listening devices and performs a comparison to filter out ambient noise from outside the vehicle.

30. The voice activation system for a vehicle of claim 29 wherein the controller compares each laser listening signal to determine variations in vibrations at each of the plurality of window panels and filter ambient noise from outside of the vehicle.

31. The voice activation system for a vehicle of claim 29 wherein the controller is a computer device connect to the vehicle and includes voice activation software programmed onto the controller.

32. The voice activation system for a vehicle of claim 31 wherein said controller also includes control hardware operationally connected to the vehicle for controlling at least one action in the vehicle.

33. The voice activation system for a vehicle of claim 32 wherein the at least one action is one selected from the group including door unlocking, door opening, window opening, vehicle ignition, vehicle lights, opening rear lift gate or trunk, and emergency.

34. The voice activation system of claim 29 wherein the laser beam reflects off the respective one of the plurality of window panels at an angle of about 90 degrees.

35. The voice activation system of claim 29 wherein each one of the plurality of laser listening devices is mounted in a headliner of the interior of the vehicle passenger compartment.

36. The voice activation system of claim 29 wherein each one of the plurality of laser listening devices is mounted on an exterior surface of the vehicle.

37. The voice activation system of claim 36 wherein each one of the plurality of laser listening devices is mounted to one of a spoiler, a center high mounted stop lamp housing, a back-up camera housing and a side view mirror housing.

38. The voice activation system of claim 29 wherein each of the plurality of laser listening devices further include a photo sensor for detecting the movement of the at least one sound panel by detecting the reflection of the laser beam off the at least one sound panel.