KR20200023671A - Robot for vehicle mounted on the vehcile and method for controlling the robot for vehicle - Google Patents

Abstract

The present invention relates to a robot for a vehicle provided in a vehicle and to a control method of the robot for a vehicle. According to one embodiment of the present invention, the robot for a vehicle comprises: a body formed to be mountable on a vehicle; a head mounted on the body and formed to be rotatable; a camera disposed at a front surface or a rear surface of the head; and a processor controlling the camera and controlling a driving unit to rotate the head. The processor selects necessary guide information in accordance with a situation of a driver, and extracts the guide information based on information data for extracting the guide information. The information data for extracting the guide information is set differently in accordance with the type of the guide information.

Description

ROBOT FOR VEHICLE MOUNTED ON THE VEHCILE AND METHOD FOR CONTROLLING THE ROBOT FOR VEHICLE}

The present invention relates to a vehicle robot and a method for controlling the vehicle robot provided in a vehicle.

The vehicle is a device capable of moving in the direction desired by the user on board. An example is a car.

On the other hand, for the convenience of a user using a vehicle, various sensors, electronic devices, and the like have been provided. In particular, research on the Advanced Driver Assistance System (ADAS) has been actively conducted for the user's driving convenience. In addition, development of autonomous vehicles is being actively conducted.

On the other hand, as the development of the ADAS (Advanced Driving Assist System) has been actively made in recent years, the necessity of the development of technology for maximizing user convenience and safety in vehicle operation is emerging.

Also, in recent years, there has been a growing interest in on-vehicle robots that can help a driver drive a vehicle, and as technology advances, functions that can be performed by in-vehicle robots are expanding.

One object of the present invention is to provide a vehicle robot capable of providing an optimized function associated with a vehicle.

Another object of the present invention is to provide a vehicle robot capable of selecting guide information necessary for a situation of a vehicle and a driver, and extracting the guide information from different information data according to the sorted guide information.

The objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the body formed to be mounted on the vehicle; A head mounted to the body and configured to be rotatable; A camera disposed at the front or rear of the head; And a processor configured to control the camera and to control the driving unit to rotate the head, wherein the processor selects the necessary guide information according to a driver's situation and based on the information data for extracting the guide information. Characterized in that the information is extracted, the information data for extracting the guide information may be set differently according to the type of the guide information.

In an embodiment, the processor monitors the vehicle within a predetermined distance based on the vehicle, and selects an expected destination as the guide information when it is detected that the driver approaches the vehicle for boarding. have.

In this case, the information data for extracting the expected destination may include at least one of a driving route of each time zone of the driver, schedule information, an information search record, and a message transmitted and received.

The processor extracts at least one expected destination based on the information data, and when the driver rides in the vehicle, controls the driving unit so that the front of the head faces the driver, and the at least one A control signal may be generated to output information about an expected destination on the in-vehicle display device.

In another embodiment, the processor monitors the driver through the camera and selects the time remaining until the signal change as the guide information when the vehicle detects a situation in which the driver does not look forward while the vehicle waits for the signal. can do.

As a specific example, when the driver watches the mobile terminal, the processor generates a control signal for outputting the time remaining until the signal change on the display unit of the mobile terminal, and transmits the control signal to the mobile terminal. Can be controlled.

According to another embodiment, when the vehicle is waiting for a signal at an intersection where a plurality of traffic lights exist, the processor may select, as the guide information, the remaining time until the signal light and a signal change among the plurality of traffic lights. Can be.

In this case, the traffic light waiting for the vehicle and the information data for extracting the time remaining until the signal change may include at least one of an expected driving route of the vehicle, an order of changing the signal at the intersection and a waiting time.

The processor may generate a control signal for outputting an image of photographing the plurality of traffic lights through the camera to be output from the display device in the vehicle, and input the user to select one of the plurality of traffic lights on the display device. Based on this addition, the time remaining until the signal change of the selected traffic light can be extracted as the guide information.

A vehicle according to an embodiment of the present invention includes a vehicle robot described herein.

Specific details of other embodiments are included in the detailed description and the drawings.

According to an embodiment of the present invention, there are one or more of the following effects.

According to the present invention, different information data may be used according to the type of guide information to be guided to the driver. In addition, as various types of information data are used to extract one guide information, accuracy may be increased.

According to another aspect of the present invention, the manner of guiding the guide information may vary according to the information data for extracting the guide information and the situation of the driver or the vehicle. That is, guide information optimized for the current situation may be provided.

For example, when predicting a destination of a driver before boarding a vehicle, the destination may be predicted in advance based on the learned driver's lifestyle and moving route, a future schedule, and a mobile phone operation. In addition, the real-time traffic situation and time required for each of the estimated destinations may be calculated in advance, and the driver may be provided on the first screen so that the driver can immediately check the navigation. As a result, the trouble of requiring the driver to input a destination separately can be solved, and preparation time before departure can be saved.

As another example, the signal change prediction may detect a situation where the user does not look forward, such as eyes closed or staring at a mobile phone, based on a driver monitoring camera or a camera of a vehicle robot. The driver's attention can be refocused by notifying the remaining time until the signal is changed by the voice before the signal is changed.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.
2 is a view of the vehicle according to an embodiment of the present invention from various angles from the outside.
3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.
5 to 6 are views referred to for describing an object according to an embodiment of the present invention.
7 is a block diagram referred to describe a vehicle according to an embodiment of the present invention.
8, 9A and 9B are conceptual views illustrating a vehicle robot according to an exemplary embodiment of the present invention.
10, 11A, 11B, 11C, 12A, and 12B are conceptual views illustrating a control method of a vehicle robot according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, and the same or similar components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or mixed in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easily understanding the embodiments disclosed in the present specification, the technical idea disclosed in the specification by the accompanying drawings are not limited, and all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

When a component is said to be "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that another component may be present in the middle. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The vehicle described herein may be a concept including an automobile and a motorcycle. In the following, a vehicle is mainly described for a vehicle.

The vehicle described herein may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, an electric vehicle having an electric motor as a power source, and the like.

In the following description, the left side of the vehicle means the left side of the driving direction of the vehicle, and the right side of the vehicle means the right side of the driving direction of the vehicle.

1 is a view showing the appearance of a vehicle according to an embodiment of the present invention.

2 is a view of the vehicle according to an embodiment of the present invention from various angles from the outside.

3 to 4 are views showing the interior of a vehicle according to an embodiment of the present invention.

5 to 6 are views referred to for describing an object according to an embodiment of the present invention.

7 is a block diagram referred to describe a vehicle according to an embodiment of the present invention.

1 to 7, the vehicle 100 may include a wheel that rotates by a power source and a steering input device 510 for adjusting a traveling direction of the vehicle 100.

The vehicle 100 may be an autonomous vehicle.

The vehicle 100 may be switched to an autonomous driving mode or a manual mode based on a user input.

For example, the vehicle 100 may switch from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the received user input through the user interface device 200.

The vehicle 100 may be switched to the autonomous driving mode or the manual mode based on the driving situation information. The driving situation information may be generated based on the object information provided by the object detecting apparatus 300.

For example, the vehicle 100 may be switched from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information generated by the object detecting apparatus 300.

For example, the vehicle 100 may switch from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on the driving situation information received through the communication device 400.

The vehicle 100 may switch from the manual mode to the autonomous driving mode or from the autonomous driving mode to the manual mode based on information, data, and signals provided from an external device.

When the vehicle 100 is driven in the autonomous driving mode, the autonomous vehicle 100 may be driven based on the driving system 700.

For example, the autonomous vehicle 100 may be driven based on information, data, or signals generated by the driving system 710, the parking system 740, and the parking system 750.

When the vehicle 100 is driven in the manual mode, the autonomous vehicle 100 may receive a user input for driving through the driving manipulation apparatus 500. The vehicle 100 may be driven based on a user input received through the driving manipulation apparatus 500.

The overall length is the length from the front to the rear of the vehicle 100, the width is the width of the vehicle 100, and the height is the length from the bottom of the wheel to the roof. In the following description, the full-length direction L is a direction in which the full-length measurement of the vehicle 100 is a reference, the full-width direction W is a direction in which the full-width measurement of the vehicle 100 is a reference, and the total height direction H is a vehicle. It may mean the direction that is the basis of the height measurement of (100).

As illustrated in FIG. 7, the vehicle 100 includes a user interface device 200, an object detecting device 300, a communication device 400, a driving manipulation device 500, a vehicle driving device 600, and a traveling system. 700, a navigation system 770, a sensing unit 120, an interface unit 130, a memory 140, a control unit 170, and a power supply unit 190 may be included.

According to an embodiment, the vehicle 100 may further include other components in addition to the components described herein, or may not include some of the components described.

The user interface device 200 is a device for communicating with the vehicle 100 and a user. The user interface device 200 may receive a user input and provide the user with information generated by the vehicle 100. The vehicle 100 may implement user interfaces (UI) or user experience (UX) through the user interface device 200.

The user interface device 200 may include an input unit 210, an internal camera 220, a biometric detector 230, an output unit 250, and a processor 270.

According to an embodiment, the user interface device 200 may further include other components in addition to the described components, or may not include some of the described components.

The input unit 210 is for receiving information from a user, and the data collected by the input unit 210 may be analyzed by the processor 270 and processed as a user's control command.

The input unit 210 may be disposed in the vehicle. For example, the input unit 210 may include one area of a steering wheel, one area of an instrument panel, one area of a seat, one area of each pillar, and a door. one area of the door, one area of the center console, one area of the head lining, one area of the sun visor, one area of the windshield, or of the window It may be disposed in one area or the like.

The input unit 210 may include a voice input unit 211, a gesture input unit 212, a touch input unit 213, and a mechanical input unit 214.

The voice input unit 211 may convert a voice input of the user into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The voice input unit 211 may include one or more microphones.

The gesture input unit 212 may convert a user's gesture input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The gesture input unit 212 may include at least one of an infrared sensor and an image sensor for detecting a user's gesture input.

According to an embodiment, the gesture input unit 212 may detect a 3D gesture input of a user. To this end, the gesture input unit 212 may include a light output unit or a plurality of image sensors that output a plurality of infrared light.

The gesture input unit 212 may detect a user's 3D gesture input through a time of flight (TOF) method, a structured light method, or a disparity method.

The touch input unit 213 may convert a user's touch input into an electrical signal. The converted electrical signal may be provided to the processor 270 or the controller 170.

The touch input unit 213 may include a touch sensor for detecting a user's touch input.

According to an exemplary embodiment, the touch input unit 213 may be integrally formed with the display unit 251 to implement a touch screen. Such a touch screen may provide an input interface and an output interface between the vehicle 100 and the user.

The mechanical input unit 214 may include at least one of a button, a dome switch, a jog wheel, and a jog switch. The electrical signal generated by the mechanical input unit 214 may be provided to the processor 270 or the controller 170.

The mechanical input unit 214 may be disposed on a steering wheel, a cente facia, a center console, a cockpit module, a door, or the like.

The internal camera 220 may acquire a vehicle interior image. The processor 270 may detect a state of the user based on the vehicle interior image. The processor 270 may acquire the gaze information of the user from the vehicle interior image. The processor 270 may detect the gesture of the user in the vehicle interior image.

The biometric detector 230 may acquire biometric information of the user. The biometric detector 230 may include a sensor capable of acquiring biometric information of the user, and may acquire fingerprint information, heartbeat information, etc. of the user using the sensor. Biometric information may be used for user authentication.

The output unit 250 is for generating output related to visual, auditory or tactile.

The output unit 250 may include at least one of the display unit 251, the audio output unit 252, and the haptic output unit 253.

The display unit 251 may display graphic objects corresponding to various pieces of information.

The display unit 251 is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible) display, a 3D display, and an e-ink display.

The display unit 251 forms a layer structure or is integrally formed with the touch input unit 213 to implement a touch screen.

The display unit 251 may be implemented as a head up display (HUD). When the display unit 251 is implemented as a HUD, the display unit 251 may include a projection module to output information through an image projected on a wind shield or a window.

The display unit 251 may include a transparent display. The transparent display can be attached to the wind shield or window.

The transparent display may display a predetermined screen while having a predetermined transparency. Transparent display, in order to have transparency, transparent display is transparent thin film elecroluminescent (TFEL), transparent organic light-emitting diode (OLED), transparent liquid crystal display (LCD), transmissive transparent display, transparent light emitting diode (LED) display It may include at least one of. The transparency of the transparent display can be adjusted.

The user interface device 200 may include a plurality of display units 251a to 251g.

The display unit 251 may include one region of the steering wheel, one region 251a, 251b, and 251e of the instrument panel, one region 251d of the seat, one region 251f of each pillar, and one region of the door ( 251g), one region of the center console, one region of the head lining, and one region of the sun visor, or may be implemented in one region 251c of the wind shield and one region 251h of the window.

The sound output unit 252 converts an electrical signal provided from the processor 270 or the controller 170 into an audio signal and outputs the audio signal. To this end, the sound output unit 252 may include one or more speakers.

The haptic output unit 253 generates a tactile output. For example, the haptic output unit 253 may vibrate the steering wheel, the seat belt, and the seats 110FL, 110FR, 110RL, and 110RR so that the user may recognize the output.

The processor 270 may control the overall operation of each unit of the user interface device 200.

According to an embodiment, the user interface device 200 may include a plurality of processors 270 or may not include the processor 270.

When the processor 270 is not included in the user interface device 200, the user interface device 200 may be operated under the control of the processor or the controller 170 of another device in the vehicle 100.

The user interface device 200 may be referred to as a vehicle display device.

The user interface device 200 may be operated under the control of the controller 170.

The object detecting apparatus 300 is a device for detecting an object located outside the vehicle 100.

The object may be various objects related to the driving of the vehicle 100.

5 to 6, the object O includes a lane OB10, another vehicle OB11, a pedestrian OB12, a two-wheeled vehicle OB13, traffic signals OB14, OB15, light, a road, a structure, Speed bumps, features, animals and the like can be included.

The lane OB10 may be a driving lane, a lane next to the driving lane, and a lane in which an opposite vehicle travels. Lane OB10 may be a concept including left and right lines forming a lane.

The other vehicle OB11 may be a vehicle that is driving around the vehicle 100. The other vehicle may be a vehicle located within a predetermined distance from the vehicle 100. For example, the other vehicle OB11 may be a vehicle that precedes or follows the vehicle 100.

The pedestrian OB12 may be a person located near the vehicle 100. The pedestrian OB12 may be a person located within a predetermined distance from the vehicle 100. For example, the pedestrian OB12 may be a person located on a sidewalk or a roadway.

The two-wheeled vehicle OB13 may be a vehicle that is positioned around the vehicle 100 and moves using two wheels. The motorcycle OB13 may be a vehicle having two wheels located within a predetermined distance from the vehicle 100. For example, the motorcycle OB13 may be a motorcycle or a bicycle located on a sidewalk or a roadway.

The traffic signal may include a traffic light OB15, a traffic sign OB14, and a pattern or text drawn on a road surface.

The light may be light generated by a lamp provided to another vehicle, light generated by a street lamp, or sunlight.

The road may include road surfaces, curves, uphill slopes, and downhill slopes.

The structure may be an object located around a road and fixed to the ground. For example, the structure may include a street lamp, a roadside tree, a building, a power pole, a traffic light, a bridge.

The features may include mountains, hills, and the like.

On the other hand, the object may be classified into a moving object and a fixed object. For example, the moving object may be a concept including another vehicle and a pedestrian. For example, the fixed object may be a concept including a traffic signal, a road, and a structure.

The object detecting apparatus 300 may include a camera 310, a radar 320, a lidar 330, an ultrasonic sensor 340, an infrared sensor 350, and a processor 370.

According to an embodiment, the object detecting apparatus 300 may further include other components in addition to the described components, or may not include some of the described components.

The camera 310 may be located at a suitable place outside the vehicle to acquire an image outside the vehicle. The camera 310 may be a mono camera, a stereo camera 310a, an around view monitoring (AVM) camera 310b, or a 360 degree camera.

For example, the camera 310 may be disposed in close proximity to the front windshield in the interior of the vehicle to obtain an image of the front of the vehicle. Alternatively, the camera 310 may be disposed around the front bumper or the radiator grille.

For example, the camera 310 may be disposed in close proximity to the rear glass in the interior of the vehicle to acquire an image of the rear of the vehicle. Alternatively, the camera 310 may be disposed around the rear bumper, the trunk, or the tail gate.

For example, the camera 310 may be disposed close to at least one of the side windows in the interior of the vehicle in order to acquire an image of the vehicle side. Alternatively, the camera 310 may be arranged around the side mirror, fender or door.

The camera 310 may provide the obtained image to the processor 370.

The radar 320 may include an electromagnetic wave transmitter and a receiver. The radar 320 may be implemented in a pulse radar method or a continuous wave radar method in terms of radio wave firing principle. The radar 320 may be implemented in a frequency modulated continuous wave (FSCW) method or a frequency shift key (FSK) method according to a signal waveform among continuous wave radar methods.

The radar 320 detects an object based on a time of flight (TOF) method or a phase-shift method based on an electromagnetic wave, and detects the position of the detected object, distance to the detected object, and relative velocity. Can be detected.

The radar 320 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The lidar 330 may include a laser transmitter and a receiver. The lidar 330 may be implemented in a time of flight (TOF) method or a phase-shift method.

The lidar 330 may be implemented as driven or non-driven.

When implemented in a driven manner, the lidar 330 may be rotated by a motor and detect an object around the vehicle 100.

When implemented in a non-driven manner, the lidar 330 may detect an object located within a predetermined range with respect to the vehicle 100 by optical steering. The vehicle 100 may include a plurality of non-driven lidars 330.

The lidar 330 detects an object based on a time of flight (TOF) method or a phase-shift method using laser light, and detects an object, a position of the detected object, a distance from the detected object, and Relative speed can be detected.

The lidar 330 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The ultrasonic sensor 340 may include an ultrasonic transmitter and a receiver. The ultrasonic sensor 340 may detect an object based on the ultrasonic wave, and detect a position of the detected object, a distance to the detected object, and a relative speed.

The ultrasonic sensor 340 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The infrared sensor 350 may include an infrared transmitter and a receiver. The infrared sensor 340 may detect an object based on infrared light, and detect a position of the detected object, a distance to the detected object, and a relative speed.

The infrared sensor 350 may be disposed at an appropriate position outside the vehicle to detect an object located in front, rear, or side of the vehicle.

The processor 370 may control overall operations of each unit of the object detecting apparatus 300.

The processor 370 may detect and track the object based on the obtained image. The processor 370 may perform operations such as calculating a distance to an object and calculating a relative speed with the object through an image processing algorithm.

The processor 370 may detect and track the object based on the reflected electromagnetic wave reflected by the transmitted electromagnetic wave to the object. The processor 370 may perform an operation such as calculating a distance from the object, calculating a relative speed with the object, and the like based on the electromagnetic waves.

The processor 370 may detect and track the object based on the reflected laser light reflected by the transmitted laser back to the object. The processor 370 may perform an operation such as calculating a distance to the object, calculating a relative speed with the object, and the like based on the laser light.

The processor 370 may detect and track the object based on the reflected ultrasound, in which the transmitted ultrasound is reflected back to the object. The processor 370 may perform an operation such as calculating a distance from the object, calculating a relative speed with the object, and the like based on the ultrasound.

The processor 370 may detect and track the object based on the reflected infrared light from which the transmitted infrared light is reflected back to the object. The processor 370 may perform an operation such as calculating a distance to the object, calculating a relative speed with the object, and the like based on the infrared light.

According to an embodiment, the object detecting apparatus 300 may include a plurality of processors 370 or may not include the processor 370. For example, each of the camera 310, the radar 320, the lidar 330, the ultrasonic sensor 340, and the infrared sensor 350 may individually include a processor.

When the processor 370 is not included in the object detecting apparatus 300, the object detecting apparatus 300 may be operated under the control of the processor or the controller 170 of the apparatus in the vehicle 100.

The object detecting apparatus 400 may be operated under the control of the controller 170.

The communication device 400 is a device for performing communication with an external device. Here, the external device may be another vehicle, a mobile terminal or a server.

The communication device 400 may include at least one of a transmit antenna, a receive antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication device 400 may include a short range communication unit 410, a location information unit 420, a V2X communication unit 430, an optical communication unit 440, a broadcast transceiver 450, and a processor 470.

According to an embodiment, the communication device 400 may further include other components in addition to the described components, or may not include some of the described components.

The short range communication unit 410 is a unit for short range communication. The short range communication unit 410 may include Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and Wi-Fi (Wireless). Local area communication may be supported using at least one of Fidelity, Wi-Fi Direct, and Wireless Universal Serial Bus (Wireless USB) technologies.

The local area communication unit 410 may form local area wireless networks to perform local area communication between the vehicle 100 and at least one external device.

The location information unit 420 is a unit for obtaining location information of the vehicle 100. For example, the location information unit 420 may include a Global Positioning System (GPS) module or a Differential Global Positioning System (DGPS) module.

The V2X communication unit 430 is a unit for performing wireless communication with a server (V2I: Vehicle to Infra), another vehicle (V2V: Vehicle to Vehicle), or a pedestrian (V2P: Vehicle to Pedestrian). The V2X communication unit 430 may include an RF circuit capable of implementing communication with infrastructure (V2I), inter-vehicle communication (V2V), and communication with pedestrians (V2P).

The optical communication unit 440 is a unit for communicating with an external device via light. The optical communication unit 440 may include an optical transmitter for converting an electrical signal into an optical signal and transmitting the external signal to the outside, and an optical receiver for converting the received optical signal into an electrical signal.

According to an embodiment, the light emitting unit may be formed to be integrated with the lamp included in the vehicle 100.

The broadcast transceiver 450 is a unit for receiving a broadcast signal from an external broadcast management server or transmitting a broadcast signal to a broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal.

The processor 470 may control the overall operation of each unit of the communication device 400.

According to an embodiment, the communication device 400 may include a plurality of processors 470 or may not include the processor 470.

When the processor 470 is not included in the communication device 400, the communication device 400 may be operated under the control of the processor or the controller 170 of another device in the vehicle 100.

Meanwhile, the communication device 400 may implement a vehicle display device together with the user interface device 200. In this case, the vehicle display device may be called a telematics device or an AVN (Audio Video Navigation) device.

The communication device 400 may be operated under the control of the controller 170.

The driving operation apparatus 500 is a device that receives a user input for driving.

In the manual mode, the vehicle 100 may be driven based on a signal provided by the driving manipulation apparatus 500.

The driving manipulation apparatus 500 may include a steering input apparatus 510, an acceleration input apparatus 530, and a brake input apparatus 570.

The steering input device 510 may receive a driving direction input of the vehicle 100 from the user. The steering input device 510 is preferably formed in a wheel shape to enable steering input by rotation. According to an embodiment, the steering input device may be formed in the form of a touch screen, a touch pad, or a button.

The acceleration input device 530 may receive an input for accelerating the vehicle 100 from a user. The brake input device 570 may receive an input for deceleration of the vehicle 100 from a user. The acceleration input device 530 and the brake input device 570 are preferably formed in the form of a pedal. According to an embodiment, the acceleration input device or the brake input device may be formed in the form of a touch screen, a touch pad, or a button.

The driving manipulation apparatus 500 may be operated under the control of the controller 170.

The vehicle drive device 600 is a device that electrically controls the driving of various devices in the vehicle 100.

The vehicle driving apparatus 600 may include a power train driving unit 610, a chassis driving unit 620, a door / window driving unit 630, a safety device driving unit 640, a lamp driving unit 650, and an air conditioning driving unit 660. Can be.

According to an exemplary embodiment, the vehicle driving apparatus 600 may further include other components in addition to the described components, or may not include some of the described components.

On the other hand, the vehicle driving device 600 may include a processor. Each unit of the vehicle driving apparatus 600 may each include a processor individually.

The power train driver 610 may control the operation of the power train device.

The power train driver 610 may include a power source driver 611 and a transmission driver 612.

The power source driver 611 may control the power source of the vehicle 100.

For example, when the fossil fuel-based engine is a power source, the power source driver 610 may perform electronic control of the engine. Thereby, the output torque of an engine, etc. can be controlled. The power source drive unit 611 can adjust the engine output torque under the control of the control unit 170.

For example, when the electric energy-based motor is a power source, the power source driver 610 may control the motor. The power source driver 610 may adjust the rotational speed, torque, and the like of the motor under the control of the controller 170.

The transmission driver 612 may control the transmission.

The transmission driver 612 can adjust the state of the transmission. The transmission drive part 612 can adjust the state of a transmission to forward D, backward R, neutral N, or parking P. FIG.

On the other hand, when the engine is a power source, the transmission drive unit 612 can adjust the bite state of the gear in the forward D state.

The chassis driver 620 may control the operation of the chassis device.

The chassis driver 620 may include a steering driver 621, a brake driver 622, and a suspension driver 623.

The steering driver 621 may perform electronic control of a steering apparatus in the vehicle 100. The steering driver 621 may change the traveling direction of the vehicle.

The brake driver 622 may perform electronic control of a brake apparatus in the vehicle 100. For example, the speed of the vehicle 100 may be reduced by controlling the operation of the brake disposed on the wheel.

On the other hand, the brake drive unit 622 can individually control each of the plurality of brakes. The brake driver 622 may differently control the braking force applied to the plurality of wheels.

The suspension driver 623 may perform electronic control of the suspension apparatus in the vehicle 100. For example, when there is a curvature on the road surface, the suspension driver 623 may control the suspension device to control the vibration of the vehicle 100 to be reduced.

Meanwhile, the suspension driver 623 may individually control each of the plurality of suspensions.

The door / window driver 630 may perform electronic control of a door apparatus or a window apparatus in the vehicle 100.

The door / window driver 630 may include a door driver 631 and a window driver 632.

The door driver 631 may control the door apparatus. The door driver 631 may control opening and closing of the plurality of doors included in the vehicle 100. The door driver 631 may control the opening or closing of a trunk or a tail gate. The door driver 631 may control the opening or closing of the sunroof.

The window driver 632 may perform electronic control of the window apparatus. The opening or closing of the plurality of windows included in the vehicle 100 may be controlled.

The safety device driver 640 may perform electronic control of various safety devices in the vehicle 100.

The safety device driver 640 may include an airbag driver 641, a seat belt driver 642, and a pedestrian protection device driver 643.

The airbag driver 641 may perform electronic control of an airbag apparatus in the vehicle 100. For example, the airbag driver 641 may control the airbag to be deployed when the danger is detected.

The seat belt driver 642 may perform electronic control of a seatbelt appartus in the vehicle 100. For example, the seat belt driver 642 may control the passengers to be fixed to the seats 110FL, 110FR, 110RL, and 110RR by using the seat belt when detecting a danger.

The pedestrian protection device driver 643 may perform electronic control of the hood lift and the pedestrian airbag. For example, the pedestrian protection device driver 643 may control the hood lift up and the pedestrian airbag to be deployed when the collision with the pedestrian is detected.

The lamp driver 650 may perform electronic control of various lamp apparatuses in the vehicle 100.

The air conditioning driver 660 may perform electronic control of an air conditioner in the vehicle 100. For example, when the temperature inside the vehicle is high, the air conditioning driving unit 660 may control the air conditioner to operate so that cold air is supplied into the vehicle.

The vehicle driving apparatus 600 may include a processor. Each unit of the vehicle driving apparatus 600 may each include a processor individually.

The vehicle driving apparatus 600 may be operated under the control of the controller 170.

The travel system 700 is a system for controlling various travels of the vehicle 100. The navigation system 700 can be operated in an autonomous driving mode.

The travel system 700 may include a travel system 710, a parking system 740, and a parking system 750.

In some embodiments, the navigation system 700 may further include other components in addition to the described components, or may not include some of the described components.

Meanwhile, the driving system 700 may include a processor. Each unit of the navigation system 700 may each include a processor individually.

Meanwhile, according to an embodiment, when the driving system 700 is implemented in software, it may be a lower concept of the controller 170.

In some embodiments, the driving system 700 may include at least one of the user interface device 200, the object detecting device 300, the communication device 400, the vehicle driving device 600, and the controller 170. It may be a concept to include.

The traveling system 710 may perform driving of the vehicle 100.

The driving system 710 may receive navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform driving of the vehicle 100.

The driving system 710 may receive object information from the object detecting apparatus 300 and provide a control signal to the vehicle driving apparatus 600 to perform driving of the vehicle 100.

The driving system 710 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving device 600, and perform driving of the vehicle 100.

The taking-out system 740 may perform taking out of the vehicle 100.

The taking-off system 740 may receive the navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The taking-out system 740 may receive the object information from the object detecting apparatus 300, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The taking-out system 740 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving apparatus 600, and perform take-out of the vehicle 100.

The parking system 750 may perform parking of the vehicle 100.

The parking system 750 may receive navigation information from the navigation system 770, provide a control signal to the vehicle driving apparatus 600, and perform parking of the vehicle 100.

The parking system 750 may receive the object information from the object detecting apparatus 300, provide a control signal to the vehicle driving apparatus 600, and perform parking of the vehicle 100.

The parking system 750 may receive a signal from an external device through the communication device 400, provide a control signal to the vehicle driving device 600, and perform parking of the vehicle 100.

The navigation system 770 may provide navigation information. The navigation information may include at least one of map information, set destination information, route information according to the destination setting, information on various objects on the route, lane information, and current location information of the vehicle.

The navigation system 770 may include a memory and a processor. The memory may store navigation information. The processor may control the operation of the navigation system 770.

According to an embodiment, the navigation system 770 may receive information from an external device through the communication device 400 and update the pre-stored information.

According to an embodiment, the navigation system 770 may be classified as a subcomponent of the user interface device 200.

The sensing unit 120 may sense a state of the vehicle. The sensing unit 120 may include an attitude sensor (eg, a yaw sensor, a roll sensor, a pitch sensor), a collision sensor, a wheel sensor, a speed sensor, and an inclination. Sensor, Weight Sensor, Heading Sensor, Gyro Sensor, Position Module, Vehicle Forward / Reverse Sensor, Battery Sensor, Fuel Sensor, Tire Sensor, Steering Sensor by Handle Rotation, Vehicle And an internal temperature sensor, an in-vehicle humidity sensor, an ultrasonic sensor, an illuminance sensor, an accelerator pedal position sensor, a brake pedal position sensor, and the like.

The sensing unit 120 includes vehicle attitude information, vehicle collision information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / reverse information, battery Acquire sensing signals for information, fuel information, tire information, vehicle lamp information, vehicle internal temperature information, vehicle internal humidity information, steering wheel rotation angle, vehicle external illumination, pressure applied to the accelerator pedal, pressure applied to the brake pedal, and the like. can do.

The sensing unit 120 may further include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor (AFS), an intake temperature sensor (ATS), a water temperature sensor (WTS), and a throttle position sensor. (TPS), TDC sensor, crank angle sensor (CAS), and the like.

The interface unit 130 may serve as a path to various types of external devices connected to the vehicle 100. For example, the interface unit 130 may include a port connectable with the mobile terminal, and may connect with the mobile terminal through the port. In this case, the interface unit 130 may exchange data with the mobile terminal.

Meanwhile, the interface unit 130 may serve as a path for supplying electrical energy to the connected mobile terminal. When the mobile terminal is electrically connected to the interface unit 130, under the control of the controller 170, the interface unit 130 may provide the mobile terminal with electrical energy supplied from the power supply unit 190.

The memory 140 is electrically connected to the controller 170. The memory 140 may store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The memory 140 may be various storage devices such as a ROM, a RAM, an EPROM, a flash drive, a hard drive, and the like, in hardware. The memory 140 may store various data for overall operation of the vehicle 100, such as a program for processing or controlling the controller 170.

According to an embodiment, the memory 140 may be integrally formed with the controller 170 or implemented as a subcomponent of the controller 170.

The controller 170 may control the overall operation of each unit in the vehicle 100. The controller 170 may be referred to as an electronic control unit (ECU).

The power supply unit 190 may supply power required for the operation of each component under the control of the controller 170. In particular, the power supply unit 190 may receive power from a battery in a vehicle.

One or more processors and controllers 170 included in vehicle 100 may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs ( It may be implemented using at least one of field programmable gate arrays, processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions.

Meanwhile, the vehicle 100 related to the present invention may include a vehicle robot 800. The vehicle robot 800 may include any type of device mounted on a vehicle and capable of communicating with a user.

The vehicle robot 800 may be named by various names such as a vehicle secretary robot, a vehicle control agent, a driving assistant communicator, and the like.

Hereinafter, with reference to the accompanying drawings looks at in more detail with respect to the vehicle robot of the present invention.

8, 9A and 9B are conceptual views illustrating a vehicle robot according to an exemplary embodiment of the present invention.

Referring to FIG. 8, the vehicle robot 800 may be provided inside a vehicle to perform interaction (or communication, communication, etc.) with a user (driver or passenger) in the vehicle 100.

For example, the vehicle robot 800 may be provided at an upper portion (or on a dashboard) of the instrument panel of the vehicle. In addition, the vehicle robot 800 may be formed integrally with the instrument panel, or may be formed to be detachable.

When the vehicle robot 800 is formed to be detachable from the vehicle, the vehicle robot 800 may be attached at a position desired by the user, and may be mounted at any position of the vehicle.

The vehicle robot 800 may be formed to enable wired / wireless communication with other devices. For example, the vehicle robot 800 may be connected to the communication device 400 of the vehicle so as to enable wired / wireless communication. In this case, the vehicle robot 800 may transmit and receive data with the vehicle through the communication device 400.

In addition, the vehicle robot 800 may include at least one of the components of the vehicle described with reference to FIG. 7. When the components described in FIG. 7 are included in the vehicular robot 800, the included components may perform the same / similarities to the functions / operations / controls described in FIG. 7.

9A shows a front view of the vehicle robot, and FIG. 9B shows a rear view of the vehicle robot.

Referring to FIG. 9A, the vehicle robot 800 of the present invention may include a body 812 formed to be mounted on a vehicle and a head 810 mounted to the body and rotatably formed.

The body 812 may be formed to be mounted (attached) to a portion of the vehicle. For example, when one side (lower end) of the body 812 is mounted (attached) to a part of the vehicle, the head 810 may be mounted on the other side (upper part) of the body 830.

The head 810 may be attached to the body 812 to be rotatable. Rotation of the head 810 may be performed, for example, by control of the processor 880 of the vehicle robot.

The rotation of the head 810 may include a rotation that returns to the reference line c vertically penetrating the vehicle robot and a rotation that is inclined with respect to the connection portion of the head 810 and the body 812. That is, the head 810 may be rotated, for example, as a human head moves.

The vehicle robot of the present invention may employ any structure (for example, a ball joint or at least one circular gear, etc.) capable of combining two objects and rotating at least one of the two objects. Through the head 810 may be rotated based on the body 812.

The vehicle robot 800 may include various components. For example, it may include a camera 820, 821, a flash 830, an input / output unit 840, a beam output unit 850, a display unit 860, and a processor 880.

These components may be provided in at least one of the head 810 and the body 820 of the vehicle robot 800, for the convenience of description herein cameras 820, 821, flash 830, input / An output unit 840 and a beam output unit 850 are provided in the head 810, and the processor 880 is provided in the body 820.

Referring to FIG. 9A, the vehicle robot 800 of the present invention may include a first camera 820 disposed on the front surface of the head 810.

For example, the first camera 820 may include at least two cameras 820a and 820b. The processor 880 measures the distance between an object existing outside the vehicle and the robot for the vehicle by using the at least two cameras 820a and 820b or receives the received information through the first camera 820. Depth information of an image (or a preview image, a live image, etc.) may be extracted.

In addition, the flash 830 provided in the vehicle robot 800 of the present invention may be provided at, for example, the front surface of the head 810, and may be mounted around the first camera 820.

The flash 830 may output light so that the brightness of an image received through the first camera 820 is brightened. In addition, the flash 830 may be formed to output structured light having a predetermined pattern.

For example, the flash 830 may include a plurality of laser light elements (for example, VCSELs) in a predetermined pattern.

When the image is received through the first camera 820, the processor 880 may compare the pattern of the structured light output from the flash 830 with the pattern of the light sensed from the image and may be photographed by the first camera. The distance to the object may be extracted or the depth information of the image received through the first camera 820 may be extracted.

As such, a method of extracting a distance to an object or extracting depth information of an image using structured light having a predetermined pattern may be referred to as a structured light method.

In addition, the present invention may combine a stereoscopic method and a structured light method to extract a distance to an object existing outside the vehicle, or extract depth information of an image received through the first camera 820.

The input / output unit 840 may be provided at the front of the head 810, as shown in FIG. 9A. For example, the input / output unit 840 may include a speaker / microphone, or the like, and may output sound information or receive a voice of a user in the vehicle.

The beam output unit 850 may be configured to output Augmented Reality (AR) information to a windshield (or window) of the vehicle. The beam output unit 850 may be referred to as an AR information output unit, an AR output unit, or a projector.

The beam output unit 850 may be provided on the front of the head 810, as shown in Figure 9a.

9B, a second camera 821 and a display unit 860 may be provided on the rear surface of the head 810.

The display unit 860 may output an image 870 received through at least one of the first camera 820 and the second camera 821.

The image 870 may be referred to as a preview image or a live image, and may refer to an image received in real time before capturing an image through a camera.

That is, the display 860 outputs an image received through the first camera 820, outputs an image received through the second camera 821, or outputs the first camera 820 and the second camera. Images received through 821 may be output together.

In addition, the vehicle robot 800 of the present invention, components (for example, the first camera 820, the second camera 821, the flash 830, input / output) provided in the vehicle robot 800 The processor 880 capable of controlling the unit 840, the beam output unit 850, the display unit 860, and the like may be included.

The processor 880 may control the rotation of the head 810. Specifically, the processor 880 controls a driving unit (not shown) for rotating the head 810 with respect to the body 812 so that the driving unit rotates the head 810 with respect to the body 812. The driving unit may be controlled.

The vehicle robot 800 of the present invention may be disposed such that the front of the head faces the front of the vehicle.

In this case, the first camera 820 provided at the front of the head may photograph the outside of the vehicle (or the front of the vehicle), and the second camera 821 provided at the rear of the head may be inside the vehicle (or in the vehicle). One user).

A user who rides in a vehicle may include a driver and a passenger (or a passenger).

In addition, when the front of the head is disposed to face the front of the vehicle, the user in the vehicle can see and operate the display unit 860 provided on the rear of the head.

Not limited to this, the vehicle robot 800 of the present invention, the rear of the head may be disposed to face the front of the vehicle, or the head may be rotated.

In this case, the first camera 820 provided at the front of the head may photograph the inside of the vehicle, and the second camera 821 provided at the rear of the head may photograph the outside of the vehicle.

It should be noted that the arrangement of the components included in the vehicle robot 800 described above is not limited as shown in FIGS. 9A and 9B.

Hereinafter, for convenience of description, the front of the head 810 of the robot for the vehicle will be described as an example facing the front of the vehicle.

Hereinafter, specific embodiments of the vehicle robot 800 according to the present invention will be described.

The vehicle robot 800 according to the present invention may include a body 812, a head 810, cameras 820 and 821, a communication unit, a display unit 860, and a processor 880.

The body 812 is formed to be mounted to a vehicle, and the head 810 is mounted to the body 812 and may be formed to be rotatable.

The cameras 820 and 821 may be disposed in front or rear of the head 810.

The communication unit may be formed to communicate with an electronic device existing inside or outside the vehicle, an electronic device mounted in the vehicle, by wired or wireless communication, or short-range communication.

The display unit 860 may be disposed at the rear of the head 810 and may output an image received through the cameras 820 and 821.

The processor 880 may control the cameras 820 and 821, the communication unit and the display unit 860, and control the driving unit to rotate the head 810.

In an embodiment, the processor 880 may select guide information necessary according to a driver's situation and extract the guide information based on information data for extracting the guide information.

As another embodiment, the processor 880 may select necessary guide information according to a driver's situation, and control the communication unit to receive information data for extracting the guide information, based on the received information data. The guide information can be extracted.

In this case, the information data for extracting the guide information may be set differently according to the type of the guide information.

The guide information is information that needs guidance in a current situation of a vehicle or a driver, and various embodiments may exist. For example, in the case of signal waiting, the time remaining until the signal change may be extracted as guide information. As another example, when the driver approaches a vehicle, the expected destination of the driver may be extracted as guide information.

The information data (information source) is data necessary for extracting the guide information, and may be set differently according to the type of the guide information.

The information data includes information on the vehicle network (CAN, OBD, etc.) including the current speed of the vehicle, fuel condition, mileage, air conditioning, other vehicle status, environment setting record, driver's gaze, drowsiness, etc. Camera information (DSM) to monitor driver status, including driver's tension through biodata, navigation destination setting record, actual driving record, AVN information including actual driving record, entertainment, etc. , Mobile terminal or internet information including usage history of the application, internet search history, and the like.

That is, the guide information may be extracted through some of the information data according to the type of the guide information. In addition, in order to link the information data, a connection step with the user's mobile terminal and the Internet account should be performed before driving.

Hereinafter, with reference to the accompanying drawings will be described in more detail the related contents.

10, 11A, 11B, 11C, 12A, and 12B are conceptual views illustrating a control method of a vehicle robot according to an embodiment of the present invention.

Meanwhile, the processor 880 monitors a predetermined distance within the predetermined distance based on the vehicle through the cameras 820 and 821, and when the driver detects a situation in which the driver approaches the vehicle 100 for boarding, an expected destination. May be selected as the guide information.

In an embodiment, the information data for extracting the expected destination may include at least one of a driving route of each driver's time zone, schedule information, an information search record, and a message transmitted and received.

Thereafter, the processor 880 extracts at least one expected destination based on the information data, and controls the driving unit so that the front of the head faces the driver when the driver rides in the vehicle 100. The control signal may be generated to output the information about the at least one expected destination on the in-vehicle display device.

Referring to FIG. 10, the vehicle robot 800 may detect a situation in which a driver approaches a vehicle for boarding through a camera 820 disposed in front of the vehicle robot 800. For example, the driver may be identified using a face recognition algorithm.

As another example, by recognizing a signal transmitted from a mobile terminal or a smart key possessed by the driver, the driver may recognize that the driver is approaching the vehicle for boarding.

Accordingly, the processor 880 may select the expected destination of the driver as guide information and extract the expected destination based on predetermined information data.

In an embodiment, the expected destination may be extracted through at least one of a driving route of each driver's time zone, schedule information, an information search record, a message transmitted and received, and a learned driver's lifestyle.

Specifically, when the current time is the usual time for the driver's work, the driver's company may be extracted as the expected destination. As another example, the expected destination may be extracted according to schedule information input to the driver's terminal. As another example, when there is a place searched by the driver before the terminal, the corresponding place may be extracted as an expected destination. In addition, a place derived from a driver's call history, a text message transmitted or received, or a messenger message before boarding may be extracted as an expected destination.

As a result, the processor 880 may extract at least one expected destination. As a specific example, when the driver rides in the vehicle, the head may be rotated so that the front of the robot faces the driver, and the extracted list of expected destinations may be output to the display device or the display unit 860 in the vehicle. As such, when the driver boards the vehicle, a list of expected destinations may be automatically output without having to set a destination.

In an embodiment, the predicted destination list 1000 may be output in the order of the high probability by predicting the probabilities for the plurality of predicted destinations. In addition, real-time traffic information (real-time traffic situation, estimated time required, etc.) corresponding to the expected destination can be downloaded in advance.

As another example, the expected destination list may be output on a navigation screen (in-vehicle display). When the driver starts up, the list of expected destinations can be displayed on the first screen in order of probability for quick selection from the navigation. Thereafter, when the destination is selected, the road guide may be immediately started based on the real-time traffic information downloaded in advance.

Meanwhile, the processor 880 monitors the driver through the cameras 820 and 821, and when the vehicle 100 detects a situation in which the driver does not look forward while waiting for the signal, the time remaining until the signal change is determined. May be selected as the guide information.

In an embodiment, when the driver watches the mobile terminal, the processor 880 may generate a control signal for outputting the time remaining until the signal change on the display unit of the mobile terminal, and the control signal may include the control signal. The communication unit may be controlled to be transmitted to the mobile terminal.

Referring to FIG. 11A, a situation in which the driver is looking at the mobile terminal 1100 without looking ahead while waiting for a signal of the vehicle may be detected. For example, when the on-vehicle robot 800 faces the front, the camera 820 disposed in front of the head 810 monitors a traffic light, and the camera 821 disposed in the rear of the head 810. The driver can be monitored. Through this, the driver's gaze may be sensed toward the mobile terminal 1100.

In this case, the vehicle robot 800 may communicate with a traffic light through a communication unit to receive signal information, and extract the time remaining until the signal change. That is, signal information such as a traffic light may be used as information data for extracting time remaining until signal change.

As an exemplary embodiment, referring to FIG. 11B, when the driver is watching the mobile terminal 1100 and the predetermined time is left until the signal change, an image effect 1110 covering the screen of the mobile terminal 1100 may be output.

For example, when the signal change is imminent, the screen 194 turns off or is hidden (opaque) as the curtain descends from the top of the mobile terminal 1100 so that the user can naturally put down the mobile terminal 1100 and concentrate on driving. Can be output.

In addition, the time 1120 remaining until the signal change may be output on the area where the screen is covered. For example, information 1120 for counting the time remaining until a signal change may be output.

As another embodiment, referring to FIG. 11C, a situation in which the driver watches an area other than the front, such as closing eyes or looking out of a window, may be sensed. This may be detected by the camera 821 of the vehicle robot 800 or the driver monitoring camera in the vehicle.

In this case, a voice 1130 indicating a time remaining until a signal change is output from the speaker 840 mounted on the vehicle robot 800 may be output. For example, a voice 1130 such as 'changes to blue light after 3 seconds' and 'changes signal after 3 seconds' may be output. As in the above-described example, signal information such as a traffic light may be used as information data for extracting time remaining until a signal change.

As another embodiment, when the driver is not looking ahead while the vehicle is stopped, the vehicle ahead may start driving. At this time, a voice indicating that the front vehicle has started driving may be output from the speaker 840 mounted to the vehicle robot 800. For example, a voice such as 'the front vehicle has started' and 'please start driving' may be output. In order to extract such guide information, a driving start signal of the front vehicle, an image of monitoring the front vehicle, and the like may be used as the information data.

On the other hand, when the vehicle 100 is waiting for a signal at an intersection where a plurality of traffic lights exist, the processor 880 indicates the time remaining until the change of the signal and the signal waiting for the vehicle 100 among the plurality of traffic lights. Can be selected as guide information.

In this case, the traffic light waiting for the vehicle and the information data for extracting the time remaining until the signal change may include at least one of an expected driving route of the vehicle, an order of changing the signal at the intersection and a waiting time.

In an embodiment, the processor 880 controls the in-vehicle display device or the display unit 860 to output images photographing the plurality of traffic lights through the cameras 820 and 821, and the plurality of traffic lights Based on the user's input for selecting one of the inputs to the in-vehicle display device or the display unit 860, the remaining time until the signal change of the selected traffic light may be extracted as the guide information.

Referring to FIG. 12A, when waiting for a signal at an intersection where a plurality of traffic lights exist, the remaining information until the change of the traffic light and the signal waiting for the vehicle 100 among the plurality of traffic lights may be selected as guide information.

For example, the processor 880 may use the expected driving path of the vehicle 100, the order of changing the signal at the intersection, the waiting time, and the like as the information data, so as to change the signal lamp and the signal waiting for the vehicle 100. The remaining time can be extracted as guide information.

As a specific example, when waiting for a signal at an intersection, a next traffic light to receive a signal may be determined according to a driving path of a vehicle going toward a destination. In this case, when there are a plurality of signals that can be received by the vehicle, it may be determined as a traffic light that waits for a traffic light that is first changed according to the order of change.

In another example, the processor 880 is a frequent intersection, by learning the signal sequence and waiting time of the corresponding location, and using the learned results as the information data, until the traffic light and signal changes waiting for the vehicle 100 The remaining time can be extracted as guide information.

Accordingly, an effect 1210 may be displayed on the display unit 860 indicating that the image light is waiting for the image received by the front camera 820. The remaining time 1220 until the signal change of the corresponding traffic light may be output. In addition, a voice (counting the remaining time) indicating the remaining time may be output from the speaker 840 of the vehicle robot 800. For example, a voice such as 'Changes to blue light after 5 seconds' or 'Changes to signal after 5 seconds' may be output.

12B, the driver may select a signal lamp to receive a signal change guide when waiting for a signal.

As described above, an image received by the front camera 820 may be output to the display unit 860. A plurality of traffic lights may be displayed on the image.

The driver may apply an input 1230 for touching the traffic light to receive the dual signal change guidance. Accordingly, the traffic light guided to the signal change is changed to the traffic light selected by the driver, so that an effect 1240 indicating that the selected traffic light is a waiting light may be output. In addition, the time remaining until the signal change of the corresponding traffic light 1250 may be output. In addition, a voice (counting the remaining time) indicating the remaining time may be output from the speaker 840 of the vehicle robot 800. For example, a voice such as 'Changes to blue after 10 seconds' or 'Changes to signal after 10 seconds' may be output.

According to the above-described embodiments, the manner of guiding the guide information may vary according to the information data for extracting the guide information and the situation of the driver or the vehicle.

According to an embodiment of the present invention, there are one or more of the following effects.

According to the present invention, different information data may be used according to the type of guide information to be guided to the driver. In addition, as various types of information data are used to extract one guide information, accuracy may be increased.

According to another aspect of the present invention, the manner of guiding the guide information may vary according to the information data for extracting the guide information and the situation of the driver or the vehicle. That is, guide information optimized for the current situation may be provided.

For example, when predicting a destination of a driver before boarding a vehicle, the destination may be predicted in advance based on the learned driver's lifestyle and moving route, a future schedule, and a mobile phone operation. In addition, the real-time traffic situation and time required for each of the estimated destinations may be calculated in advance, and the driver may be provided on the first screen so that the driver can immediately check the navigation. As a result, the trouble of requiring the driver to input a destination separately can be solved, and preparation time before departure can be saved.

As another example, the signal change prediction may detect a situation where the user does not look forward, such as eyes closed or staring at a mobile phone, based on a driver monitoring camera or a camera of a vehicle robot. The driver's attention can be refocused by notifying the remaining time until the signal is changed by the voice before the signal is changed.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

The vehicle robot 800 described above may be included in the vehicle 100.

In addition, the operation or control method of the vehicle robot 800 described above may be analogously applied to the operation or control method of the vehicle 100 (or the control unit 170).

More specific embodiments may be replaced with the above description or may be applied in analogy or similarly.

Each of the above steps may be performed by the controller 170 provided in the vehicle 100 as well as the vehicle robot 800.

In addition, all functions, configurations, or control methods performed by the vehicle robot 800 described above may be performed by the controller 170 provided in the vehicle 100. That is, all the control methods described herein may be applied to the control method of the vehicle or may be applied to the control method of the vehicle robot.

Furthermore, the above-described vehicle robot 800 may be a mobile terminal. In this case, all functions, configurations, or control methods performed by the vehicle robot 800 may be performed by the controller of the mobile terminal. In addition, all of the control methods described herein may be analogously applied to the control method of the mobile terminal.

Specifically, the mobile terminal may be formed not only in the form of a smart phone but also in the form of a wearable device (for example, a watch or a glass).

The present invention described above can be embodied as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like. There is this. The computer may also include a processor or a controller. Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (10)

A body formed to be mounted on the vehicle;
A head mounted to the body and configured to be rotatable;
A camera disposed at the front or rear of the head;
A processor which controls the camera and controls a driving unit to rotate the head,
The processor,
The guide information is selected according to the driver's situation, and the guide information is extracted based on the information data for extracting the guide information.
The information robot for extracting the guide information is set differently according to the type of the guide information.
The method of claim 1,
The processor,
The vehicle robot monitors a predetermined distance based on the vehicle through the camera and selects an expected destination as the guide information when a situation in which the driver approaches the vehicle for boarding is detected.
The method of claim 2,
The information data for extracting the expected destination is
A vehicle robot comprising at least one of a driving route of each time zone, schedule information, information search records, and transmitted / received messages of the driver.
The method of claim 3, wherein
The processor,
Extract at least one expected destination based on the information data,
When the driver boards the vehicle, the driver controls the driving unit so that the front of the head faces the driver, and generates a control signal for outputting information on the at least one expected destination from the in-vehicle display device. A vehicle robot characterized by the above-mentioned.
The method of claim 1,
The processor,
And monitoring the driver through the camera, and when the vehicle detects a situation in which the driver does not look forward while waiting for the signal, selecting the remaining time until the signal change as the guide information.
The method of claim 5, wherein
The processor,
When the driver is watching the mobile terminal, generating a control signal for outputting the time remaining until the signal change in the display unit of the mobile terminal, characterized in that for controlling the control signal to be transmitted to the mobile terminal Car robot.
The method of claim 1,
The processor,
And when the vehicle is waiting for a signal at an intersection where a plurality of traffic lights are present, selecting the remaining traffic light and the time remaining until the signal change among the plurality of traffic lights as the guide information.
The method of claim 7, wherein
The traffic light waiting for the vehicle and the information data for extracting the time remaining until the signal change,
And at least one of an expected driving route of the vehicle, an order of changing a signal at the intersection, and a waiting time.
The method of claim 8,
The processor,
Generating a control signal for outputting an image of photographing the plurality of traffic lights through the camera from the display device in the vehicle,
And extracting, as the guide information, the time remaining until the signal change of the selected traffic light is input based on the user's input of selecting one of the plurality of traffic lights to the display device.
A vehicle comprising the vehicle robot according to any one of claims 1 to 9.

Images