JP4536300B2 - In-vehicle hands-free system and portable terminal thereof - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a hands-free system for performing a hands-free call in an automobile, and more particularly to an in-vehicle hands-free system realized in combination with an in-vehicle device such as a camera, a microphone, a speaker, and a display.
[0002]
[Prior art]
In-vehicle hands-free systems have become widespread in order to allow mobile phones to be used safely in the car.
Hereinafter, a conventional in-vehicle hands-free system will be described with reference to FIG. FIG. 16 is a configuration diagram of a conventional in-vehicle hands-free system.
[0003]
A conventional hands-free system includes an in-vehicle adapter 1201, an operation switch 1202 with a microphone, a mobile phone 1203, and an outside antenna 1204. The in-vehicle adapter 1201 includes a connector for connecting an operation switch 1202 with a microphone, a mobile phone 1203, and an antenna 1204 outside the vehicle, and these devices are connected via a cable. The vehicle exterior antenna 1204 is installed outside the vehicle, such as at the rear of the vehicle, and is connected to the vehicle-mounted adapter 1201 through a cable drawn from there.
[0004]
The procedure when the driver uses the conventional hands-free system and the operation of the hands-free system are as follows.
First, when the driver gets into the car, the mobile phone 1203 brought in is connected to the in-vehicle adapter 1201 with a cable, and the power of the in-vehicle adapter is turned on. When making a call, the user presses the button of the operation switch with microphone 1202 to select the other party. When the driver presses the up button or the down button of the operation switch 1202 with a microphone, the in-vehicle adapter 1201 sequentially reads out the phone book stored in the mobile phone 1203, and the voice is transmitted by the speaker built in the in-vehicle adapter 1201. invite. In this way, the other party is called by confirming and selecting the other party and pressing the connection button of the operation switch. Thereafter, a call is performed using a microphone attached to the operation switch 1202 with a microphone and a speaker built in the in-vehicle adapter 1201. When the call ends, the disconnect button of the operation switch 1202 with microphone is pressed.
On the other hand, when an incoming call is received, a call can be made by simply pressing the connection button of the operation switch, and when the call is ended, the call can be ended by a disconnect button.
[0005]
[Problems to be solved by the invention]
However, in the conventional hands-free system, the driver needs to connect the mobile phone brought in to the in-vehicle adapter with a cable after getting on.
In addition, peripheral devices such as a microphone, a speaker, and an operation switch constituting the hands-free system can only be used as devices dedicated to the hands-free system. That is, usually, in the vehicle, video / audio devices such as a car navigation device, a car audio device, a TV device, and a vehicle interior camera are mounted, and these video / audio devices also include peripheral devices such as a microphone, a speaker, a display, and a remote controller. However, these peripheral devices cannot be easily used as peripheral devices for the hands-free system. For this reason, peripheral devices included in the hands-free system and peripheral devices included in the in-vehicle video / audio device are mixed in a narrow vehicle, and the limited vehicle interior space is occupied wastefully.
[0006]
Recently, videophone-compatible mobile terminals (videophone terminals) that enable real-time voice and image calls at the destination have become widespread, and such videophone terminals are used as they are for in-car calls. It is also possible. However, such a portable videophone terminal has a small display and the screen is difficult to see, and the orientation and installation location of the videophone terminal so that the camera mounted on the videophone terminal photographs the driver himself. There are problems such as having to adjust and devise etc.
[0007]
Therefore, in view of such a problem, the present invention does not require redundant peripheral devices such as a peripheral device such as a microphone, a speaker, a camera, and a display for a hands-free system and a peripheral device for an in-vehicle video / audio device. A first object is to provide a compact in-vehicle hands-free system.
[0008]
Furthermore, the present invention utilizes an operation interface of an in-vehicle device designed on the assumption that it is used in an in-vehicle environment, and is capable of ensuring safe driving with simple operation and no camera adjustment. A second object is to provide an in-vehicle hands-free system with excellent performance.
[0009]
In addition, the present invention provides a convenient in-vehicle hands-free system that can start using the hands-free system without performing troublesome operations such as connecting a portable terminal brought into the vehicle to the in-vehicle adapter with a cable and pressing a button. A third object is to provide a system.
[0010]
[Means for Solving the Problems]
In order to achieve the first object, the in-vehicle hands-free system of the present invention is a hands-free system including a mobile terminal and at least one in-vehicle device of a microphone, a speaker, a camera, and a display, The in-vehicle device notifies the mobile terminal of attribute information, and the mobile terminal corresponds to at least one function of a built-in microphone, speaker, camera, and display based on the attribute information. It is configured to be used in place of the in-vehicle device.
[0011]
Specifically, for example, the present invention is a hands-free videophone system including a vehicle-mounted device and a videophone terminal including a microphone, a speaker, a camera, and an instrument panel connected to the microphone, a speaker, a camera, and an instrument panel and a video. When the videophone terminal is connected to the phone terminal via a wireless communication medium and the videophone terminal is brought into the vehicle, the instrument panel notifies the videophone terminal of attribute information about the system configuration. Based on the attribute information, the videophone terminal The voice image multiplexed data is used so as to use the display mounted on the microphone, speaker, camera, and instrument panel of the in-vehicle device instead of the built-in microphone, speaker, camera, and display when a call is entered. Switch routes.
[0012]
The in-vehicle hands-free system of the present invention is a hands-free system including a mobile terminal and at least one in-vehicle device of a microphone, a speaker, a camera, and a display, and the in-vehicle device is connected to the mobile terminal. Attribute information is notified, and based on the attribute information, the portable terminal complements and uses at least one function of a missing microphone, speaker, camera, or display with the corresponding in-vehicle device. It is comprised as follows.
[0013]
That is, according to the in-vehicle hands-free system according to the present invention, peripheral devices such as a microphone, a speaker, a camera, and a display dedicated to the hands-free system are not provided, but a car navigation device and a car audio that are incorporated in the car in advance. In-vehicle devices such as a microphone, a speaker, a camera, and a display included in a TV device and an indoor camera are also used as a hands-free system. Specifically, a portable terminal such as a videophone terminal brought into the vehicle is connected to these on-vehicle peripheral devices by wireless communication, and instead of peripheral devices such as built-in microphones, speakers, cameras, and displays, Alternatively, communication such as a telephone is performed using these in-vehicle devices so as to complement the lacking peripheral devices.
[0014]
In order to achieve the second object, the in-vehicle hands-free system of the present invention further stores in-vehicle camera setting information in the mobile terminal and is stored in the mobile terminal at the start of the hands-free operation. The configuration information is configured to automatically perform customized camera settings for each user using the setting information. Alternatively, the setting information of the in-vehicle camera is stored in one of the microphone, speaker, camera, and display of the in-vehicle device in association with the mobile terminal, and the setting information stored in the in-vehicle device is used at the start of hands-free operation. Thus, the camera setting customized for each user is automatically performed.
[0015]
In order to achieve the third object, the in-vehicle hands-free system of the present invention includes an engine key operation, an input operation to the mobile terminal or the in-vehicle device, a communication link state between the mobile terminal and the in-vehicle device, It is configured to switch between a normal operation state of a normal portable terminal and a hands-free operation state in conjunction with the setting state of the terminal on the telephone holder.
In addition, this invention can also be implement | achieved as a portable terminal in the said vehicle-mounted hands-free system.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
(Embodiment 1)
Hereinafter, an in-vehicle hands-free videophone system according to a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram of a hands-free videophone system according to the first embodiment of the present invention. This hands-free videophone system includes a microphone 101, a speaker 102, a camera 103, a connection cable 104, an instrument panel (Instrument Panel) 105, a videophone terminal 106, a wireless communication medium 107, a room mirror 108, and the like.
[0017]
An outline of the operation of the hands-free videophone system configured as described above will be described first.
In-vehicle embedded devices such as a microphone 101, a speaker 102, and a camera 103 are connected to an instrument panel 105 via a connection cable 104. Instead of the connection cable 104, the connection cable 104 may be connected by an in-vehicle BUS or a wireless medium.
[0018]
The videophone terminal 106 is a portable wireless communication device capable of having a conversation in real time with a partner in a remote place via a telephone network or the like (for example, a conversation while looking at the partner's face). This is a device in which a function of image communication is added to a general mobile phone.
[0019]
The instrument panel 105 is incorporated in the front panel, console box, etc. of the vehicle, and includes a display and operation input means such as a touch panel and operation buttons. Provides user interface functions to do. The instrument panel 105 may be integrated with a car navigation device, car audio, television, or the like. At this time, video / audio peripheral devices such as the microphone 101, the speaker 102, the camera 103, and the display of the instrument panel 105 are used as peripheral devices for the car navigation apparatus, car audio, television, and indoor camera under the control of the instrument panel 105. At the same time, it is also used as a peripheral device of the hands-free videophone system in the present embodiment.
[0020]
The instrument panel 105 further includes a wireless communication function such as Bluetooth or IrDA. When the driver brings the videophone terminal 106 into the vehicle, the instrument panel 105 searches for a device brought in via the wireless communication medium 107 to find and recognize the videophone terminal 106. The search is performed when the driver unlocks the door when getting in, when turning the key to the accessory state, when the engine is turned on, or when the driver performs an operation to start a call on the instrument panel 105, This is performed when the videophone terminal 106 is set. Of course, the search may be executed from the videophone terminal 106 side when an operation is performed from the videophone terminal 106 side or when the videophone terminal 106 is set in the telephone holder.
[0021]
Thereafter, the microphone 101 and the speaker 102 which are in-vehicle built-in devices are used as voice input / output means, the camera 103 installed on the side of the room mirror 108 is used as image input means, and the instrument panel 105 is also used for calling. By using it as a display / input means for operations, videophone image display, etc., these in-vehicle devices and hands-free videophone terminal 106 using hand-in videophone terminal 106 become possible. In such a hands-free call state, the microphone, the speaker, the camera, and the like included in the videophone terminal 106 are basically not used, and instead, the in-vehicle embedded device provides the function.
[0022]
On the other hand, when the driver turns off the key, locks the door from the outside of the vehicle, inputs a release operation to the videophone terminal 106 or the instrument panel 105, or removes the videophone terminal 106 from the telephone holder, The hands-free call state is canceled when the mobile phone is taken out of the vehicle and communication with the instrument panel 105 is cut off.
[0023]
Next, detailed configurations of the videophone terminal 106 and the instrument panel 105 will be described.
FIG. 2 is a functional block diagram of the hands-free videophone system according to the first embodiment of this invention. As shown in the figure, the videophone terminal 106 is roughly composed of a videophone terminal main body 201 and a wireless communication interface 202b. The instrument panel 105 includes a wireless communication interface 202a, a media demultiplexing unit 204, a control unit 205, a system information storage unit 206, an audio codec 207, a video encoder 208, a video decoder 209, a display 210, operation buttons 203, and the like.
[0024]
Note that a microphone 101, a speaker 102, and a camera 103 are connected to the instrument panel 105 via a connection cable 104. The camera 103 is remotely controlled by a control signal from the instrument panel 105 such as a shooting direction and a zoom amount.
[0025]
Similar to the system information storage unit 315 of the videophone terminal 106, the system information storage unit 206 of the instrument panel 105 includes attribute information of the instrument panel itself, information on installed functions such as presence / absence of a camera, a microphone, and a display, as well as sound and image Information on supported standards, such as parameters such as encoding method, rate, and screen size, is stored. In addition, camera setting information such as the camera orientation and zoom amount, and setting information of installed functions such as which camera to select when a plurality of cameras are connected to the instrument panel are also stored. For example, in the case of a 3G-H324M-compliant videophone terminal compatible with the next-generation mobile phone system IMT-2000, as system information, the audio encoding method is variable bit rate AMR, and the image encoding method is MPEG4 simple profile ( (Screen size is QCIF, about 10 frames per second), and media multiplexing is ITU-T H.264. 223, the control method is ITU-T H.264. 245, camera control is ITU-T H.264. Information such as 281 compliant, the rate is 64 kbps or less in total for audio and images is stored.
[0026]
FIG. 3 is a functional block diagram showing a detailed configuration of the videophone terminal 106 shown in FIG. The videophone terminal 106 includes a videophone terminal main body 201 and a wireless communication interface 202b. The videophone terminal main unit 201 includes an antenna 301 for providing a function as a normal mobile phone, an RF unit 302 that transmits and receives RF signals, and a baseband processing unit 303 that performs modulation and demodulation processing and error control. Further, a media demultiplexing unit 304 that multiplexes and demultiplexes audio data, image data, and control data is provided. The audio processing unit includes an audio codec 305 that performs audio encoding / decoding processing, a microphone 306, and a speaker 307. The image processing unit includes a video encoder 308 that performs image encoding processing, and decoding. A video decoder 309, a camera 310, a display 311, an operation button 312 and the like.
[0027]
Both or one of the audio codec 305 (encoding processing side) and the video encoder 308 receives a command from the media demultiplexing unit 304 (multiplexing processing side) and controls the encoding rate. The control unit 313 controls each of these functions, and negotiates with the exchange and the other party via the telephone network 314 to realize a videophone call. At this time, camera control such as zoom adjustment and orientation adjustment can also be executed via the control unit 313 under the command of the other party. The system information storage unit 315 stores, as the system information of the videophone terminal 106, information on standards that the videophone terminal 106 supports, information on functions incorporated therein, and the like. For example, attribute information of the videophone terminal itself, such as manufacturer, model, model number, corresponding standard name, etc., and voice information such as presence / absence of microphone / speaker, supported audio encoding method, and encoding rate Furthermore, the presence or absence of a display / camera, the corresponding image encoding method, various parameters such as encoding rate and screen size, image system information such as command system supported for camera control, and media Control system information such as a demultiplexing method, a call control method, and other supported protocols is stored. Therefore, the microphone, the speaker, the display, the audio codec, the camera, the video encoder, the video decoder, and the media demultiplexing unit mounted on the videophone terminal 106 can be used when the corresponding function is available on the instrument panel side. It is possible to adopt a system configuration in which it is not used after being bypassed.
[0028]
FIG. 4 is a block diagram showing a detailed configuration of the media demultiplexing unit 304 of the videophone terminal 106 shown in FIG. The media demultiplexing unit 304 is a circuit that performs multiplexing and demultiplexing of audio data, image data, and control data, and controls to switch the paths of these data. The first switching unit 304a, the second switching unit 304b, and multiplexing Part 304c, separation part 304d, and control port 304e.
[0029]
The multiplexing unit 304c is a multiplexer circuit or the like, multiplexes the audio data sent from the audio codec 305 and the image data sent from the video encoder 308, and outputs them to the first switching unit 304a. The first switching unit 304a is a two-input one-output selector circuit or the like, and based on a control signal from the control port 304e, the audio image multiplexed data from the wireless communication interface 202b and the audio image multiplexed from the multiplexing unit 304c. Is selected and output to the baseband processing unit 303.
[0030]
The second switching unit 304b is a 1-input 2-output selector circuit or the like, and outputs the audio / video multiplexed data sent from the baseband processing unit 303 to either the wireless communication interface 202b or the separation unit 304d. The separation unit 304d is a demultiplexer circuit or the like, which demultiplexes the audio image multiplexed data sent from the second switching unit 304b into audio data and image data, converts the audio data into the audio codec 305, and converts the image data into video. Output to the decoder 309.
[0031]
The control port 304e is a gate circuit or the like that separates and transfers control data. The control port 304e relays control data between the wireless communication interface 202b and the control unit 313, or the first based on the control data from the control unit 313. It controls the switching unit 304a and the second switching unit 304b.
[0032]
Depending on the connection state of the first switching unit 304a and the second switching unit 304b in the media demultiplexing unit 304 having such a configuration, a microphone 306, a speaker 307, It is determined whether the display 311 and the camera 310 are used, or whether the in-vehicle microphone 101, the speaker 102, the display 210, and the camera 103 are used.
[0033]
Next, the operation sequence of this embodiment will be described.
FIG. 5 is an operation sequence of the hands-free videophone system according to the first embodiment of this invention. The operation sequence will be described with reference to FIG.
[0034]
(Step A)
When the driver gets into the car and puts the key in the accessory state, the instrument panel 105 searches for a peripheral device that can communicate via the wireless communication interface 202a, and finds and recognizes the videophone terminal 106. At this time, the control units 313 and 205 of the videophone terminal 106 and the instrument panel 105 exchange information stored in the system information storage units 315 and 206 through the wireless communication interfaces 202a and 202b, respectively. The use of the functions of the instrument panel 105 is negotiated with each other instead of the functions that are present. At the same time, the phone book data stored on the videophone terminal 106 side is transferred to the instrument panel 105 via the wireless communication interfaces 202a and 202b.
[0035]
FIG. 6A shows a screen display example on the display 210 of the instrument panel 105. Here, a phone book based on the phone book data transferred from the videophone terminal 106 is displayed at the center of the screen, and an operation button 203a is displayed at the bottom of the screen.
[0036]
(Step B)
Thereafter, when the driver operates the operation button 203 (or the operation button 203a displayed on the screen) of the instrument panel 105 to select a call partner and perform a call start operation, the videophone terminal is connected via the wireless communication interface 202a. 106, a call is made from the videophone terminal 106, and the connection with the other party is completed via the telephone network 314. At the same time, according to the setting information described in the system information stored in the system information storage unit 206 of the instrument panel 105, automatic adjustment such as orientation of the camera 103 and zoom adjustment is performed for the videophone.
[0037]
The system information storage unit 206 of the instrument panel 105 stores camera setting information (shooting conditions relating to shooting direction, zoom, etc.) previously associated with each of the plurality of videophone terminals, and the videophone terminal 106 is brought into the vehicle. The camera setting information corresponding to the videophone terminal 106 detected by the instrument panel 105 is read from the system information storage unit 206 and transferred to the camera 103, and the lens orientation and zoom are automatically adjusted.
[0038]
An equivalent effect can be obtained by signal processing such as cutting out the driver portion in the screen showing the entire interior of the vehicle without moving the direction of the camera 103. Further, when a plurality of cameras are connected, automatic selection of the driver's seat camera is also performed according to the setting information described in the system information. The setting information can be updated by adjusting the camera 103 by using the operation button 203 and overwriting the setting state as system information.
[0039]
(Step C)
Thereafter, the audio and image input from the microphone 101 connected to the instrument panel 105 and the camera 103 are encoded and multiplexed in accordance with a rate adjustment request from the videophone terminal 106, and then via the wireless communication interface 202a. It is transmitted to the videophone terminal 106 and further transferred to the other party via the telephone network 314. Specifically, the first switching unit 304a in the media demultiplexing unit 304 of the videophone terminal 106 shown in FIG. 4 connects the baseband processing unit 303 and the wireless communication interface 202b based on an instruction from the control unit 313. By connecting, the audio image multiplexed data transmitted from the instrument panel 105 via the wireless communication interfaces 202 a and 202 b is passed and output to the baseband processing unit 303.
[0040]
The voice and image transmitted from the other party are transferred to the instrument panel 105 via the wireless communication interfaces 202a and 202b, decoded, and then reproduced and displayed on the speaker 102 and the display 210. Specifically, the second switching unit 304b in the media demultiplexing unit 304 of the videophone terminal 106 shown in FIG. 4 connects the baseband processing unit 303 and the wireless communication interface 202b based on an instruction from the control unit 313. By connecting, the audio image multiplexed data transmitted from the baseband processing unit 303 is output to the wireless communication interfaces 202a and 202b.
[0041]
It is also possible to transfer the image captured by the camera 103 to the display 210 and display it, and confirm the same image as that transmitted to the other party. Further, in accordance with a camera control request from the other party, control of the orientation and zoom of the camera 103 is also performed.
[0042]
FIG. 6B is a screen display example on the display 210 of the instrument panel 105. Here, the upper body of the other party is displayed at the center of the screen, the upper body image of the driver (driver) being sent to the other party is displayed at the lower right of the screen, and the operation button 203a is displayed at the lower part of the screen. Yes.
[0043]
(Step D)
At the end of the call, if the call end operation is performed with the operation button 203 of the instrument panel 105 (or the operation button 203a displayed on the screen), a call disconnection signal is transmitted to the exchange via the videophone terminal 106 and the telephone network 314. Is disconnected.
[0044]
On the other hand, when an incoming call is received, the instrument panel 105 is called from the telephone network 314 and the videophone terminal 106 via the wireless communication interfaces 202a and 202b to notify the incoming call. The instrument panel 105 displays the sender information. After that, the call can be performed by the same operation as that at the time of outgoing. The same applies when the call from the other party is disconnected.
[0045]
(Step E)
When the driver turns off the key or takes out the videophone terminal 106 out of the vehicle and becomes unable to communicate with the instrument panel 105, the hands-free state is canceled, and both the videophone terminal 106 and the instrument panel 105 are in the initial state. Return to.
[0046]
As described above, according to the present embodiment, an in-vehicle operating environment designed on the premise of simple and safe operation without bringing in or selecting the camera 103 by simply bringing the videophone terminal 106 into the vehicle. A hands-free videophone system that uses this function can be realized.
[0047]
In the present embodiment, the system information stored in the system information storage unit 206 of the instrument panel 105 has been described as including camera setting information. However, the system information stored in the system information storage unit 315 of the videophone terminal 106 has been described. System information may include setting information on functions of the camera 103, the microphone 101, the display 210, and the like, which may be transferred to the instrument panel 105 to make these settings.
[0048]
In the present embodiment, the example in which the instrument panel 105 includes the video encoder 208, the video decoder 209, the audio codec 207, and the media demultiplexing unit 204 has been described. However, the instrument panel 105 includes the camera 103, Only the functions of the microphone 101, the display 210, the operation buttons 203, and the like may be mounted, and the above-described functions may be configured to use those equipped in the videophone terminal 106.
[0049]
(Embodiment 2)
Hereinafter, an in-vehicle hands-free videophone system according to a second embodiment of the present invention will be described with reference to the drawings.
[0050]
FIG. 7 is a configuration diagram of a hands-free videophone system according to the second embodiment of the present invention. This hands-free videophone system includes a headset 501, a wireless camera 502, an instrument panel 503, a videophone terminal 106, a wireless communication medium 107, a room mirror 108, and the like. The same constituent elements as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted (the same applies to the following drawings).
[0051]
An outline of the operation of the hands-free videophone system configured as described above will be described first.
In the present embodiment, unlike the first embodiment, a wireless headset 501 is used instead of a microphone and a speaker. The wireless camera 502 is also used for the camera. In-vehicle devices such as the headset 501 and the wireless camera 502 are connected to the instrument panel 503 via the wireless communication medium 107, and the instrument panel 503 and the videophone terminal 106 are also connected via the wireless communication medium 107 and can communicate with each other. It has become.
[0052]
When the driver brings the videophone terminal 106 into the vehicle, the instrument panel 503 searches for a device brought in via the wireless communication medium 107 to find and recognize the videophone terminal 106. If the headset 501 and the wireless camera 502 are not yet recognized, these devices are also recognized at the same time. Note that the conditions for triggering the search are the same as those described in the first embodiment, such as setting the key to the accessory state. Of course, the videophone terminal 106 may execute the search when an operation is performed from the videophone terminal 106 or when the videophone terminal 106 is set in the telephone holder.
[0053]
Thereafter, as in the first embodiment, the headset 501 which is an in-vehicle device is used as an audio input / output unit, and the wireless camera 502 installed on the side of the room mirror 108 is used as an image input unit. Further, by using the instrument panel 503 as a display / input means such as a call operation or a display of a videophone image, a hands-free call using these in-vehicle devices and the brought-in videophone terminal 106 becomes possible. In such a hands-free call state, the microphone, the speaker, the camera, and the like included in the videophone terminal 106 are basically not used, and instead, the in-vehicle embedded device provides the function.
On the other hand, the hands-free call state is canceled when triggered by the same conditions as those described in the first embodiment, such as the driver turning off the key.
[0054]
Next, detailed configurations of the videophone terminal 106, the instrument panel 503, the wireless camera 502, and the headset 501 will be described.
FIG. 8 is a functional block diagram of the hands-free videophone system according to the second embodiment of the present invention. The videophone terminal 106 has a block configuration similar to that of the first embodiment. The instrument panel 503 includes a wireless communication interface 202a, a media demultiplexing unit 204, a control unit 601, a system information storage unit 602, a display 210, operation buttons 203, and the like. A headset 501 and a wireless camera 502 are connected to the instrument panel 503 via the wireless communication medium 107.
[0055]
In the system information storage unit 602 of the instrument panel 503, information on installed functions such as presence / absence of a display as attribute information of the instrument panel 503, and information obtained from the videophone terminal 106, the wireless camera 502, and the headset 501 through the wireless communication medium 107. The system information of these devices is stored. Further, peripheral device setting information such as setting of the orientation and zoom amount of the wireless camera 502 and which camera to select when a plurality of cameras are connected to the instrument panel 503 are also stored. Of course, the setting information of the wireless camera 502 may be stored in the wireless camera 502.
[0056]
In addition to the camera unit 607, the wireless camera 502 includes a video encoder 208, a system information storage unit 608, a control unit 609, and a wireless communication interface 202d. The camera image data encoded by the video encoder 208 is transmitted to the instrument panel 503 via the wireless communication medium 107. The system information storage unit 608 stores, as attribute information of the wireless camera 502 itself, parameters such as an image encoding method, a rate, a screen size, and information on supported standards.
[0057]
The headset 501 includes a microphone 603, an earphone speaker 604, an audio codec 207, a system information storage unit 605, a control unit 606, and a wireless communication interface 202c. The system information storage unit 605 stores, as attribute information of the headset 501 itself, parameters such as a voice encoding method, a rate, and information on supported standards.
[0058]
Next, the operation sequence of this embodiment will be described.
FIG. 9 is an operation sequence of the hands-free videophone system according to the second embodiment of the present invention. The operation sequence will be described with reference to FIG.
[0059]
(Step A)
When the driver gets into the car and puts the key in the accessory state, the instrument panel 503 searches for peripheral devices that can communicate via the wireless communication interface 202a, and discovers the videophone terminal 106, the wireless camera 502, and the headset 501, recognize. At this time, the control units 313, 609, and 606 of the devices of the videophone terminal 106, the wireless camera 502, and the headset 501 and the control unit 601 of the instrument panel 503 are stored in the system information storage units 315, 608, 605, and 602, respectively. Information is exchanged through the wireless communication interfaces 202a to 202d, and a hands-free videophone is realized by using the functions of the wireless camera 502, the headset 501, and the instrument panel 503 instead of the functions of the videophone terminal 106. Negotiate with each other. At the same time, the phone book data stored in the videophone terminal 106 is transferred to the instrument panel 503 via the wireless communication interfaces 202a and 202b.
[0060]
(Step B)
Thereafter, when the driver operates the operation button 203 of the instrument panel 503 to select a call partner and perform a call start operation, the videophone terminal 106 is notified via the wireless communication interfaces 202a and 202b. To complete the connection with the other party via the telephone network 314. At the same time, automatic adjustment such as the orientation and zoom adjustment of the wireless camera 502 is performed for the videophone according to the setting information described in the system information stored in the system information storage unit 602 of the instrument panel 503. Alternatively, the same effect can be obtained by signal processing such as cutting out the driver portion in the screen showing the entire interior of the vehicle without moving the direction of the wireless camera 502. Further, when a plurality of cameras are connected, automatic selection of the driver's seat camera is also performed according to the setting information described in the system information. The setting information can be updated by adjusting the wireless camera 502 by using the operation button 203 and overwriting the setting state as system information.
[0061]
(Step C)
Thereafter, audio and images input from the headset 501 and the wireless camera 502 are encoded in accordance with a rate adjustment request from the videophone terminal 106 and further multiplexed by the instrument panel 503, and then transmitted to the wireless communication interfaces 202 a and b. Is transmitted to the videophone terminal 106 via the telephone network 314 and transferred to the other party via the telephone network 314. The voice and image transmitted from the other party are transferred to the instrument panel 503 via the wireless communication interfaces 202a and 202b. After the voice and image are separated from each other, the voice passes through the wireless communication medium 107. The image is transferred to the headset 501 and reproduced, and the image is displayed on the display 210 of the instrument panel 503. Of course, it is also possible to display an image captured by the wireless camera 502 on the display 210 of the instrument panel 503 and confirm an image transmitted to the other party. Further, in accordance with a camera control request from the other party, control of the orientation and zoom of the wireless camera 502 is also performed.
[0062]
(Step D)
At the end of the call, when a call end operation is performed using the operation button 203 of the instrument panel 503, a call disconnect signal is transmitted to the exchange via the videophone terminal 106 and the telephone network 314, and the line is disconnected.
[0063]
On the other hand, when an incoming call is received, the instrument panel 503 is called from the telephone network 314 and the videophone terminal 106 via the wireless communication interfaces 202a and 202b to notify the incoming call. The instrument panel 503 displays the sender information. After that, the call can be performed by the same operation as that at the time of outgoing. The same applies when the call from the other party is disconnected.
[0064]
(Step E)
When the driver turns off the key or takes out the videophone terminal 106 out of the vehicle and becomes unable to communicate with the instrument panel 503, the hands-free state is canceled and both the videophone terminal 106 and the instrument panel 503 are in the initial state. Return to.
[0065]
As described above, also in the present embodiment, an in-vehicle operating environment designed on the premise of simple and safe operation without bringing in or adjusting the wireless camera 502 simply by bringing the videophone terminal 106 into the vehicle. A hands-free videophone system that uses this function can be realized.
[0066]
In this embodiment, the system information stored in the system information storage unit 602 on the instrument panel 503 is described as including the setting information of the wireless camera 502, but is stored in the system information storage unit 608 of the wireless camera 502. In addition, the system information storage unit 315 of the videophone terminal 106 stores function setting information such as the wireless camera 502, microphone, and display as system information, which is transferred to the instrument panel 503 side. These settings may be made.
[0067]
In this embodiment, the wireless camera 502, the headset 501, and the instrument panel 503 include the video encoder 208, the camera unit 607, the video decoder 209, the display 210, the audio codec 207, the microphone 603, the speaker 604, and the media demultiplexing unit 204. However, these functions may be configured to use those equipped in the videophone terminal 106.
[0068]
(Embodiment 3)
Hereinafter, an in-vehicle hands-free videophone system according to a third embodiment of the present invention will be described with reference to the drawings.
FIG. 10 is a configuration diagram of the hands-free videophone system according to the third embodiment of the present invention. This hands-free videophone system includes a videophone terminal 801, an instrument panel 802, a headset 501, a wireless camera 502, a wireless communication medium 107, a room mirror 108, and the like.
[0069]
An outline of the operation of the hands-free videophone system configured as described above will be described first.
In the present embodiment, unlike the second embodiment, a videophone terminal 801 that is brought in and a vehicle-mounted device such as a headset 501, a wireless camera 502, and an instrument panel 802 are directly connected via a wireless communication medium 107. ing. For this reason, the media demultiplexing process can be performed by using the function inside the videophone terminal 801 and does not need to be provided on the instrument panel 802 side.
[0070]
When the driver brings the videophone terminal 801 into the vehicle, the driver searches for peripheral devices via the wireless communication medium 107, and finds and recognizes the instrument panel 802, the wireless camera 502, and the headset 501. The search is triggered by the same conditions as in the first embodiment, for example, triggered by pressing the operation button 312 on the videophone terminal 801 side.
[0071]
Thereafter, as in the second embodiment, the in-vehicle device headset 501 is used as an audio input / output unit, and the wireless camera 502 installed on the side of the room mirror 108 is used as an image input unit. Furthermore, by using the instrument panel 802 as a display / input unit for a call operation or display of a videophone image, a hands-free call using these in-vehicle devices and the brought-in videophone terminal 801 becomes possible. In such a hands-free call state, the microphone, the speaker, the camera, and the like included in the videophone terminal 801 are not basically used, but instead the in-vehicle embedded device provides the function.
[0072]
In addition, the cancellation of the hands-free call state is performed when the operation is input from the videophone terminal 801 or when it is detected that communication has been interrupted by turning off the key or taking the videophone terminal 801 out of the vehicle. The process is performed under the same conditions as in the first embodiment.
[0073]
Next, detailed configurations of the videophone terminal 801, the instrument panel 802, the wireless camera 502, and the headset 501 will be described.
FIG. 11 is a functional block diagram of the hands-free videophone system according to the third embodiment of the present invention.
The wireless camera 502 and the headset 501 have the same block configuration as that of the second embodiment.
[0074]
The instrument panel 802 includes a wireless communication interface 202a, a video decoder 209, a display 210, operation buttons 203, a system information storage unit 902, and a control unit 901. The instrument panel 802 basically has the same configuration as the instrument panel 503 of the second embodiment. However, since the media demultiplexing unit is not mounted on the instrument panel 802 and does not directly communicate with the wireless camera 502 or the headset 501, the operation of the control unit 901 is the same as that of the second embodiment. This is different from the case of 503. The system information storage unit 902 stores attribute information of the instrument panel 802 itself, for example, information such as the presence / absence of a display.
[0075]
The videophone terminal 801 has a block configuration similar to that of the first and second embodiments. However, in the system information storage unit 315, in addition to the system information as described in the first embodiment, these devices acquired from the instrument panel 802, the wireless camera 502, and the headset 501 via the wireless communication medium 107. System information is stored. Further, peripheral device setting information such as camera setting information such as camera orientation and zoom amount, and which camera to select when a plurality of cameras are connected to the instrument panel 802 is also stored. Of course, the camera setting information may be stored on the wireless camera 502 side.
[0076]
Further, the videophone terminal 801 includes a media demultiplexing unit 1304 shown in FIG. 12 instead of the media demultiplexing unit 304 shown in FIG. The media demultiplexing unit 1304 includes a multiplexing unit 1304a, a demultiplexing unit 1304b, first to fourth switching units 1304c-f, etc., and performs multiplexing and demultiplexing of audio data, image data, and control data, This is the same as the media demultiplexing unit 304 in that it is a circuit that controls the switching of the audio data. However, it does not switch the path of the audio / video multiplexed data, but instead of switching the paths of the audio data and the image data, the media multiplexing is performed. Different from the separation unit 304. In the drawing, the processing unit related to the control data (component corresponding to the control port 304e in FIG. 4) is not shown.
[0077]
The first switching unit 1304c selects and multiplexes either audio data sent from the headset 501 via the wireless communication interface 202b or audio data sent from the audio codec 305 in the videophone terminal 801. To the unit 1304a. Similarly, the second switching unit 1304d selects either image data sent from the wireless camera 502 via the wireless communication interface 202b or image data sent from the video encoder 308 in the videophone terminal 801. And output to the multiplexing unit 1304a.
[0078]
On the other hand, the third switching unit 1304e selects whether to send the audio data sent from the separation unit 1304b to the headset 501 via the wireless communication interface 202b or to the audio codec 305 in the videophone terminal 801. To do. Similarly, the fourth switching unit 1304f selects whether to send the image data sent from the separation unit 1304b to the instrument panel 802 via the wireless communication interface 202b or to the video decoder 309 in the videophone terminal 801. To do.
[0079]
Note that the multiplexing unit 1304a and the demultiplexing unit 1304b have the same functions as the multiplexing unit 304c and demultiplexing unit 304d shown in FIG.
[0080]
Depending on the connection state of the first to fourth switching units 1304c-f in the media demultiplexing unit 1304 having such a configuration, the microphone 306, the speaker 307, and the display included in the videophone terminal 801 as audio and image input / output devices. It is determined whether 311 and the camera 310 are used, or the microphone 603 and the speaker 604 of the headset 501 worn by the driver, the vehicle-mounted display 210 and the wireless camera 502 are used. Unlike the first and second embodiments, the media demultiplexing unit need not be provided in the instrument panel 802 due to the functions of the first to fourth switching units 1304c to 1304f of the media demultiplexing unit 1304. .
[0081]
Next, the operation sequence of this embodiment will be described.
FIG. 13 shows an operation sequence of the hands-free videophone system according to the third embodiment of the present invention. The operation sequence will be described with reference to FIG.
[0082]
(Step A)
When the driver gets into the car and presses the corresponding operation button 312 of the videophone terminal 801, the videophone terminal 801 searches for peripheral devices that can communicate via the wireless communication interfaces 202a to 202d, and the instrument panel 802, wireless Discover and recognize the camera 502 and headset 501. At this time, the control units 901, 609, and 606 of the instrument panel 802, the wireless camera 502, and the headset 501 and the control unit 313 of the videophone terminal 801 are stored in the system information storage units 902, 608, 605, and 315, respectively. Information is exchanged through the wireless communication interfaces 202a to 202d, and a hands-free videophone is realized by using the functions of the wireless camera 502, the headset 501, and the instrument panel 802 instead of the functions of the videophone terminal 801. Negotiate with each other. At the same time, the phone book data stored in the videophone terminal 801 is transferred to the instrument panel 802 via the wireless communication interfaces 202a and 202b.
[0083]
(Step B)
Thereafter, when the driver operates the operation button 203 of the instrument panel 802 to select a call partner and perform a call start operation, the videophone terminal 801 is notified via the wireless communication interfaces 202a and 202b, and the videophone terminal 801 To complete the connection with the other party via the telephone network 314. At the same time, automatic adjustment such as the orientation and zoom adjustment of the wireless camera 502 is performed for the videophone according to the setting information described in the system information stored in the system information storage unit 315 of the videophone terminal 801. Alternatively, the same effect can be obtained by signal processing such as cutting out the driver portion in the screen showing the entire interior of the vehicle without moving the direction of the wireless camera 502. Further, when a plurality of cameras are connected, automatic selection of the driver's seat camera is also performed according to the setting information described in the system information. The setting information can be updated by adjusting the camera by using the operation button 203 and overwriting the setting state as system information.
[0084]
(Step C)
Thereafter, audio and images from the headset 501 and the wireless camera 502 are encoded in accordance with a rate adjustment request from the videophone terminal 801, transmitted to the videophone terminal 801 via the wireless communication interfaces 202a to 202d, and media multiplexed. After the processing is performed, the call is transferred to the other party via the telephone network 314. Specifically, the first switching unit 1304c (and the second switching unit 1304d) in the media demultiplexing unit 1304 of the videophone terminal 801 shown in FIG. By connecting 202b and the multiplexing unit 1304a, audio data (and image data) sent from the headset 501 (and wireless camera 502) via the wireless communication interfaces 202b, c (and 202d) Is output to the multiplexing unit 1304a.
[0085]
Conversely, the voice and image transmitted from the other party are subjected to media separation processing at the videophone terminal 801, and then the voice is sent to the headset 501 and the image is sent to the instrument panel 802 via the wireless communication interfaces 202a to 202c. To be played back and displayed. Specifically, the third switching unit 1304e (and the fourth switching unit 1304f) in the media demultiplexing unit 1304 of the videophone terminal 801 shown in FIG. 202b and the separation unit 1304b are connected to output separated sound data (and image data) to the headset 501 (and the instrument panel 802).
[0086]
It is also possible to display an image captured by the wireless camera 502 on the display 210 of the instrument panel 802 and confirm an image transmitted to the other party. Further, in accordance with a camera control request from the other party, control of the orientation and zoom of the wireless camera 502 is also performed.
[0087]
(Step D)
At the end of the call, when a call end operation is performed with the operation button 203 of the instrument panel 802, a call disconnect signal is transmitted to the exchange via the videophone terminal 801 and the telephone network 314, and the line is disconnected.
[0088]
On the other hand, when an incoming call is received, the instrument panel 802 is called from the telephone network 314 and the videophone terminal 801 via the wireless communication interfaces 202a and 202b to notify the incoming call. The instrument panel 802 displays the sender information. After that, the call can be performed by the same operation as that at the time of outgoing. The same applies when the call from the other party is disconnected.
[0089]
(Step E)
When the driver turns off the key or takes the videophone terminal 801 out of the vehicle and becomes unable to communicate with the instrument panel 802, the hands-free state is canceled, and both the videophone terminal 801 and the instrument panel 802 are in the initial state. Return to.
[0090]
As described above, also in the present embodiment, an in-vehicle operating environment designed on the premise of simple and safe operation without bringing in or adjusting the wireless camera 502 simply by bringing the videophone terminal 801 into the vehicle. A hands-free videophone system that uses this function can be realized.
[0091]
In the present embodiment, the system information stored in the system information storage unit 315 of the videophone terminal 801 is described as including camera setting information. However, the system information storage unit 608 of the wireless camera 502 stores the information. You may keep it.
[0092]
In this embodiment, the wireless camera 502, the headset 501, and the instrument panel 802 have a video encoder 208, a camera unit 607, a video decoder 209, a display 210, an audio codec 207, a microphone 603, and a speaker 604. Although an example of using it has been described, some of these functions may be configured so as to use those equipped in the videophone terminal 801.
[0093]
(Embodiment 4)
Hereinafter, an in-vehicle hands-free videophone system according to a fourth embodiment of the present invention will be described with reference to the drawings.
FIG. 14 is a configuration diagram of an emergency call system using a hands-free videophone system according to the fourth embodiment of the present invention. This emergency call system includes an emergency call center 1101 connected via a telephone network 314 and a hands-free videophone system (videophone terminal 106, headset 501, wireless camera 502 and instrument panel 503 connected via a wireless communication medium 107). It consists of.
[0094]
The emergency call system configured as described above will be described.
The emergency call center 1101 has a monitor device 1101a and the like for making a voice and image call via the telephone network 314 with the user's videophone terminal 106 registered in advance. , Name, and vehicle information (number plate number, vehicle type, etc.). On the other hand, the telephone number of the emergency call center is stored on the videophone terminal 106 side.
[0095]
Here, for example, when an emergency call is required due to an accident or a sudden illness, and the driver or passenger presses the emergency call button provided on the instrument panel 503, the videophone terminal 106 is connected via the telephone network 314. Call the emergency call center 1101. Of course, notification may be automatically made without a clear operation by the driver, such as collision detection by a collision sensor or air bag operation detection. The setting of the wireless camera 502 is switched so that the entire interior of the vehicle moves. After the line connection, hands-free communication between the emergency call center 1101 and the vehicle becomes possible. Further, from the emergency call center 1101, the wireless camera 502 in the vehicle can be controlled, for example, zoomed and panned, and the state inside the vehicle can be known from a remote place by voice and image.
[0096]
FIGS. 15A and 15B are screen display examples in such an emergency call system. FIG. 15A shows a screen display example on the display 210 of the in-vehicle instrument panel 503, and FIG. 15B shows a screen display example of the monitor device 1101a installed in the emergency call center 1101. As shown in FIG. 15 (a), a driver who is a registered user, when an emergency occurs, simply presses the emergency call button displayed on the display 210 of the instrument panel 503, and the emergency call center 1101 Voice and image calls can be made. Further, as shown in FIG. 15B, the emergency call center 1101 can see the inside of the vehicle of the driver or the like who has made an emergency call or can talk with the driver or the like.
[0097]
As described above, according to the present embodiment, it is possible to make a hands-free call with the emergency call center 1101 in an emergency, and it is possible to transmit an in-vehicle image to the call partner and to control the camera from the call partner. . With the same configuration, it is possible to apply real-time transmission to a specific partner such as a front image during driving and image recording at a transmission destination.
[0098]
In addition, about each of said embodiment, as radio | wireless communication interface 202a-d used for each connection between videophone terminal 106,801, headset 501, wireless camera 502, instrument panel 105,503,802, it is wireless. Communication technology Bluetooth, infrared communication technology IrDA, etc. can be used, but if at least one of these connections is connected wirelessly, other connections are equivalent, such as wired USB, IEEE1394, and in-vehicle BUS instead of wireless A medium capable of realizing the above functions may be used.
[0099]
For each of the above embodiments, if the other party is not compatible with a videophone and can only carry out a voice call, the camera function is not used and the device operates as a hands-free system with only normal voice. Good.
[0100]
Furthermore, each of the above embodiments has been described by taking a videophone terminal as an example, but it is not necessarily a videophone terminal, and system information can be stored even in a normal mobile phone that does not have a videophone function. The same effect can be obtained if it can be operated as a hands-free videophone system using peripheral devices such as cameras and headsets.
[0101]
In other words, not only are peripheral devices such as microphones, speakers, cameras, and displays built into mobile terminals brought into the car replaced with in-vehicle peripheral devices, but also peripheral devices that are not built in the mobile terminal are installed in the vehicle. It may be supplemented with peripheral devices. For example, a mobile terminal in which a built-in camera is broken or a mobile phone that does not have a built-in camera can transfer an image in the car to the other party by complementing and using the in-vehicle camera. Specifically, for example, even if the camera 310 of the videophone terminal 106 in the first embodiment is broken or removed, the first of the media demultiplexing unit 304 shown in FIG. The switching unit 304a allows the audio / video multiplexed data sent from the instrument panel 105 to pass through the baseband processing unit 303, so that the video in the vehicle can be transmitted to the other party.
[0102]
In the above embodiment, the phone number and the phone book stored in the videophone terminal 106 are used as the destination telephone number. However, the phone number and the phone book are stored in the video phone terminal 106. For example, an instrument panel or the like may be used. That is, when one telephone number stored in the instrument panel is designated by the user, the control procedure may be such that the telephone number is notified from the instrument panel to the videophone terminal 106 and the videophone terminal 106 is called.
[0103]
Furthermore, each of the embodiments has been described by taking the instrument panel as an example. However, the present invention is not necessarily limited to the instrument panel, and functions equivalent to in-vehicle devices such as a car navigation system and a multimedia display system are implemented, and equivalent functions are provided. It may be realized. In addition, regarding the operation surface, the display on the instrument panel and the operation using the operation buttons have been described as examples. However, a voice recognition processing unit is provided on the instrument panel or the headset side, and the operation input is performed by voice input from the microphone. Good.
[0104]
【The invention's effect】
As is apparent from the above description, according to the in-vehicle hands-free system of the present invention, peripheral devices such as a microphone, a speaker, a camera, a display, etc. dedicated to the hands-free system are not provided, but are incorporated in the car in advance. In-car devices such as microphones, speakers, cameras, displays, etc., possessed by car navigation devices, car audio devices, TV devices, indoor cameras, etc. are also used as hands-free systems. In other words, portable terminals such as videophone terminals brought into the vehicle are connected to these on-vehicle peripheral devices by wireless communication, so that they can replace or lack peripheral devices such as built-in microphones, speakers, cameras, and displays. Communication such as telephone is performed using these in-vehicle devices so as to complement the peripheral devices.
[0105]
Therefore, according to the present invention, a hands-free system can be realized simply by bringing a mobile terminal into the vehicle without bringing peripheral devices dedicated to the hands-free system into the vehicle. Is avoided. Since all operations such as volume adjustment in the hands-free system may be performed on the in-vehicle device, a special operation dedicated to the hands-free system is not required. In other words, hands-free videophone calls can be made using the operation interface of the in-vehicle device designed for use in the vehicle environment, so simple operation without troublesome settings and safe driving A hands-free system that can ensure the above is realized.
[0106]
In addition, the in-vehicle hands-free system of the present invention further stores in-vehicle camera setting information in a mobile terminal, and customizes for each user using the setting information stored in the mobile terminal at the start of hands-free. The camera setting is automatically performed. Alternatively, the setting information of the in-vehicle camera is stored in one of the microphone, speaker, camera, and display of the in-vehicle device in association with the mobile terminal, and the setting information stored in the in-vehicle device is used at the start of hands-free operation. Thus, the camera setting customized for each user is automatically performed. Thus, by storing the camera setting information customized for each individual in the mobile terminal or the like, the camera adjustment specific to the owner is automatically performed just by bringing the mobile terminal into the vehicle.
[0107]
In addition, the in-vehicle hands-free system of the present invention can be used for engine key operation, input operation to the mobile terminal or in-vehicle device, communication link state between the mobile terminal and in-vehicle device, set state of the mobile terminal in the phone holder, In conjunction with this, it is configured to switch between a normal operation state of a normal mobile terminal and a hands-free operation state. Thereby, the use of the hands-free system can be automatically started without performing troublesome operations such as connecting the portable terminal brought into the vehicle to the in-vehicle adapter with a cable and pressing a button.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of an in-vehicle hands-free videophone system according to a first embodiment of the present invention.
FIG. 2 is a functional block diagram of the hands-free videophone system according to the first embodiment of the present invention.
FIG. 3 is a functional block diagram of the videophone terminal according to the first embodiment of the present invention.
FIG. 4 is a block diagram showing a detailed configuration of a media demultiplexing unit of the videophone terminal according to the first embodiment of the present invention.
FIG. 5 is a diagram showing an operation sequence of the hands-free videophone system according to the first embodiment of the present invention.
6A is an example of a screen display in which a telephone directory is displayed on the instrument panel display according to the first embodiment of the present invention, and FIG. 6B is a screen display according to the first embodiment of the present invention. It is an example of a screen display in which a call partner and oneself (driver) are displayed on the instrument panel display.
FIG. 7 is a configuration diagram of an in-vehicle hands-free videophone system according to a second embodiment of the present invention.
FIG. 8 is a functional block diagram of a hands-free videophone system according to a second embodiment of the present invention.
FIG. 9 is a diagram showing an operation sequence of the hands-free videophone system according to the second embodiment of the present invention.
FIG. 10 is a configuration diagram of an in-vehicle hands-free videophone system according to a third embodiment of the present invention.
FIG. 11 is a functional block diagram of a hands-free videophone system according to a third embodiment of the present invention.
FIG. 12 is a block diagram showing a detailed configuration of a media demultiplexing unit of a videophone terminal according to a third embodiment of the present invention.
FIG. 13 is a diagram showing an operation sequence of the hands-free videophone system according to the third embodiment of the present invention.
FIG. 14 is a configuration diagram of an emergency call system using an in-vehicle hands-free videophone system according to a fourth embodiment of the present invention.
FIGS. 15A and 15B are screen display examples in the emergency call system according to the fourth embodiment of the present invention, and FIG. 15A shows a menu button displayed on the display of an in-vehicle instrument panel A screen display example is shown, and (b) shows a screen display example in which the interior of the communication partner is displayed on a monitor device installed in the emergency call center.
FIG. 16 is a configuration diagram of a conventional in-vehicle hands-free system.
[Explanation of symbols]
101, 306, 603 Microphone
102, 307, 604 Speaker
103, 310 Camera
104 Connection cable
105, 503, 801 Instrument panel
106 Videophone terminal
107 wireless communication medium
108 room mirror
201, 801 Videophone terminal body
202a to 202d Wireless communication interface
203, 203a Operation buttons
204, 304, 1304 Media demultiplexing unit
205, 313, 601, 606, 609, 901 Control unit
206, 315, 502, 605, 608, 902 System information storage unit
207, 305 Audio codec
208, 308 Video encoder
209, 309 Video decoder
210, 311 display
301 Antenna
302 RF part
303 Baseband processing unit
304a, 304b switching unit
304b 1304c to 1304f switching unit
304c, 1304a Multiplexer
304d, 1304d Separation unit
304e control port
312 Operation buttons
314 telephone network
501 headset
502 wireless camera
607 Camera unit
1101 Emergency Call Center
1101a Monitor device

Claims (21)

An in-vehicle hands-free system comprising an in-vehicle device including at least one of a microphone, a speaker, a camera, and a display as a constituent element and a portable terminal that performs wireless communication using at least one of video and audio via a communication network There,
The in-vehicle device is
First communication means for wirelessly communicating with the portable terminal;
Attribute information notifying means for notifying the portable terminal of attribute information for specifying the component via the first communication means,
The portable terminal is
Peripheral means comprising at least one of a microphone, a speaker, a camera and a display;
Second communication means for wirelessly communicating with the in-vehicle device;
Attribute information acquisition means for acquiring attribute information notified from the in-vehicle device via the second communication means;
In wireless communication via the communication network, replacement control for controlling the corresponding component of the in-vehicle device to be used instead of the peripheral means based on the attribute information acquired by the attribute information acquisition means A vehicle-mounted hands-free system. The replacement control means blocks the data path connecting the wireless communication transmission path and the peripheral means, and instead of the data path, connects the wireless communication transmission path and the in-vehicle device. 2. The in-vehicle hands-free system according to claim 1, wherein the control is performed by establishing a data path by the second communication means. 3. The in-vehicle hands-free system according to claim 2, wherein the data path is a path for transmitting data in which video and audio are multiplexed. 3. The in-vehicle hands-free system according to claim 2, wherein the data path is a path for transmitting only video or audio data. The in-vehicle device includes a camera as its component,
The mobile terminal further includes:
Storage means for storing camera setting information for specifying shooting conditions of the camera of the in-vehicle device;
Camera setting information notifying means for transmitting the camera setting information stored in the storage means to the in-vehicle device via the second communication means, and
The in-vehicle device further includes
The in-vehicle hands-free system according to claim 1, further comprising camera control means for controlling the camera in accordance with a photographing condition indicated by camera setting information transmitted from the portable terminal. The in-vehicle device includes a camera as its component,
The in-vehicle device further includes
Storage means for storing camera setting information for specifying shooting conditions of the camera in association with each of a plurality of portable terminals;
Camera setting information stored in the storage means is read out corresponding to the mobile terminal brought into the vehicle, and camera control means for controlling the camera according to the shooting conditions indicated by the read camera setting information. The in-vehicle hands-free system according to claim 1. The mobile terminal further includes:
2. A state switching means for switching between a hands-free videophone operating state in which the replacement control means functions in conjunction with an operation of an engine key and a single operation state in which the replacement control means does not function. The in-vehicle hands-free system described. The in-vehicle hands-free system further includes:
State switching means for switching between a hands-free videophone operating state in which the replacement control means functions and a single operation state in which the replacement control means does not function based on an operation by an operator on the portable terminal or the in-vehicle device. The in-vehicle hands-free system according to claim 1. The in-vehicle hands-free system further includes:
Based on a communication link state between the in-vehicle device and the portable terminal by the first and second communication means, a hands-free videophone operating state for causing the replacement control means to function, and a single operation state for not allowing the replacement control means to function The vehicle-mounted hands-free system according to claim 1, further comprising state switching means for switching between the two. The in-vehicle hands-free system further includes:
Holder means for holding the portable terminal;
State switching for switching between a hands-free videophone operating state in which the replacement control unit functions and a single operation state in which the replacement control unit does not function based on a set state of whether or not the portable terminal is held by the holder The vehicle-mounted hands-free system according to claim 1, further comprising: means. An in-vehicle hands-free system comprising an in-vehicle device including at least one of a microphone, a speaker, a camera, and a display as a constituent element and a portable terminal that performs wireless communication using at least one of video and audio via a communication network There,
The in-vehicle device is
First communication means for wirelessly communicating with the portable terminal;
Attribute information notifying means for notifying the portable terminal of attribute information for specifying the component via the first communication means,
The portable terminal is
Peripheral means consisting of 1 to 3 of microphone, speaker, camera and display;
Second communication means for wirelessly communicating with the in-vehicle device;
Attribute information acquisition means for acquiring attribute information notified from the in-vehicle device via the second communication means;
In wireless communication via the communication network, based on the attribute information acquired by the attribute information acquisition means, at least one of a microphone, a speaker, a camera, and a display not included in the peripheral means, An in-vehicle hands-free system comprising: complementary control means for controlling so that corresponding components of the device are complemented and used. The in-vehicle device includes a camera as its component,
The mobile terminal further includes:
Storage means for storing camera setting information for specifying shooting conditions of the camera of the in-vehicle device;
Camera setting information notifying means for transmitting the camera setting information stored in the storage means to the in-vehicle device via the second communication means, and
The in-vehicle device further includes
12. The in-vehicle hands-free system according to claim 11, further comprising camera control means for controlling the camera in accordance with shooting conditions indicated by camera setting information transmitted from the portable terminal. The in-vehicle device includes a camera as its component,
The in-vehicle device further includes
Storage means for storing camera setting information for specifying shooting conditions of the camera in association with each of a plurality of portable terminals;
Camera setting information stored in the storage means is read out corresponding to the mobile terminal brought into the vehicle, and camera control means for controlling the camera according to the shooting conditions indicated by the read camera setting information. The in-vehicle hands-free system according to claim 11. The mobile terminal further includes:
12. A state switching unit that switches between a hands-free videophone operating state in which the complementary control unit functions in conjunction with an operation of an engine key and a single unit operating state in which the complementary control unit does not function. The in-vehicle hands-free system described. The in-vehicle hands-free system further includes:
State switching means for switching between a hands-free videophone operating state in which the complementary control means functions and a single operation state in which the complementary control means does not function based on an operation by the operator on the portable terminal or the in-vehicle device. The in-vehicle hands-free system according to claim 11. The in-vehicle hands-free system further includes:
Based on a communication link state between the in-vehicle device and the portable terminal by the first and second communication means, a hands-free videophone operation state in which the complementary control means functions, and a single operation state in which the complementary control means does not function The vehicle-mounted hands-free system according to claim 11, further comprising state switching means for switching between the two. The in-vehicle hands-free system further includes:
Holder means for holding the portable terminal;
Based on the set state of whether or not the portable terminal is held by the holder, state switching for switching between a hands-free videophone operating state in which the complementary control means functions and a single operation state in which the complementary control means does not function The vehicle-mounted hands-free system according to claim 11, further comprising: means. A portable terminal that performs wireless communication by at least one of video and audio via a communication network,
Peripheral means comprising at least one of a microphone, a speaker, a camera and a display;
A communication unit that wirelessly communicates with an in-vehicle device including at least one of a microphone, a speaker, a camera, and a display;
Attribute information acquisition means for acquiring attribute information for identifying the component notified from the in-vehicle device via the communication means;
In wireless communication via the communication network, replacement control for controlling the corresponding component of the in-vehicle device to be used instead of the peripheral means based on the attribute information acquired by the attribute information acquisition means A portable terminal. The in-vehicle device includes a camera as its component,
The mobile terminal further includes:
Storage means for storing camera setting information for specifying shooting conditions of the camera of the in-vehicle device;
Camera setting information notification means for transmitting the camera setting information stored in the storage means to the in-vehicle device via the communication means,
The mobile terminal according to claim 18, wherein the in-vehicle device controls the camera according to a shooting condition indicated by camera setting information transmitted from the mobile terminal. A portable terminal that performs wireless communication by at least one of video and audio via a communication network,
Peripheral means consisting of 1 to 3 of microphone, speaker, camera and display;
A communication unit that wirelessly communicates with an in-vehicle device including at least one of a microphone, a speaker, a camera, and a display;
Attribute information acquisition means for acquiring attribute information for identifying the component notified from the in-vehicle device via the communication means;
In wireless communication via the communication network, based on the attribute information acquired by the attribute information acquisition means, at least one of a microphone, a speaker, a camera, and a display not included in the peripheral means, A portable terminal comprising: a complementary control unit configured to perform control so that corresponding components of the device are complemented and used. The in-vehicle device includes a camera as its component,
The mobile terminal further includes:
Storage means for storing camera setting information for specifying shooting conditions of the camera of the in-vehicle device;
Camera setting information notification means for transmitting the camera setting information stored in the storage means to the in-vehicle device via the communication means,
The mobile terminal according to claim 20, wherein the in-vehicle device controls the camera according to a shooting condition indicated by camera setting information transmitted from the mobile terminal.

Images