KR20130002646A - Mobile terminal and control method for mobile terminal - Google Patents

Abstract

PURPOSE: A mobile terminal capable of transmitting information to and receiving information from other mobile terminals regarding a three-dimensional video call and a control method thereof are provided to efficiently control cameras according to a video call mode in a mobile terminal which supports a three-dimensional video call. CONSTITUTION: A wireless communications unit(110) is connected to other mobile terminals. Each of multiple cameras obtains external images. A control unit(180) requests a three-dimensional video call to the other mobile terminals. If either a two-dimensional video call mode or a three-dimensional video call mode is selected by the other mobile terminals, the control unit controls the multiple cameras based on the selected video call mode. [Reference numerals] (110) Wireless communications unit; (111) Broadcast receiving module; (112) Mobile communications module; (113) Wireless internet module; (114) Local area communications module; (115) Location information module; (120) A/V input unit; (121) Camera; (122) Microphone; (130) User input unit; (140) Sensing unit; (141) Proximity sensor; (150) Output unit; (151) Display module; (152) Sound output module; (153) Alarm unit; (154) Haptic module; (160) Memory; (170) Interface unit; (180) Control unit; (181) Multimedia module; (190) Power supply unit

Description

Mobile terminal and control method for mobile terminal

The present invention relates to a mobile terminal and a control method of the mobile terminal.

Terminals may be divided into mobile terminals and stationary terminals according to their mobility. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can carry it directly.

Recently, as the services provided by the mobile terminal are diversified, it is considered to improve the structural part and / or the software part of the terminal.

An object of the present invention is to provide a mobile terminal and a method of controlling the mobile terminal for efficiently controlling a camera according to a video call mode in a mobile terminal capable of stereoscopic video call.

A mobile terminal according to an aspect of the present invention, a wireless communication unit for connecting with another mobile terminal; A plurality of cameras for acquiring an external image; And requesting a 3D video call to the other mobile terminal, and selecting one of a 2D video call mode and a 3D video call mode by the other mobile terminal, based on the selected video call mode. It includes a control unit for controlling the camera.

A mobile terminal according to another aspect of the present invention, a wireless communication unit for connecting with another mobile terminal; And upon receiving a 3D video call request from another mobile terminal, selects one of a 2D video call mode and a 3D video call mode based on a user's control input, and selects a video call mode for the selected video call mode. And a control unit for transmitting information to the other mobile terminal.

In addition, a control method of a mobile terminal having a plurality of cameras for acquiring an external image according to an aspect of the present invention includes: requesting a stereoscopic video call to another mobile terminal; Receiving, by the other mobile terminal, a video call mode selected from a 2D video call mode and a 3D video call mode; And controlling the plurality of cameras based on the selected video call mode.

The mobile terminal and the method for controlling the mobile terminal according to the present invention can transmit and receive information to and from the other mobile terminal in relation to the three-dimensional video call, it is possible to efficiently control the camera according to the video call mode.

1 is a block diagram of a mobile terminal according to embodiments of the present invention.
2 and 3 are views for explaining a stereoscopic image display method using a binocular parallax associated with embodiments of the present invention.
4 to 7 are views for explaining the appearance of a mobile terminal according to embodiments of the present invention.
8 and 9 are flowcharts illustrating a control method when the mobile terminal 100 according to an embodiment of the present invention is a transmitting mobile terminal.
10 to 12 are detailed flowcharts of step S107 of FIG. 8.
FIG. 13 illustrates an example in which the mobile terminal 100 controls the left image camera and the right image camera according to a user's selection according to an embodiment of the present invention.
14 is a detailed flowchart of steps S109 to S111 of FIG. 9.
15 and 16 illustrate examples in which the mobile terminal 100 switches a video call mode according to an embodiment of the present invention.
17 and 18 are flowcharts illustrating a control method when the mobile terminal 100 according to an embodiment of the present invention is a receiving mobile terminal.
19 illustrates an example of a 3D video call reception screen according to an embodiment of the present invention.
20 illustrates an example of a screen for changing a video call mode during a video call according to an embodiment of the present invention.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. In addition, numerals (e.g., days, days, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another component

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

In addition, the suffix "module" and " part "for constituent elements used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) .

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a mobile terminal according to embodiments of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, an EPG (Electronic Program Guide) of a DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of a DVBH (Digital Video BroadcastHandheld).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (object), information on the time when the distance information is measured, , It is possible to calculate three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continues to calculate the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display module 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. The sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to visual, auditory or tactile sense and includes a display module 151, an acoustic output module 152, an alarm unit 153, and a haptic module 154 .

The display module 151 displays information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display module 151 is a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, or a 3D display. It may include at least one.

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display module 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display module 151 of the terminal body.

There may be two or more display modules 151 according to the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display modules may be spaced apart or integrally arranged on one surface, and may be disposed on different surfaces, respectively.

In a case where the display module 151 and the sensor for sensing the touch operation (hereinafter, referred to as 'touch sensor') have a mutual layer structure (hereinafter referred to as 'touch screen' It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display module 151 or capacitance generated at a specific portion of the display module 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display module 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of a mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensor 141 has a longer life and higher utilization than the contact sensor.

Examples of the proximity sensor 141 include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or audio signal may also be output through the display module 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM At least one of a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Type storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module. (Universal Subscriber Identity Module, USIM) and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

2 and 3 are views for explaining a stereoscopic image display method using a binocular parallax associated with embodiments of the present invention. 2 illustrates a method using a lenticular lens array, and FIG. 3 illustrates a method using a parallax barrier.

The binocular parallax refers to the difference in the way the left and right eyes of a person see things. When a human's brain synthesizes the image seen through the left eye and the image seen through the right eye, the synthesized image makes a person feel three-dimensional.

Hereinafter, a phenomenon in which a person perceives a stereoscopic effect according to a binocular disparity is referred to as 'stereoscopic vision', and an image causing stereoscopic vision is referred to as a 'stereoscopic image'. Also, when a specific object included in the image causes stereoscopic vision, the object is referred to as a 'stereoscopic object'.

The stereoscopic image display method according to the binocular disparity can be classified into a spectacle type requiring special glasses and a non-eye type requiring no glasses.

The spectacles include a method using sunglasses with wavelength selectivity, a polarization glasses method using a light blocking effect according to a polarization difference, and a time-division glasses method alternately presenting left and right images within an afterimage time of an eye. In addition, there is a method in which a filter having different transmittances is mounted in the left and right sides to obtain a stereoscopic effect on the movement in the left and right directions according to the time difference of the visual system coming from the difference in the transmittances.

The autostereoscopic method, in which a stereoscopic effect is generated on the image display surface rather than the observer, includes a parallax barrier method, a lenticular lens method, a microlens array method, and the like.

Referring to FIG. 2, the display module 151 includes a lenticular lens array 11a to display a stereoscopic image. The lenticular lens array 11a includes a display surface 13 in which the pixels L to be input to the left eye 12a and the pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction, and the left and right eyes 12a, 12b), and provides optical discrimination directivity for the pixel L to be input to the left eye 12a and the pixel R to be input to the right eye 12b. Accordingly, the image passing through the lenticular lens array 11a is observed separately from the left eye 12a and the right eye 12a, and the human brain is viewed through the left eye 12a and through the right eye 12b. By synthesizing the three-dimensional image.

Referring to FIG. 3, the display module 151 includes a vertical grid parallax barrier 11b to display a stereoscopic image. The parallax barrier 11b includes a display surface 13 and left and right eyes 12a in which pixels L to be input to the left eye 12a and pixels R to be input to the right eye 12b are alternately arranged along the horizontal direction. 12b), the image is separated from the left eye 12a and the right eye 12b through a vertical grid-shaped aperture. Therefore, the human brain synthesizes an image viewed through the left eye 12a and an image viewed through the right eye 12b to observe a stereoscopic image. The parallax barrier 11b is turned on only when a three-dimensional image is to be displayed and is separated from the incident time, and is turned off when a planar image is to be displayed. have.

Meanwhile, the stereoscopic image display methods described above are for illustrating embodiments of the present invention, and the present invention is not limited thereto. The present invention can display stereoscopic images using binocular parallax using various methods in addition to the above-described methods.

4 to 7 are views for explaining the appearance of a mobile terminal according to embodiments of the present invention.

4 and 5 are perspective views of front views of examples of mobile terminals according to embodiments of the present invention.

Referring to FIG. 4, the mobile terminal 100 includes a terminal body having a bar shape. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display module 151, the audio output module 152, the camera 121, the user input unit 130/131, 132, the microphone 122, the interface 170, etc. may be disposed in the terminal body, mainly the front case 101. have.

The display module 151 occupies most of the main surface of the front case 101. The sound output module 152 and one camera 121 are disposed in regions adjacent to one end of both ends of the display module 151, and the user input unit 131 and the microphone 122 are disposed in regions adjacent to the other end. . The user input unit 132, the interface 170, and the like are disposed on the side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of manipulation units 131 and 132.

The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

The contents input by the manipulation units 131 and 132 may be variously set. For example, the operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 adjusts the volume of the sound output from the sound output module 152 or the display module 151. Commands such as switching to the touch recognition mode may be input.

FIG. 5 illustrates an example in which the number of cameras disposed in front of the mobile terminal 100 and the terminal body illustrated in FIG. 4 is different. Referring to FIG. 5, a plurality of cameras 121a and 121b may be provided on the front surface of the terminal body.

6 and 7 are perspective views of examples of a mobile terminal associated with embodiments of the present invention viewed from the rear side.

Referring to FIG. 6, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 'has a photographing direction substantially opposite to the cameras 121 / 121a and 121b disposed in the front case 101, see FIGS. 2 and 3, and the camera 121 disposed in the front case 101. It may be a camera having different pixels from / 121a and 121b.

The terminal body is equipped with a power supply unit 190 for supplying power to the mobile terminal 100. The power supply unit 190 may be built in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display module 151. In this case, if the display module 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102.

The touch pad 135 operates in association with the display module 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display module 151. The touch pad 135 may have the same or smaller size as the display module 151.

FIG. 7 illustrates an example in which the number of cameras disposed on the rear of the terminal body and the mobile terminal 100 shown in FIG. 6 is different. Referring to FIG. 7, a plurality of cameras 121 ′ and 121 ′ b may be provided at the rear of the body.

4 to 7 illustrate examples of the appearance of a mobile terminal related to embodiments of the present invention, and the present invention is not limited thereto. The present invention is also applicable when the arrangement position of the camera is different from the examples shown in FIGS. 4 to 7.

Embodiments disclosed in this document may be implemented in the mobile terminal 100 described with reference to FIGS. 1 to 7. Hereinafter, embodiments of the present invention will be described.

In the embodiments disclosed herein, the display module 151 may be provided with a panel for implementing stereoscopic vision. As described above, the panel may have a structure for implementing stereoscopic vision in any one of a lenticular lens method or a parallax barrier method.

In addition, in the embodiments disclosed in this document, the mobile terminal 100 may be provided with a plurality of cameras on at least one surface of the front and rear.

In the following description, a camera for capturing a left image corresponding to a left eye image is referred to as a 'left image camera' for generating a stereoscopic image for convenience of description, and a camera for capturing a right image corresponding to a right eye image. Is called 'right video camera'.

In addition, the camera located in the front of the terminal body is used as a 'front camera' and the camera located in the rear of the terminal body is used as a 'rear camera'.

Hereinafter, a video call method of a mobile terminal and an operation of the mobile terminal 100 to implement the same will be described in detail with reference to the accompanying drawings.

8 and 9 are flowcharts illustrating a method of controlling the mobile terminal 100 according to an exemplary embodiment of the present invention, which illustrates a case in which the mobile terminal 100 operates as a transmitting mobile terminal. 10 to 16 are diagrams for describing a control method when the mobile terminal 100 operates as a transmitting mobile terminal according to an embodiment of the present invention.

Referring to FIG. 8, when a stereoscopic video call is requested from a user, the controller 180 requests a stereoscopic video call to the mobile terminal of the counterpart through the wireless communication unit 110 (S101).

In addition, the left video camera 121a / 121'a and the right video camera 121b / 121'b are turned on to enable stereoscopic video call (S102).

In operation S102, the controller 180 may select a left image camera and a right image camera used for a 3D video call according to the camera arrangement of the mobile terminal 100.

For example, the controller 18 has a plurality of cameras 121a, 121b, 121'a, and 121'b located at both the front and the rear of the mobile terminal 100, so that stereoscopic image capturing is possible from both the front and the rear. In this case, only the cameras 121a / 121'a and 121b / 121'b located at either one of the front and the rear may be turned on for the 3D video call based on the default setting information.

For example, the controller 180 includes a plurality of cameras 121a, 121b, 121'a, and 121'b located at both the front and the rear of the mobile terminal 100, thereby capturing stereoscopic images from both the front and the rear. If this is possible, only the cameras 121a / 121'a and 121b / 121'b positioned in the direction selected by the user among the front and rear surfaces may be turned on for the 3D video call.

In addition, for example, the controller 180 may include a plurality of cameras 121a / 121'a and 121b / 121'b on only one surface of the front and rear surfaces of the mobile terminal 100, and thus may have any one surface. When only stereoscopic image capturing is possible, only cameras 121a / 121'a and 121b / 121'b disposed on a surface capable of stereoscopic image capturing may be turned on for stereoscopic video call.

Meanwhile, in an embodiment of the present invention, the step of turning on the left video camera 121a / 121'a and the right video camera 121b / 121'b to enable a 3D video call is performed by the receiving mobile terminal. Although the case is performed before accepting as an example, the present invention is not limited thereto.

According to the present invention, the step of turning on the left video camera 121a / 121'a and the right video camera 121b / 121'b is performed after the receiver mobile terminal accepts the 3D video call. It is also possible.

When the call is connected to the receiving mobile terminal (S103), the controller 180 may receive information including whether to accept the 3D video call from the receiving mobile terminal (S104).

If the stereoscopic video call is accepted from the receiving mobile terminal (S105), the controller 180 transmits the stereoscopic video to the receiving mobile terminal to perform the stereoscopic video call (S106).

The stereoscopic image may be generated by synthesizing the left image and the right image through the left image camera 121a / 121'a and the right image camera 121b / 121'b.

Here, the controller 180 acquires images sequentially or simultaneously images from the left image camera 121a / 121'a and the right image camera 121b / 121'b, respectively, and synthesizes the stereoscopic images. Can be generated.

In operation S105, when a two-dimensional video call is selected from the receiving mobile terminal instead of the three-dimensional video call, the controller 180 performs camera control for the two-dimensional video call (S107). In addition, a two-dimensional video call is performed by transmitting a two-dimensional video to the counterpart mobile terminal (S108).

In operation S107, the controller 180 may perform camera control for 2D video call based on a default setting, a user's selection, a camera arrangement, and the like. The camera control method for the two-dimensional video call will be described in detail with reference to FIGS. 10 to 14 to be described later.

10 to 12 are detailed flowcharts of step S107 of FIG. 8. 13 illustrates an example of controlling a left image camera and a right image camera according to a user's selection.

10 is a flowchart illustrating an example of a camera control method for 2D video call.

Referring to FIG. 10, when the 2D video call is requested from the counterpart mobile terminal, the controller 180 reads the default setting of the 2D video call mode from the memory 160 (S201).

Based on the read default setting, only one of the left video cameras 121a / 121'a and the right video cameras 121b / 121'b currently in the ON state is turned on (S202).

Accordingly, the controller 180 transmits the two-dimensional image acquired through the camera which is turned ON among the left image camera 121a / 121'a and the right image camera 121b / 121'b to the counterpart mobile terminal, thereby transmitting the two-dimensional image. You can make a video call.

FIG. 11 is a flowchart illustrating another example of a camera control method for a 2D video call, and illustrates a camera control method of the mobile terminal described with reference to FIGS. 5 and 6.

Referring to FIG. 5, a plurality of cameras 121a and 121b capable of capturing stereoscopic images are positioned in front of the terminal body of the mobile terminal 100. In addition, referring to FIG. 6, one camera 121 ′ capable of capturing two-dimensional images is located at the rear of the terminal body of the mobile terminal 100.

Referring to FIG. 11, when a two-dimensional video call is requested from a counterpart mobile terminal, the controller 180 turns off front cameras 121a and 121b used for a three-dimensional video call (S301).

In addition, the rear camera 121 'is turned on, and a two-dimensional video call is performed using the two-dimensional image captured by the rear camera 121'.

That is, the camera used for the video call is switched from the cameras 121a and 121b located at the front side to the camera 121 'located at the rear side.

Meanwhile, as illustrated in FIGS. 4 and 7, one camera 121 is positioned at the front side, and a plurality of cameras 121'a and 121'b are positioned at the rear side, and the cameras 121 are positioned at the rear side. When performing a 3D video call using 'a, 121'b), the controller 180 performs a 2D video call with the cameras 121'a and 121'b positioned behind the camera used for the video call. ) May be switched to the camera 121 located at the front.

12 is a flowchart illustrating still another example of a camera control method for two-dimensional video call. 13 is a diagram for describing the camera control method of FIG. 12.

Referring to FIG. 12, when a two-dimensional video call is requested from a counterpart mobile terminal, the controller 180 receives selection information for camera control from a user (S401).

When the user selects the stereoscopic image transmission (S402), the controller 180 may control the left image camera 121a / 121'a and the right image camera 121b / 121 even if the counterpart mobile terminal 100 requests the 2D video call. 'b) All controls to maintain the ON state (S403). In addition, the stereoscopic image is generated by using the left image and the right image acquired through the left image camera 121a / 121'a and the right image camera 121b / 121'b, and the generated stereoscopic image is transferred to the counterpart mobile terminal. send.

On the other hand, when the user selects to transmit the two-dimensional image using any one of the left image and the right image (S404), the controller 180 based on the user's selection, the left image camera (121a / 121'a) ) And only one of the right image cameras 121b / 121'b maintains the ON state, and controls the other cameras to be OFF (S405 and S406).

In addition, a two-dimensional video call is transmitted by transmitting a two-dimensional image acquired through a camera turned on by a user among the left image camera 121a / 121'a and the right image camera 121b / 121'b to the counterpart mobile terminal. Perform.

Referring to FIG. 13, as the two-dimensional video call is requested from the counterpart mobile terminal, the controller 180 displays a message 13a indicating that the two-dimensional video call is requested from the counterpart mobile terminal.

In addition, the controller 180 displays selection buttons 13b, 13c, and 13d for determining which image to use for a two-dimensional video call.

Accordingly, the user may control which of the selection buttons 13b, 13c, and 13d to select which image to transmit to the counterpart mobile terminal.

For example, when the user selects the 'LEFT' button 13b, the controller 180 may transmit a left image obtained through the left image cameras 121a / 121'a to the counterpart mobile terminal.

For example, when the user selects the 'RIGHT' button 13c, the controller 180 transmits the right image acquired through the right image camera 121b / 121'b to the counterpart mobile terminal.

For example, when the user selects the '3D' button 13c, the controller 180 may control the left image and the right image cameras 121b / 121'b obtained through the left image cameras 121a / 121'a. ) Can be transmitted to the counterpart mobile terminal.

Meanwhile, according to an embodiment of the present disclosure, the controller 180 may change the video call mode at the request of the counterpart mobile terminal during the video call.

Referring to FIG. 9, the controller 180 may receive a video call mode change request from the counterpart mobile terminal 100 during a video call in operation S109.

When the video call mode change request is received from the counterpart mobile terminal 100, the controller 180 performs camera control for the requested video call mode change (S110). In addition, a video call is performed in the video call mode requested to be changed (S111).

Steps S109 to S111 may be continuously performed until the video call between the mobile terminal 100 and the counterpart mobile terminal ends (S112).

Steps S110 to S111 will be described in detail with reference to FIGS. 14 to 16 to be described later.

14 is a detailed flowchart of steps S109 to S111 of FIG. 9. 15 and 16 illustrate examples of switching a video call mode.

Referring to FIG. 14, the controller 180 may receive a video call mode change request from a counterpart mobile terminal during a video call.

If the change of the video call mode is accepted from the user (S501), the controller 180 performs camera control for operating in the video call mode requested to be switched from the counterpart mobile terminal (S502, S503, S504).

Here, the camera control for the 2D video call may be performed by a method similar to the camera control method described with reference to FIGS. 10 to 14.

In addition, camera control for a stereoscopic video call may be performed in a manner similar to the camera control method in the above-described step S102, or control the camera to a state before the step S107 of FIG.

For example, if the controller 180 is requested to switch to the two-dimensional video call mode while performing a stereoscopic video call, the controller 180 notifies that the request for switching to the two-dimensional video call has been received from the counterpart mobile terminal. Is displayed on the screen.

Accordingly, the controller 180 displays selection buttons 15b, 15c, and 15d for determining which image to use when switching to the 2D video call or when switching to the 2D video call. The user may control which of the selection buttons 15b, 15c, and 15d to select which image to transmit to the counterpart mobile terminal.

For example, when the user selects the 'LEFT' button 15b, the controller 180 switches to the two-dimensional video call mode and moves the left image acquired through the left image camera 121a / 121'a to the other party. Can be sent to the terminal.

For example, when the user selects the 'RIGHT' button 15c, the controller 180 switches to the 2D video call mode and displays the right image obtained through the right image camera 121b / 121'b. Send to the other party's mobile terminal.

In addition, for example, when the user selects the 'decline' button 15d, the controller 180 maintains the 3D video call mode, and the left image and the right image obtained through the left image cameras 121a and 121'a. An image obtained by synthesizing the right image acquired through the image cameras 121b / 121'b may be transmitted to the other party's mobile terminal.

In addition, taking FIG. 16 as an example, if a switch to the stereoscopic video call mode is requested while the two-dimensional video call is being performed, the controller 180 notifies the reception of the request to switch to the stereoscopic video call from the counterpart mobile terminal 16a. ) Is displayed on the screen.

Accordingly, the controller 180 displays selection buttons 16b and 16c for determining whether to switch the video call mode on the screen. The user may control the selection buttons 16b and 16c to select whether to change the video call mode.

For example, when the user selects the 'accept' button 16b, the controller 180 switches to the 3D video call mode and the left image camera 121a / 121'a and the right image camera (3D) to generate a 3D image. 121b / 121'b) can be controlled to be in an ON state. In addition, the stereoscopic image is generated by using the left image and the right image acquired through the left image camera 121a / 121'a and the right image camera 121b / 121'b, and the generated stereoscopic image is transferred to the counterpart mobile terminal. Can transmit

Also, for example, when the user selects the 'decline' button 16c, the controller 180 maintains the 2D video call mode. That is, it maintains the current camera state.

17 and 18 are flowcharts illustrating a control method of the mobile terminal 100 according to an embodiment of the present invention, which illustrates a case in which the mobile terminal 100 operates as a receiving side mobile terminal. 19 illustrates an example of a 3D video call reception screen. In addition, FIG. 20 illustrates an example of a screen for changing a video call mode during a video call.

Referring to FIG. 17, the controller 180 receives a stereoscopic video call request from a transmitting mobile terminal through the wireless communication unit 110 (S601). Accordingly, the controller 180 notifies the user that the 3D video call request has been received using the ringtone, vibration, message, and the like (S602).

The user may select whether to accept a call and a video call mode using the user input unit 130.

Referring to FIG. 19, as the stereoscopic video call is requested from the counterpart mobile terminal, the controller 180 displays information 19a of the counterpart requesting the video call on the screen.

In addition, the screen displays the selection buttons 19b, 19c, and 19d for selecting whether to accept the call and the video call mode with respect to the 3D video call request of the other party. The user may control the selection buttons 19b, 19c, and 19d to select whether to accept the call and the video call mode.

For example, when the user selects the '3D' button 19b, the controller 180 may accept a video call request of the other party and perform a video call in the 3D video call mode.

For example, when the user selects the 'general' button 19c, the controller 180 may accept a video call request of the other party and perform a video call in the 2D video call mode.

For example, when the user selects the 'decline' button 19d, the controller 180 may reject the video call request of the counterpart and terminate the call.

Referring back to FIG. 17, in operation S603 to S604, when the stereoscopic video call is accepted by the user, the controller 180 performs camera control for the stereoscopic video call (S605). That is, the left image camera 121a / 121'a and the right image camera 121b / 121'b which acquire the left image and the right image for generating a stereoscopic image are turned on. Here, the camera control method for the three-dimensional video call can be performed in a similar manner to step S102 of FIG. 8 described above, a detailed description thereof will be omitted below.

In addition, the controller 180 acquires a left image and a right image through the left image cameras 121a / 121'a and the right image cameras 121b / 121'b that are turned on, and combines the stereoscopic images obtained by combining the two images. The stereoscopic video call is performed by transmitting to the mobile terminal (S606).

On the other hand, if a 2D video call is selected by the user (S603 and S604), the controller 180 requests a 2D video call to the counterpart mobile terminal (S607). In addition, the camera control for the 2D video call is performed (S608), and the 2D video call is performed with the counterpart mobile terminal (S609). Here, the camera control for the 2D video call may be performed by a method similar to the camera control method described with reference to FIGS. 10 to 14.

Meanwhile, according to an embodiment of the present disclosure, the controller 180 may change the video call mode according to a user's request during the video call.

Referring to FIG. 18, the controller 180 may receive a video call mode change request from a user during a video call in operation S610.

During the video call, the user may request to change the video call mode through the user input unit 130.

Referring to FIG. 20, the controller 180 may display a button 20a for requesting a change in a video call mode while performing a video call on the screen. In addition, when the corresponding button 20a is selected by the user, it may be recognized that the user is requested to change the video call mode.

For example, when the corresponding button 20a is selected by the user during the 2D video call, the user recognizes that the user is requested to switch to the 3D video call mode.

Referring back to FIG. 18, when a change in the video call mode is requested, the controller 180 requests the counterpart mobile terminal 100 to change the video call mode (S611).

In addition, the camera control is performed for the video call mode in which the change is requested (S612), and the video call is performed in the video call mode in which the change is requested (S613). Here, steps S612 to S613 may be performed in a similar manner to steps S110 to S111 of FIG. 9 described above, and thus, detailed descriptions thereof will be omitted below.

Steps S610 to S613 may be continuously performed until the video call between the mobile terminal 100 and the counterpart mobile terminal ends (S614).

As described above, according to an embodiment of the present invention, the mobile terminal 100 transmits and receives information with the other mobile terminal in relation to the three-dimensional video call, it is possible to efficiently control the camera according to the video call mode based on this Do.

For example, when the other party selects a 2D video call, turning on both the left and right video cameras may cause unnecessary power consumption. In this case, therefore, only one camera may be ON as appropriate, thereby minimizing power consumption.

The above-described method of controlling a mobile terminal according to the present invention can be provided by being recorded in a computer-readable recording medium as a program for execution in a computer.

The control method of the mobile terminal according to the present invention can be executed through software. When implemented in software, the constituent means of the present invention are code segments that perform the necessary work. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier in a transmission medium or communication network.

The computer-readable recording medium includes a mode type recording device in which data that can be read by a computer system is stored. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, DVD ± ROM, DVD-RAM, magnetic tape, floppy disks, hard disks, optical data storage devices, and the like. The computer readable recording medium can also be distributed over network coupled computer devices so that the computer readable code is stored and executed in a distributed fashion.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings, and all or some of the embodiments may be selectively combined so that various modifications may be made.

Claims (13)

A wireless communication unit connecting with another mobile terminal;
A plurality of cameras for acquiring an external image; And
Requesting the 3D video call to the other mobile terminal, and when one of the 2D video call mode and the 3D video call mode is selected by the other mobile terminal, Control unit to control the camera
Mobile terminal comprising a.
The method of claim 1,
When the stereoscopic video call mode is selected by the other mobile terminal, the controller controls the plurality of cameras such that a left image camera for obtaining a left image and a right image camera for obtaining a right image are turned on. Mobile terminal, characterized in that.
The method of claim 2,
The plurality of cameras include a first camera and a second camera located at the front of the mobile terminal, a third camera and a fourth camera located at the rear of the mobile terminal,
The controller selects the left video camera and the right video camera from among the plurality of cameras based on previously stored default settings or selection information received from a user.
The method of claim 2,
The plurality of cameras includes a first camera located on a first surface of a body of the mobile terminal, a second camera located on a second surface of a body of the mobile terminal, and a third camera.
The controller selects the second camera and the third camera as the left video camera and the right video camera.
The method of claim 1,
The plurality of cameras includes a left image camera for obtaining a left image and a right image camera for obtaining a right image.
The controller may control the plurality of cameras such that only one of the left video camera and the right video camera is turned on when the 2D video call mode is selected by the other mobile terminal. Mobile terminal.
The method of claim 5,
The controller may control the plurality of cameras such that only a camera selected by a user is turned on among the left image camera and the right image camera.
The method of claim 1,
The plurality of cameras includes a first camera located on a first surface of a body of the mobile terminal, a second camera located on a second surface of a body of the mobile terminal, and a third camera.
The control unit controls the plurality of cameras such that only the first camera is turned on when the two-dimensional video call mode is selected by the other mobile terminal.
The method of claim 1,
The controller is configured to perform a video call in the selected video call mode, and when a change of the video call mode is requested from the other mobile terminal while performing the video call, the plurality of cameras based on the requested video call mode. Mobile terminal, characterized in that for controlling.
A wireless communication unit connecting with another mobile terminal; And
Upon receiving the 3D video call request from the other mobile terminal, one of the 2D video call mode and the 3D video call mode is selected based on a user's control input, and information about the selected video call mode is obtained. Control unit for transmitting to the other mobile terminal
Mobile terminal comprising a.
10. The method of claim 9,
Further comprising a plurality of cameras for obtaining an external image,
The controller controls the plurality of cameras based on the selected video call mode.
The method of claim 10,
When the selected video call mode is the stereoscopic video call mode, the plurality of cameras are turned on so that a left video camera for obtaining a left image and a right video camera for obtaining a right image are turned on among the plurality of cameras. Mobile terminal, characterized in that for controlling.
The method of claim 10,
When the selected video call mode is the two-dimensional video call mode, the controller controls the plurality of cameras so that any one of the plurality of cameras is turned on. Mobile terminal.
In the control method of a mobile terminal having a plurality of cameras for obtaining an external image,
Requesting a stereoscopic video call to another mobile terminal;
Receiving, by the other mobile terminal, a video call mode selected from a 2D video call mode and a 3D video call mode; And
Controlling the plurality of cameras based on the selected video call mode
≪ / RTI >

Images