KR101649638B1 - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed, and a control method thereof. More particularly, the present invention relates to a mobile terminal having a first display and a second display superimposed on each other, And a control unit for selecting an object displayed on the first display or an object displayed on the second display according to a method of receiving the touch when an object is superimposed on the pad and the first and second displays do.

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed, and a control method thereof.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. . In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

As the function of the terminal is increased, the user demands a wider display area, and the volume and weight of the terminal are required to be smaller and lighter. Therefore, as a method for meeting the above-mentioned demand, recently, a user interface capable of using a display in a superimposed manner has been demanded.

The present invention provides a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed, and a control method thereof.

The present invention also provides a method of controlling a mobile terminal according to a display position of an object in a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed.

The present invention also provides a control method of a mobile terminal according to whether or not objects are overlaid in a mobile terminal having a superimposed display structure.

The present invention also provides a method of controlling a mobile terminal according to a touch pressure in a mobile terminal having a superimposed display structure.

The present invention also provides a control method of a mobile terminal according to a touch input surface in a mobile terminal having a superimposed display structure.

The present invention also provides a method for controlling a mobile terminal by dividing a touch screen and other input means in a mobile terminal having a superimposed display structure.

The present invention also provides a method for controlling a mobile terminal according to a touch gesture in a mobile terminal having a superimposed display structure.

The present invention also provides a method of controlling a mobile terminal according to a fingerprint of a finger in a mobile terminal having a superimposed display structure.

The present invention also provides a control method of a mobile terminal according to a touch region in a mobile terminal having a superimposed display structure.

A mobile terminal according to an embodiment of the present invention for realizing the above-mentioned object includes first and second displays superimposed on each other, a touch pad attached to the first and second displays to receive a touch, And a controller for selecting an object displayed on the first display or an object displayed on the second display according to a method of receiving the touch when the objects are superimposed and displayed on the second display.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal having first and second overlapped displays, the method comprising: receiving a touch from a user; displaying an object on the first and second displays An object displayed on the first display is selected according to a method of receiving the touch, and an object displayed on the second display is selected according to a method of receiving the touch.

The mobile terminal according to at least one embodiment of the present invention configured as described above is a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed on each other, .

In addition, the present invention enables a user to select an object displayed on one of the displays according to a touch gesture, a fingerprint of a finger, or a touch area in a mobile terminal having a display structure in which a transparent display and an opaque display are superimposed.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVF-H) And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a three-dimensional display (3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch activation state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may be configured to include a pin arrangement that vertically moves with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various effects of tactile effect such as effect of reproducing the cold sensation using the heat absorbing or heatable element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons. At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be called a so-called " soft key ". The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

Hereinafter, embodiments related to a control method that can be implemented in the terminal configured as above will be described with reference to the accompanying drawings. The following embodiments can be used alone or in combination with each other. In addition, the embodiments described below may be used in combination with the above-described user interface (UI).

The embodiments described below are also applicable to the form factor of all currently available mobile terminals (e.g., a bar type, a flip type, a slide type, a swing type, a folder type, a clip type that can be combined / separated with the main body, .

3 is a conceptual diagram for explaining a configuration of a display unit of a mobile terminal according to the present invention.

In this embodiment, the display unit 151 or the display module 151 has a form in which the first and second display units 155 and 156 are overlapped. The first and second display units 155 and 156 are composed of a transparent OLED (TOLED) and a non-transparent display (e.g., LCD, E-paper). Particularly, when the electronic paper is applied to a watch phone, power consumption is low, so that the electronic paper does not enter the sleep mode and is always on.

In addition, the transparent display and the non-transparent display may be overlapped or separately formed. For example, a single display is composed of one module by superimposing a transparent display and a non-transparent display, and a dual display is formed by separating a transparent display and a non-transparent display as separate display modules.

Hereinafter, in all the embodiments, the transparent display (or the second display) may be referred to as TOLED (Transparent OLED), and the non-transparent display (or the first display) may be a liquid crystal display (LCD) -paper). However, the transparent display and the non-transparent display are not intended to be limited to TOLED and LCD (or E-paper), respectively.

In the mobile terminal according to the present invention, when the transparent display (TOLED) is operated alone, the driving of the LCD may be blocked so as not to interfere with the display of the TOLED. Also, the transparency of the second display can be controlled so as not to interfere with the display of the opaque display (LCD or E-paper). The transparency can be controlled from 0% which is completely transparent to 100% which is opaque.

A touch pad (not shown) may be used as a touch screen on either the upper side or the lower side of the TOLED and the LCD (or E-paper). Hereinafter, it is assumed that the TOLED and the LCD (or E-paper) operate on a touch screen, although not mentioned in all the embodiments of the present invention.

Hereinafter, a method of controlling the operation of a mobile terminal having a display having a superimposed structure will be described.

4 is a diagram illustrating an object selection method according to a display position of an object of a mobile terminal having a superimposed display structure according to the present invention.

the object 211 can be displayed only on the first display if the first display and the second display are overlapped as shown in (a), or only the second display can be displayed on the object 212 ) May be displayed. The objects 211 and 212 may be separately displayed on the first display and the second display as shown in (c), and the objects may be displayed so as not to overlap each other.

Here, the object refers to information displayed in association with the operation of the mobile terminal, such as a menu icon, a text menu list, or a scroll bar.

Even if the display is overlapped as described above, even if the object is displayed on either one of the displays, or if the objects are displayed on both the displays 155 and 156, if the display positions of the objects do not overlap, the user touches the second display The control unit 180 can execute the menu related to the touched object regardless of the display on which the object is displayed.

For reference, when displaying a menu list (or information list) as shown in (d), a highlight effect may be applied by displaying a specific object on an upper display (e.g., a second display). The user may touch the object to which the highlight effect is applied, or may touch the object to which the highlight effect is not applied.

If the touched object is a controllable object (e.g., an activated object) regardless of the highlighting, the control unit 180 may execute a menu or an operation related to the object. However, if the touched object is a non-controllable object (e.g., an inactive object), the control unit 180 does not perform any operation. The activated state and the inactive state can be displayed in a different manner regardless of the highlight effect.

As described above, when there is no overlapping display object even though the display is overlapped, a method of selecting a specific object has been described. Hereinafter, a method of selecting a specific object when different objects are displayed on the overlapping display will be described.

5A and 5B are diagrams for explaining an object selection method in a case where objects are superimposed and displayed in a mobile terminal having a superimposed display structure according to the present invention.

When the first display and the second display are overlapped, the object may be displayed overlaid on the first and second displays as shown in FIG. The first object displayed on the first display and the second object displayed on the second display represent different information.

Here, the second object displayed on the second display, which is the upper display, may be entirely or partially overlapped on the first object according to its size. When the touch of the user is input to the overlapping display area of the object as described above (S101), the controller 180 determines whether the object is displayed on the upper display (= second display) of the touched portion (S102). Accordingly, if an object (= second object) is displayed on the upper display, it can be determined that the object (second object) is selected (S104). However, when the object (= second object) is not displayed on the upper display of the touched portion and the object (= first object) is displayed on the lower display (YES in S103), it is determined that the first object is selected (S104).

However, when the user's touch is input to a portion where the objects (the first object and the second object) are not superimposed, the above-described method is followed.

For example, assuming that the first object displayed on the first display 155 is a main menu list, and the second object displayed on the second display 156 is a submenu list, The controller 180 can display the sub menu list 215 on the second display when selecting a specific menu item (e.g., a built-in memory item)

Accordingly, the user can select and execute a desired sub menu item in the sub menu list 215 displayed on the second display. Here, if the first object displayed on the first display is in a position that does not overlap with the second object displayed on the second display, the user can directly touch the second display to select the first object.

On the other hand, the object displayed on the first display or the second display can be selected by using other input means (e.g., button, proximity touch, jog wheel, trackball, joystick, etc.) provided in the mobile terminal. At this time, when a specific object is selected using the other input means, one of the first display 155 or the second display 156 may be selected to select only the displayed object.

In this embodiment, if the first object is displayed on the first display and the second object is superimposed on the second display, the object displayed on the second display, which is the parent display, can be selected first, In order to select the first object, a method has been described in which a first object that is not displayed in a superimposed manner is selected, or a first display or a second display is selected using another user interface means to select an object displayed thereon.

Hereinafter, a method of selecting one of the first object or the second object according to the touch pressure while the first object displayed on the first display and the second object displayed on the second display are overlapped will be described.

FIG. 6 is another exemplary view for explaining a method of selecting an object using pressure in a mobile terminal having a superimposed display structure according to the present invention.

When the first object displayed on the first display and the second object displayed on the second display are overlapped as shown in the figure, the user uses the touch pressure to display the object displayed on the first display or one of the objects displayed on the second display Can be selected.

For example, it is assumed that the main menu list, which is the first object, is displayed on the first display 155, and the sub menu list which is the second object is displayed on the second display 156. It is assumed that the user selects a specific menu item (e.g., built-in memory item) 216 from the main menu list displayed on the first display and the submenu list is displayed on the second display.

If the user touches the desired sub-menu item 217 in the sub-menu list displayed on the second display with less than a predetermined touch pressure (YES in S201), the control unit 180 selects and executes the sub-menu item (218). However, when the touch pressure is input above a predetermined value, the main menu item 216 corresponding to the touch position is touched and input in the main menu list superimposed on the submenu list on the first display, The control unit 180 can select and execute the main menu item 216 (219).

In order to select the object displayed on the upper display or the object displayed on the lower display according to the touch pressure input by the user as described above, the mobile terminal may further include a pressure detection sensor (not shown) in the sensing unit 140.

As another embodiment, when the first object displayed on the first display and the second object displayed on the second display are superimposed on each other, the user can use one of the objects displayed on the first display or the objects displayed on the second display You can choose. For example, when the user touches a desired sub-menu item in the sub-menu list displayed on the second display for less than a predetermined time (for example, short-touch), the controller 180 can select and execute the sub-menu item . However, when the desired main menu item is overlapped with the submenu list and the desired main menu item is touched (for example, long touch) longer than a predetermined time, the controller 180 selects and executes the main menu item .

7 is a diagram illustrating an object selection method using a backside touch in a mobile terminal having a superimposed display structure according to the present invention.

As shown, the present embodiment includes a touch pad on a front surface of a mobile terminal (e.g., an upper surface of a second display that is an upper display), and includes a back surface or back surface of the mobile terminal (E.g., a side surface or a bottom surface of a body) of the touch screen, the first object displayed on the first display or the second object displayed on the second display can be selected along the touch input surface .

For example, when it is assumed that the mobile terminal reproduces MP3 music or moving images, a plurality of control buttons 311 and 312 may be displayed on the screen. The more control buttons to be displayed as described above, the narrower the area 313 for displaying specific information (e.g., motion pictures). Therefore, in the mobile terminal having the superimposed display structure according to the present invention, the control buttons 311 and 312 are displayed on the first display 155 and the second display 156 in a superimposed manner, ) Can be relatively widened.

When a specific control button (e.g., a first object) and a specific control button (e.g., a second object) are superimposed on the same position on the first display and the second display is displayed on the first display, Or the rear surface) to select the first object 312, and the second object 311 can be selected by touching the front surface. In addition, when the user touches the back surface, the controller 180 outputs a pointer (not shown) for indicating a point corresponding to the touch on the first display, and then moves the pointer according to the touch or drag of the user . In addition, when the user touches the back surface, the controller 180 controls the transparency of the second display to be more transparent so as to highlight the control buttons (= first objects) displayed on the first display to display it more clearly .

Accordingly, the user can select an activated object among the first objects using the pointer. If the user touches the front side, the second object displayed on the second display can be directly selected even if the pointer is not displayed.

8 is a diagram for explaining a method of selecting an object using a touch and a keypad in a mobile terminal having a superimposed display structure according to the present invention.

When the first object displayed on the first display and the second object displayed on the second display are overlapped as shown in the figure, the user can display the object displayed on any one of the displays (e.g., the first display) ) Can be selected using a hardware input means other than a touch (e.g., a keypad).

For example, assuming that the mobile terminal plays MP3 music or moving pictures, a plurality of control buttons 311 and 312 are displayed on the screen. At this time, in order to solve the problem that the area 313 for displaying information is narrowed to display the control button, the control buttons may be displayed in a superimposed manner on the first display 155 and the second display 156 . As described above, the control buttons are overlaid to display an area 313 for displaying information relatively wider.

Accordingly, when the user touches and inputs a desired control button among the control buttons (= second objects) 311 displayed on the second display 156, the control unit 180 can select and execute the control button. In addition, the present invention can input the keypad 314 to select a desired button among the control buttons (= first objects) 312 displayed on the first display superimposed on the control button displayed on the second display. That is, the first object displayed on the first display 155 can be selected using the keypad 314 input, and the second object displayed on the second display 156 can be selected using the touch input.

When a touch pad (not shown) is attached to the keypad, the first object displayed on the first display can be selected by touching the button of the keypad without pressing the button of the keypad have. And the second object displayed on the second display can be selected by touch inputting the second display.

In the above embodiment, a method of selecting an object displayed on the first display using a keypad and selecting an object displayed on the second display using a touch has been described. However, depending on the option setting, an object displayed on the second display may be selected using a keypad The object displayed on the first display can be selected using the touch.

9A and 9B are diagrams for explaining a method of selecting an object using a touch and a specific input means in a mobile terminal having a superimposed display structure according to the present invention.

When the first object displayed on the first display and the second object displayed on the second display are overlapped as shown in the figure, the user can display the object displayed on any one of the displays (e.g., the first display) ) Can be selected using a specific input means (e.g., a jog wheel, a trackball, a joystick, etc.) rather than a touch input.

For example, as shown in FIG. 9A, it is assumed that a main menu list, which is a first object, is displayed on the first display 155, and a sub menu list which is a second object is displayed on the second display 156. It is assumed that the user selects a specific menu item (e.g., multimedia) from the main menu list displayed on the first display and the submenu list is displayed on the second display. Accordingly, the user can select a desired sub-menu item from the sub-menu list displayed on the second display by a predetermined method (315).

However, when the desired main menu item is selected from the main menu list displayed on the first display by overlapping with the submenu list, the user can input specific input means (e.g., jog wheel, track ball, joystick, etc.) Can be used. One of the first objects (e.g., main menu icons) displayed on the first display may be selected 318 by operating the specific input means 316, 317.

9B, when the buttons 411 and 412 for controlling a specific application (e.g., movie reproduction, photo album, music reproduction, etc.) are displayed in a superposed manner on the first display and the second display, The user can touch and input a desired button among the control buttons 411 displayed on the second display. Then, a desired button among the control buttons 412 displayed on the first display superimposed on the control button displayed on the second display can be selected using a specific input means (e.g., a jog wheel, a trackball, a joystick, etc.).

In the above embodiment, a method has been described in which an object displayed on the first display is selected using a specific input means and an object displayed on the second display is selected using a touch. However, depending on the option setting, the object displayed on the second display can be selected using the specific input means, and the object displayed on the first display can be selected using the touch.

10A and 10B are diagrams for explaining a method of selecting an object using a touch and tilt sensor in a mobile terminal having a superimposed display structure according to the present invention.

In the present embodiment, a tilt sensor (not shown) may be additionally provided in the sensing unit 140 to detect tilt and movement of the mobile terminal.

Hereinafter, in the present embodiment, the inclination is set to a direction in which one direction (for example, downward direction) around the axis as a reference when the mobile terminal is tilted in an arbitrary direction is desired to be controlled by the user. For example, when the left side of the mobile terminal faces downward with respect to an arbitrary axis, the same operation as inputting the left direction key is performed, and when the right side of the mobile terminal faces downward, the same operation as inputting the right direction key is performed . The inclined angle may be set to correspond to the input speed of the direction key. For example, if the tilted angle is large, the same operation is performed as if the direction key was entered at a high speed. If the tilted angle is small, the operation is performed as if the direction key is input at a slow speed.

The motion also performs the same operation as inputting the direction key corresponding to the moving direction of the mobile terminal in a specific direction, at a specific intensity or speed, and at a specific distance. For example, when the mobile terminal is moved to the left side, the same operation as that of the left direction key is performed, and when the mobile terminal is moved to the right side, the same operation as that of the right direction key is performed.

When the first object displayed on the first display and the second object displayed on the second display are overlapped as shown in the figure, the user can select an object displayed on one of the displays using the touch and display the selected object on the other display The object can be selected using the inclination or motion of the mobile terminal.

For example, it is assumed that a main menu list, which is a first object, is displayed on the first display 155 and a sub menu list which is a second object is displayed on the second display 156, as shown in FIG. 10A. It is assumed that the user selects a specific menu item (e.g., multimedia) from the main menu list displayed on the first display and the submenu list is displayed on the second display.

Accordingly, the user can select a desired sub-menu item from the sub-menu list displayed on the second display by a touch input method. In order to select a desired main menu item from the main menu list displayed on the first display by overlapping with the submenu list, the user can move or tilt the mobile terminal in a specific direction. (E.g., main menu icons) displayed on the first display by moving or tilting the mobile terminal in a specific direction.

In addition, when the buttons for controlling a specific application (for example, movie reproduction, photo album, music reproduction, and the like) are displayed in a superimposed manner on the first display and the second display as shown in FIG. 10B, A desired control button among the control buttons 414 shown in FIG. Then, the mobile terminal can be tilted or moved in a specific direction to select a desired button among the control buttons 415 displayed on the first display.

In the above embodiment, a method has been described in which an object displayed on the first display is selected using a tilt or a motion, and an object displayed on the second display is selected using a touch. However, depending on the option setting, an object displayed on the second display may be selected using the tilt or motion, and an object displayed on the first display may be selected using the touch.

FIG. 11 is an exemplary view for explaining a method of setting a touch gesture for object selection in a mobile terminal having a superimposed display structure according to the present invention.

In the present embodiment, the touch gesture means that the user inputs a touch in a specific shape desired by the user. For example, a shape that can be drawn consecutively at once without releasing the touch (i.e., seamlessly) such as an arrow shape (<>), a circle shape (O), a curved shape (~), or a diagonal shape (/ Even if the touch is released, the touch gesture can be inputted and drawn immediately within a certain time.

In general, dragging is an operation of moving a specific object to a desired position by selecting a touch object and distinguishing it from the touch gesture. That is, the touch gesture operates as a kind of shortcut key that can execute a predetermined specific function.

As shown in the figure, the touch gesture can be set separately according to each function. That is, the user first selects the function 511 to set the touch gesture, inputs the touch gesture 512 corresponding to the function and the input position 513, and stores the input. The control unit 180 may determine the shape and the input direction of the input touch gesture and store the input gesture. Here, the configuration of the user interface for setting the touch gesture may vary depending on the mobile terminal.

The shape of the touch gesture is also important. However, the shape of the touch gesture is not limited to the position (for example, the divided left side, right side, upper side, or lower side divided by the area of the screen), the size of the touch gesture, (E.g., starting from left to right, starting from right to left, starting from top to bottom, or starting from bottom to top). That is, even if a touch gesture of the same shape is inputted, it is possible to set different actions according to the input position, the size of the gesture, or the input direction of the gesture.

FIG. 12 is an exemplary view for explaining a method of selecting an object using a touch gesture in a mobile terminal having a superimposed display structure according to the present invention.

It is assumed that the corresponding touch gesture is set for each function as described above. The user may enter a first touch gesture to select a first object displayed on the first display. And a second touch gesture to select a second object displayed on the second display. Accordingly, the control unit 180 may select only the corresponding object among the objects displayed on the first or second display by dividing the inputted touch gesture.

For example, the phone book list is displayed on the first display 155, and the second display 156 displays information of the other party currently on the call. Accordingly, the user can select the objects displayed on the second display by any one of the above-described object selection methods (e.g., touch, input means, selection methods using the tilt).

When a predetermined specific touch gesture 515 is input, the objects displayed on the first display can be displayed, and the user can select one of the displayed objects. That is, by selectively displaying the objects of the first or second display according to the touch gesture, a desired one of the objects can be selected as one of the object selection methods described above. In other words, the touch gesture can be used to select any one of the objects currently displayed on the first or second display.

As another embodiment, by inputting a preset specific touch gesture, it can be used as a shortcut key for directly executing another preset function other than the object displayed on the first or second display.

13A and 13B are diagrams for explaining a method for selecting an object using a fingerprint of a finger in a mobile terminal having a superimposed display structure according to the present invention.

In this embodiment, a photo sensor (not shown) for fingerprint scanning is built in the display unit, and a display unit directly scans the fingerprint and performs predetermined functions according to the scanned fingerprint.

In general, a conventional mobile terminal is provided with a separate fingerprint recognition sensor. However, in the present embodiment, a fingerprint can be scanned immediately on the display unit, and then a fingerprint of a user who touched the display unit is detected, So that the corresponding function can be executed. Here, the configuration for the fingerprint scanning may be a form in which a photosensor (not shown) is inserted into the LCD, a touch sensor is placed on the upper side of the LCD, or a transparent scan film (not shown) .

As shown in the figure, the fingerprint can be set according to each function. However, since the number of fingers is 10 including both hands, the number of functions that can be matched to each finger fingerprint can be limited to 10. Meanwhile, when there are additional users who use the mobile terminal together, different functions can be set for each fingerprint of each user.

As shown in FIG. 13A, the user sets a user to register a fingerprint (521). The user may further add or edit the user who is being input. After the user is selected as described above, a finger to input a fingerprint can be selected (522). After the finger is selected as described above, the fingerprint is registered. Then, the function to be executed when each fingerprint is scanned is input and stored.

It is assumed that the corresponding fingerprint is set for each function as described above. The user can touch the first finger (e.g., index finger) to the second display, which is the upper display, to select the first object displayed on the first display. And immediately select one of the second objects displayed on the second display. On the other hand, the controller 180 divides the fingerprint of the finger touched on the upper display and displays the corresponding one of the objects displayed on the first or the second display, You can select and execute an object.

Further, in the above-described embodiment, the same operation as that of inputting the shortcut key is performed by setting the corresponding function for each fingerprint of each finger. However, it is also possible to set and use a finger to select an object displayed on the first display or a finger to select an object displayed on the second display.

For example, an object of the first display may be selected using a first fingerprint (e.g., a fingerprint) as shown in FIG. 13B, and an object of the second display may be selected using a second fingerprint Is set to be selectable. In addition, when the control buttons for controlling a specific application (e.g., moving picture playback, photo album, music playback, etc.) are displayed on the first display 155 and the second display 156 in a superimposed manner, A desired control button among the control buttons displayed on the second display can be selected by touching (532) and the control button displayed on the first display using the index finger can be selected (533).

FIG. 14 is an exemplary view for explaining a method of selecting an object according to a touch region in a mobile terminal having a superimposed display structure according to the present invention.

In the case where the first object displayed on the first display and the second object displayed on the second display are overlapped as shown in the figure, when the user touches the one area 541 by dividing the touch area into at least two areas, The user can select the object displayed on the first display 155 and select the object displayed on the second display 156 when touching the other side area 542. [

For example, assuming that the mobile terminal plays MP3 music or moving pictures, a plurality of control buttons are displayed on the screen. The more control buttons to be displayed as described above, the narrower the area for displaying specific information (e.g., motion pictures). Accordingly, in the mobile terminal having the superimposed display structure according to the present invention, the control buttons may be divided and displayed in each area after the display area is divided (e.g., the first area and the second area).

Or the first display and the second display, the display area is divided (e.g., the first area, the second area) to control the buttons for controlling the functions displayed on the first or second display It can be divided into areas.

If the user touches one of the divided display areas, the controller 180 may display the touched display area. The control buttons (= objects) set in the display area can be displayed. When the touched display area is displayed as described above, the position of the area for displaying the specific information (e.g., moving picture) can be moved. For example, when the user touches the upper display area 542, control buttons for controlling the functions displayed on the second display 156 are displayed on the upper display area, and an area 543 for displaying specific information is displayed on the lower side Direction. When the user touches the lower display area 541, control buttons for controlling the functions displayed on the first display 155 are displayed in the lower display area and an area 543 for displaying specific information is displayed in the upper direction It is wider.

In the foregoing, preferred embodiments of the present invention have been described with reference to the accompanying drawings.

Here, the terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings, but should be construed as meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It should be understood that various equivalents and modifications may be present.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 2A is a front perspective view of a mobile terminal according to an embodiment of the present invention; FIG.

FIG. 2B is a rear perspective view of a portable terminal according to an embodiment of the present invention; FIG.

3 is a cross-sectional view of a display having a double bond structure according to the present invention.

4 is a diagram illustrating an object selecting method according to a display position of an object of a mobile terminal having a superimposed display structure according to the present invention.

5A and 5B are diagrams for explaining an object selecting method in the case where objects are displayed in a superimposed manner in a mobile terminal having a superimposed display structure according to the present invention.

6 is a diagram illustrating another method for selecting an object using pressure in a mobile terminal having a superimposed display structure according to the present invention.

FIG. 7 is an exemplary view for explaining a method for selecting an object using a backside touch in a mobile terminal having a superimposed display structure according to the present invention; FIG.

FIG. 8 is an exemplary view for explaining a method of selecting an object using a touch and a keypad in a mobile terminal having a superimposed display structure according to the present invention; FIG.

FIGS. 9A and 9B are views illustrating a method for selecting an object using a touch and a specific input means in a mobile terminal having a superimposed display structure according to the present invention; FIG.

10A and 10B are views illustrating an object selection method using a touch and tilt sensor in a mobile terminal having a superimposed display structure according to the present invention.

FIG. 11 is an exemplary diagram for explaining a method of setting a touch gesture for object selection in a mobile terminal having a superimposed display structure according to the present invention. FIG.

FIG. 12 is an exemplary view for explaining a method of selecting an object using a touch gesture in a mobile terminal having a superimposed display structure according to the present invention; FIG.

13A and 13B are views illustrating a method for selecting an object using a fingerprint of a finger in a mobile terminal having a display structure superimposed according to the present invention.

FIG. 14 is an exemplary view for explaining a method of selecting an object according to a touch region in a mobile terminal having a superimposed display structure according to the present invention; FIG.

Claims (18)

Touchpad; A first display portion including a transparent display; A second display portion including an opaque display disposed to overlap with the transparent display; And a control unit for controlling at least one of the first and second display units, Wherein, Wherein the control unit controls the first and second display units so that information displayed on the second display unit is displayed through at least a part of the transparent display included in the first display unit, Wherein at least one of the first and second display units is controlled such that only one of the first and second display units is operated, Wherein information displayed on the second display unit through the first display unit is limited to display information on at least a part of the first display unit. The display device according to claim 1, wherein all information displayed on the second display unit is displayed through at least a part of the first display unit comprising the transparent display, or information displayed on the first display unit and the second display unit is Are displayed together. The method according to claim 1, wherein when the object is superimposed on the first and second displays, the control unit selects an object displayed on any one of the predetermined displays according to a touch time when the touch is input . The mobile terminal of claim 1, wherein the touchpad is disposed between the transparent display and the opaque display. The method according to claim 1, Wherein when the object is superimposed on the first and second displays, the object displayed on any one of the predetermined displays is selected according to the touch pressure when the touch is input. The method according to claim 1, wherein when the objects are superimposed on the first and second displays, the objects displayed on the one display are selected by inputting the touch, and the objects displayed on the other display are displayed in the tilting direction And is selected according to the direction of movement. 2. The method according to claim 1, wherein when the object is superimposed on the first and second displays, an object displayed on any one of the predetermined displays according to a touch gesture when a touch is input is selected terminal. 8. The method of claim 7, wherein the touch gesture comprises: Wherein the touch input is inputted in a form that can be drawn consecutively one time without releasing the input touch. The method according to claim 1, wherein when an object is superimposed on the first and second displays, an object displayed on a one-side display is selected by inputting a touch, and an object displayed on the other one- Selected, Wherein the other input means comprises: A keypad, a jog wheel, a trackball, or a joystick. The method according to claim 1, wherein when the object is superimposed on the first and second displays, the object displayed on the first display can be selected when the touch region is divided into at least two regions and the one region is touched, And the object displayed on the second display can be selected when the one-side area is touched. delete delete delete delete delete delete delete delete

Images