JP2012137800A - Portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal capable of suitably performing complementary processing for user's operation instructions to improve its operability.SOLUTION: A portable terminal comprises: a display unit for displaying a predetermined image; a detection unit for receiving an instruction to the image via an operation screen to detect the instruction as input position information (step S1); a time acquisition unit for acquiring time elapsed from when the detection unit completes detection of input position information until when the detection unit succeedingly starts detection of input position information (step S2); a complementary processing unit for, when the time acquired by the time acquisition unit is less than predetermined time (step S3 is YES), based on input position information at a detection completion and input position information at a detection start, calculating complementary position information that complements input position information missing from the detection completion until the detection start (step S4); and a control unit for performing display control of the image based on the pieces of input position information detected by the detection unit and the complementary position information (step S5).

Description

  The present invention relates to a portable terminal provided with a pointing device such as a touch pad or a touch panel.

  Various input devices for receiving an operation instruction from a user are mounted on a mobile terminal such as a mobile phone. Among these input devices, one that can input an operation instruction by an intuitive operation such as a touch pad or a touch panel is known (for example, see Patent Document 1). The touchpad and the touch panel are configured to accept an operation instruction based on input position information obtained by sensing a change in capacitance or contact pressure accompanying contact with the operation surface.

JP 2008-258805 A

  One of the input devices is an operation key that receives an operation instruction when pressed. When the user inputs an operation instruction with the operation key, the user can determine whether or not the input has been appropriately performed based on a click feeling obtained when the operation key is pressed.

  In the case of a touch panel or a touch pad, the user performs an operation instruction input operation by applying contact pressure to the operation surface by moving or touching a finger or the like on the operation surface. At this time, when the contact pressure on the operation surface is insufficient, the touch panel or the like cannot sense the contact.

  Furthermore, unlike the above-described operation keys, a touch panel or the like is difficult to obtain a pressing feeling, and thus it is difficult for the user himself to determine whether or not an operation instruction can be input.

  For this reason, the case where the process performed with a portable terminal with respect to a user's input operation differs from the process which the user anticipated will generate | occur | produce. In addition, the occurrence of a discrepancy between the input operation and the processing to be performed in this manner causes a user to feel poor operability.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a portable terminal capable of suitably performing a complementing process on a user's operation instruction and improving operability.

  In order to solve the above-described problem, a mobile terminal according to the present invention includes a display unit that displays a predetermined image, and a detection unit that receives an instruction for the image via an operation surface and detects the instruction as input position information. And a time acquisition unit that acquires a time from when the detection unit ends detection of the input position information to when detection of the input position information starts next, and when the time is less than a predetermined time Complementary position information that complements input position information from the end of the detection to the start of the detection based on the input position information at the end of the detection and the input position information at the start of the detection. A complement processing unit to be obtained, and a control unit that performs display control of the image based on the input position information and the complementary position information detected by the detection unit.

  The portable terminal which concerns on this invention can perform a complementation process suitably with respect to a user's operation instruction, and can aim at the improvement of operativity.

1 is an external perspective view showing an embodiment of a mobile terminal according to the present invention. The schematic functional block diagram which shows the main functional structures of the portable terminal in this embodiment. The figure which illustrates notionally the case where the movement instruction | indication with respect to the image displayed on the touch panel is input. The figure which illustrates notionally the operation | movement which inputs to an operation pad, and the example of a cursor display based on the input. The figure which illustrates notionally the display example of the other operation | movement which inputs into an operation pad, and the input based on the input. The flowchart explaining the complementary process of the input position information performed by the main control part of the portable terminal in this embodiment. FIG. 7 is a diagram conceptually illustrating a display example of an image (cursor) when the complementing process of FIG. 6 is performed for an input operation.

  An embodiment of a portable terminal according to the present invention will be described with reference to the accompanying drawings. As a portable terminal to which the present invention is applied, a portable terminal that is formed in a card shape and that allows a user to input an operation instruction by touching the display with a finger will be described as an example.

  FIG. 1 is an external perspective view showing an embodiment of a mobile terminal according to the present invention.

  The mobile terminal 1 includes a rectangular plate-shaped housing 11. A touch panel 14 occupies most of one surface of the casing 11.

  The touch panel 14 has both functions of a display unit and a detection unit.

  The touch panel 14 as a display unit is a display (display 35 in FIG. 2) provided with an area for displaying a display screen made up of characters, images, and the like. This display is composed of, for example, an LCD (Liquid Crystal Display).

  The touch panel 14 as a detection unit is a touch sensor (touch sensor 33 in FIG. 2) that detects a contact operation on the operation surface as input position information. The touch sensor includes a plurality of elements for detecting a contact operation arranged on the upper surface of the display, and a transparent operation surface laminated thereon. As a method for detecting the contact operation on the touch panel 14, a pressure-sensitive method for detecting a change in pressure, an electrostatic method for detecting an electric signal due to static electricity, or other methods can be applied.

  In addition, a receiver 15 for outputting sound and a microphone 16 for inputting sound are disposed at opposing positions in the longitudinal direction of the housing 11.

  FIG. 2 is a schematic functional block diagram showing a main functional configuration of the mobile terminal 1 in the present embodiment. The mobile terminal 1 is configured by connecting a main control unit 30, a power supply circuit unit 31, an input control unit 32, a display control unit 34, a voice control unit 36, a communication control unit 37, and a storage unit 39 so that they can communicate with each other via a bus. Has been.

  The main control unit 30 includes a CPU (Central Processing Unit). The main control unit 30 operates based on various programs stored in the storage unit 39 and performs overall control of the mobile terminal 1.

  The power supply circuit unit 31 includes a power supply source (not shown). The power supply circuit unit 31 switches the power supply ON / OFF state of the mobile terminal 1 based on an operation of turning on the power supply. The power supply circuit unit 31 supplies power from the power supply source to each unit when the power supply is in an ON state, thereby enabling the mobile terminal 1 to operate.

  The input control unit 32 includes an input interface for the touch sensor 33. The input control unit 32 receives the detection signal from the touch sensor 33 as input position information indicating the coordinates of the input position every predetermined time (for example, every 10 ms), generates a signal indicating the input, and transmits the signal to the main control unit 30. To do.

  The display control unit 34 includes a display interface for the display 35. The display control unit 34 causes the display 35 to display an image based on the document data and the image signal based on the control of the main control unit 30.

  The sound control unit 36 generates an analog sound signal from the sound collected by the microphone 16 based on the control of the main control unit 30 and converts the analog sound signal into a digital sound signal. Further, when acquiring the digital audio signal, the audio control unit 36 converts the digital audio signal into an analog audio signal based on the control of the main control unit 30 and outputs the analog audio signal as audio from the receiver 15.

  Based on the control of the main control unit 30, the communication control unit 37 restores data by performing a spectrum despreading process on the received signal received from the base station via the antenna 38. This data is transmitted to the voice control unit 36 and output from the receiver 15 according to an instruction from the main control unit 30, transmitted to the display control unit 34 and displayed on the display 35, or recorded in the storage unit 39. To do. When the communication control unit 37 acquires the voice data collected by the microphone 16, the data input via the touch panel 14, or the data stored in the storage unit 39 based on the control of the main control unit 30, Is spread over the data and transmitted to the base station via the antenna 38.

  The storage unit 39 is a ROM (Read Only Memory) that stores a processing program for processing performed by the main control unit 30 and data necessary for the processing, a hard disk, a non-volatile memory, a database, and is used when the main control unit 30 performs processing. RAM (Random Access Memory) that temporarily stores data to be stored.

  The mobile terminal 1 in the present embodiment includes the touch panel 14 as described above. The touch panel 14 receives an instruction for an image or the like displayed on the display 35 of the touch panel 14 via the operation surface. The user inputs to the touch panel 14 via the user's finger or stylus pen. In the present embodiment, an example in which input is mainly performed on the touch panel 14 with a finger will be described. However, the present invention can also be applied to a case other than a finger.

  FIG. 3 is a diagram conceptually illustrating a case where a movement instruction for an image displayed on the touch panel 14 is input. The example illustrated in FIG. 3 is described by applying a cursor 41 used to point an operation target on the touch panel 14 as an example of an image displayed on the touch panel 14.

  On the touch panel 14, a cursor 41 used for pointing an operation target is displayed. In addition, an area assigned as an operation pad 40 that exclusively receives an operation instruction for the cursor 41 is displayed at a predetermined position on the touch panel 14. The operation pad 40 detects input position information at predetermined time intervals (for example, 10 ms) based on the input operation of the user who moves the finger F in contact with the operation pad 40. The main control unit 30 performs display processing for moving the cursor 41 based on the detected input position information.

  For example, when the finger F is moved on the operation pad 40 in the direction of the illustrated arrow A, the cursor 41 is moved in the direction of the illustrated arrow B based on the direction and movement amount corresponding to the input operation. .

  FIG. 4 is a diagram for conceptually explaining an operation for inputting to the operation pad 40 and a display example of the cursor 41 based on the input. FIG. 5 is a diagram for conceptually explaining another operation for inputting to the operation pad 40 and a display example of the cursor 41 based on the input. FIG. 4A and FIG. 5A show the locus of input operations performed on the operation panel 40 displayed on the touch panel 14. 4B and 5B show display examples of the cursor 41 displayed on the touch panel 14 based on the input operation. 4 and 5, the operation of the finger F performed on the operation pad 40 (FIGS. 4A and 5B) and the display processing of the cursor 41 corresponding to this operation (FIG. 4). (B) and FIG. 5 (B)) are individually shown, but actually, the operation of the finger F and the display process of the cursor 41 are simultaneously performed on the touch panel 14 as shown in FIG. .

  When the user performs an input operation of an operation instruction for moving the cursor 41 (FIG. 4B) displayed on the touch panel 14, the user presses the finger F against the operation pad 40, and the finger F by a desired operation amount is obtained therefrom. The operation to move is performed. FIG. 4A shows a case where the finger F is operated so as to draw a waveform.

  Here, when the user can apply a sufficient contact pressure from the finger F to the operation pad 40 and the operation pad 40 can continuously detect the contact of the finger F, the mobile terminal 1 is configured as shown in FIG. As shown in (B), a display is performed in which the cursor 41 is moved while drawing a locus having substantially the same shape as the waveform drawn by the finger F. Note that the trajectory drawn in FIG. 4B is a trajectory having the cursor 41a position as the start point and the cursor 41b position as the end point, and shows a state in which the cursor 41 continuously moves on the display.

  On the other hand, even if the user intends to move the finger F on the operation pad 40 while drawing the same waveform as in FIG. 4A, sufficient contact pressure is applied from the finger F to the operation pad 40. If not, it can happen. For example, this may occur when the contact pressure of the user's finger F is smaller than a detectable pressure. In such a case, as shown in FIG. 5A, the operation pad 40 cannot continuously detect the contact of the finger F, and detects an intermittent trajectory.

  Then, based on the detected locus, the mobile terminal 1 performs a display of moving the cursor 41 while drawing a locus having the cursor 41a position shown in FIG. 5B as the start point and the cursor 41b position as the end point. That is, the mobile terminal 1 performs display processing for moving the cursor 41 based on a locus detected from the operation pad 40 and not intended by the user.

  For this reason, the portable terminal 1 will make the user feel bad operability that the intended operation is not performed on the operation pad 40 operated by the finger F.

  On the other hand, the portable terminal 1 according to the present embodiment performs input position information complementation processing even when the contact pressure is insufficient and the touch panel 14 (touch sensor 33) cannot detect an input operation associated with the contact. Thus, the display process accompanying the operation intended by the user can be performed.

  FIG. 6 is a flowchart for explaining the input position information complementing process executed by the main control unit 30 of the mobile terminal 1 in the present embodiment.

  In step S1, the main control unit 30 determines whether a touch event has occurred after a release event has occurred. The release event is an event that occurs when the input position information detected by the touch panel 14 as the detection unit every predetermined time cannot be acquired (when the detection is finished). The touch event is an event that occurs when the touch panel 14 detects input position information next (when detection is started) after the occurrence of a release event.

The case where the touch panel 14 cannot acquire the input position information means that when the touch sensor 33 is pressure sensitive, the detected contact pressure is less than a predetermined pressure (for example, 100 g / cm ² ≈9806 Pa). If it is an equation, it means a case where the detected capacitance is equal to or less than a predetermined capacitance.

  When it is determined that a release event and a touch event have not occurred (NO in step S1), the main control unit 30 waits for processing until it occurs.

  On the other hand, when it is determined that a release event and a touch event have occurred (YES in step S1), in step S2, the main control unit 30 as a time acquisition unit acquires a time from the release event occurrence to the touch event occurrence. The mobile terminal 1 is provided with a dedicated timer for measuring the time between events, and the main control unit 30 acquires the time between events from this timer.

  In step S3, the main control unit 30 determines whether or not the time between events acquired in the time acquisition step S2 is less than a predetermined time (for example, 60 ms). The predetermined time is determined by a value that allows the release event to be regarded as an event that has occurred due to an operation not intended by the user.

  Note that the time used for the determination in step S3 may be provided with a range. For example, when the time between events is in the range of 20 ms to 60 ms, it may be determined that the release event is not intended by the user. When the time between events is 60 ms or more, the time between events is long, and it can be considered that the user has intentionally generated a release event. Further, when the time between events is 20 ms or less, the operation is negligibly discontinued and cannot be recognized by the user. If the time between events is less than 60 ms, all of them may be subjected to complement processing.

  When determining that the time between events is not less than the predetermined time (NO in step S3), the main control unit 30 ends the process because it is not necessary to perform the complementing process.

  On the other hand, when it is determined that the time between events is less than the predetermined time (YES in step S3), the main control unit 30 serving as a complement processing unit in step S4 ignores the release event and performs complementation for obtaining supplementary position information. Process.

  The main control unit 30 complements the input position information at the time of occurrence of the touch event from the occurrence of the release event based on the input position information at the time of occurrence of the release event and the input position information at the time of occurrence of the touch event as complementary position information. . In other words, the release operation unintended by the user is ignored, and an input operation in which contact with the operation surface of the touch panel 14 continues is obtained, and the complementary position information is obtained so that the cursor is displayed on the touch panel 14 based on the input operation. Process.

  Specifically, since it is considered that the input operation on the operation surface has been continuously detected, the complementary position information is obtained that linearly connects the input position information when the release event occurs and the input position information when the touch event occurs. .

  In step S5, the main control unit 30 as a control unit displays a cursor on the touch panel 14 based on the input position information detected from the touch panel 14 and the complementary position information obtained in the complementary processing step S4.

  FIG. 7 is a diagram for conceptually explaining a display example of an image (cursor 41) when a complementary process is performed on an input operation. FIG. 7A shows a trajectory of the input operation of the finger F performed on the touch panel 14. FIG. 7B shows a display example of the cursor 41 displayed based on the input operation of FIG. A solid line in FIG. 7A indicates a locus where the user performs an input operation on the touch panel 14 using the finger F, and a broken line indicates a portion where detection is not performed although the user intended the input operation. Show the trajectory.

  As shown in FIG. 7A, when the touch panel 14 cannot detect the input position information corresponding to the operation intended by the user and a release event occurs, the mobile terminal 1 performs the complementing process of FIG. . Specifically, the portion that is not detected, which is the dotted line portion shown in FIG. 7A, is continuously connected based on the input position information when the release event occurs and the input position information when the touch event occurs. Complement processing is performed to obtain complementary position information.

  The mobile terminal 1 displays the cursor 41 on the touch panel 14 based on the input position information and the complementary position information obtained from the touch panel 14. As shown in FIG. 7B, the mobile terminal 1 can continuously display the movement of the cursor 41 close to the input operation intended by the user. For this reason, the portable terminal 1 can perform display processing in consideration of the user's intention even when the contact pressure of the user on the touch panel 14 is not sufficient and the touch panel 14 cannot detect the input operation intended by the user. it can.

  This is the end of the description of the complement processing.

  According to the portable terminal 1, even when a release event occurs because the input operation intended by the user cannot be detected, it is determined appropriately whether or not the release event is intentional. Complementary processing for display processing can be performed. For this reason, the portable terminal 1 can implement | achieve the display process which the user expected, without producing a habit with the operation instruction which the user intended, and an actual display process.

  In the present embodiment, an example in which the complementary process is performed on the input operation accompanying the operation instruction for moving the cursor 41 displayed on the display 35 of the touch panel 14 has been described. However, the present invention is not limited to this, and the present invention may be applied to a complementary process for an input operation accompanying an operation instruction for an image other than the cursor. Specifically, the present invention can be applied to a case where the mobile terminal 1 performs a display process in which an image displayed on the display 35 is continuously changed with a continuous input operation on the touch panel 14. For example, the present invention can be applied to a case where display processing is performed in which the image change amount or the display time is changed depending on the contact time with the operation surface of the touch panel 14.

  Moreover, although the portable terminal 1 in this embodiment applied and demonstrated the structure provided with the touchscreen 14 with which the display 35 and the touch sensor 33 were united, the touch sensor 33 is the touch comprised separately with the display 35. It may be a pointing device such as a pad.

  Furthermore, the portable terminal according to the present invention can also be applied to a cellular phone, a PDA (Personal Digital Assistant), a personal computer, a portable game machine, a portable music player, a portable video player, and other portable terminals.

DESCRIPTION OF SYMBOLS 1 Mobile terminal 11 Case 14 Touch panel 15 Receiver 16 Microphone 30 Main control part 31 Power supply circuit part 32 Input control part 33 Touch sensor 34 Display control part 35 Display 36 Voice control part 37 Communication control part 38 Antenna 39 Storage part 41 Cursor F Finger

Claims (4)

A display unit for displaying a predetermined image;
A detection unit that receives an instruction for the image via an operation surface and detects the instruction as input position information;
A time acquisition unit that acquires a time from when the detection unit ends detection of the input position information to when detection of the input position information starts next;
When the time is less than a predetermined time, the input from the end of the detection to the start of the detection based on the input position information at the end of the detection and the input position information at the start of the detection A complementary processing unit for obtaining complementary position information that complements position information;
A portable terminal comprising: a control unit that performs display control of the image based on the input position information and the complementary position information detected by the detection unit. The predetermined image is a cursor that moves at least a part of the screen displayed on the display unit,
The instruction is an instruction to move the cursor on the screen,
The mobile terminal according to claim 1, wherein the control unit performs display control for moving the cursor based on the complementary position information. The portable terminal according to claim 2, wherein the complementary position information is information that connects the input position information at the end of the detection and the input position information at the start of the detection substantially linearly. The mobile terminal according to claim 1, wherein the display unit and the detection unit are a touch panel formed integrally.

Images