KR20100104875A - Portable terminal for operating based sensed data and method for operating portable terminal based sensed data - Google Patents

Abstract

PURPOSE: A portable terminal operating based sensed data and a method for operating the portable terminal based sensed data are provided to make a recognition operation start timing clear, thereby preventing malfunction of the portable terminal by a sensor. CONSTITUTION: A portable terminal(200) includes a sensing unit(210), a control unit(220), and an output unit(240). The sending unit obtains sensed data. The control unit determines to input a start gesture for recognition start based on inputted sensed data. If the start gesture is inputted, the control unit provides feedback for showing at least one function mode according to the inputted sensed data. The output unit outputs an operation execution result of the control unit.

Description

Portable terminal for operating based on sensed data and method for operation thereof {Portable terminal for operating based sensed data and method for operating portable terminal based sensed data}

According to one or more aspects, the present invention relates to touch gesture recognition, and more particularly, to a mobile terminal and a method for operating a mobile terminal for efficiently providing a functional mode of the mobile terminal using touch recognition information.

Modern portable terminals can typically perform various functions. For example, a mobile phone basically provides a call function, but provides functions such as a short message service (SMS), a digital camera, an MP3 player, video playback, and an electronic notebook. In order to operate a mobile terminal having a plurality of functions in a specific function mode, the user operates a keypad or a touch pad provided in the mobile terminal to search for a function mode to perform a desired function, and to enter the function mode. You will be instructed to switch.

When performing the function of the portable terminal by the touch information, the sensor built in the device responds to any touch. This allows the recognizer to run even when the user inadvertently grabs or touches the device.

The present invention provides a portable terminal and a method of controlling the portable terminal that perform a function according to a gesture of a user inputted by clarifying a starting point of a recognition operation.

In accordance with an aspect, a portable terminal includes a sensor configured to acquire sensing data; A controller for determining whether a start gesture for starting recognition is input based on the input sensing data and providing feedback for indicating at least one function mode based on the input sensing data when the start gesture is input; And an output unit configured to output a result of performing the operation of the controller.

The sensing data may include pressure sensing data and movement data.

The control unit may provide a message requesting confirmation that the function mode provided as the feedback is the function mode intended by the user. Alternatively, the controller may provide an operation selection menu belonging to the function mode provided as feedback.

The controller may determine the type of response to the user's feedback from the gesture based on the sensing data input after providing the feedback. The control unit may determine whether the response to the feedback indicates approval or rejection for the provided feedback. If it is determined that the response to the feedback indicates approval, the controller may execute an application program corresponding to the provided feedback. If the response to the feedback is a rejection, the controller may determine whether the rejection is requested to return to the initial mode or the rejection is required to request re-awareness.

The plurality of function modes may include at least one of a call mode, a text message service mode, a camera mode, an audio playback mode, and a video playback mode.

According to another aspect, there is provided a method of operating a mobile terminal, the method comprising: obtaining sensory data; Determining whether a start gesture for initiating recognition is input based on the input sense data; And providing feedback for indicating at least one function mode among the plurality of function modes based on the sensing data input when the start gesture is input.

According to an embodiment of the present disclosure, it is possible to clarify a starting point of a recognition operation in a portable terminal capable of recognizing a gesture of a user using a sensor, thereby preventing malfunction of the portable terminal by the sensor. In addition, it is possible to provide an opportunity for a response for confirming whether the recognition result recognized according to the gesture of the user fits the intention of the user, thereby enabling efficient switching of the desired function mode.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, if it is determined that detailed descriptions of related well-known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the present invention, which may vary according to intention or custom of a user or an operator. Therefore, the definition should be made based on the contents throughout the specification.

1 is a diagram illustrating a relationship between a holding posture and a portable terminal mode of a portable terminal according to an exemplary embodiment.

The portable terminal can provide various function modes such as a call mode, an SMS mode, a digital camera mode, an audio playback mode, and a video playback mode. As shown, when the user uses the portable terminal, there is a difference in the form and attitude of the user holding the portable terminal according to the function mode of the portable terminal. Therefore, in order to recognize a function mode desired by the user and to switch the mode of the portable terminal to the recognized function mode to perform a function according to the mode, the sensed data value according to the grip position of the user may be used.

In addition, when the user grips the portable terminal, when the portable terminal rotates based on a predetermined reference axis set in the portable terminal or when the reference axis is inclined at a specific angle with the direction of gravity, the rotation angle or directionality of the portable terminal. Motion information, including information about, may also be used to determine the function mode.

However, even when the function of the portable terminal can be performed by the sensed data as described above, the portable terminal may malfunction in response to an unintended touch of the user. Hereinafter, a description will be given of a portable terminal for precisely performing a function intended by a user by recognizing a start time of recognition requiring gesture recognition according to an exemplary embodiment.

2 is a block diagram illustrating a configuration of a portable terminal according to an exemplary embodiment.

The portable terminal 200 according to an exemplary embodiment includes a detector 210, a controller 220, a storage 230, and an output 240.

The detector 210 may include a touch detector 212 and a motion detector 214 to detect sensing data including pressure sensing data and movement data.

As the user grips the portable terminal 200, the touch detector 212 detects a contact area in contact with the user on the outer surface of the portable terminal 200. To this end, the touch sensing unit 212 may include at least one touch sensing sensor capable of sensing whether a touch exists, and each touch sensing sensor may be located on the surface of the mobile terminal 200. A signal regarding whether or not the user is in contact with the user is provided to the controller 220.

When the capacitive touch sensor is used, the holding pressure of the user is represented by a change in capacitance. In order to determine the holding pressure of the user, the following Equation 1 may be used using a point where the standard deviation value is lower than when the mobile terminal 200 is strongly gripped when the mobile terminal 200 is strongly gripped. have.

Here, g (t) is changed to a pressure (PRESSURE), a contact (CONTACT) and a no touch (NO TOUCH), depending on whether the user applied the appropriate pressure to the portable terminal 200. f _g () denotes a filtering function for removing sensor noise, σ () denotes a standard deviation, and x (t) denotes the output value of each touch sensor [x ₁ (t), x ₂ (t), .. .x ₃ (t)]. p _th is the pressure sensing threshold and c _th is the simple gripping (contact) sensing threshold. N _touch represents the number of electrodes for which a _touch has been sensed, and N _th represents a threshold of the number of electrodes for which a touch is determined to be sensed.

The motion detector 214 detects the movement of the mobile terminal 200 as the user grips the mobile terminal 200. Specifically, when the mobile terminal 200 rotates about a predetermined reference axis or forms a specific angle with the gravity direction as the user grips the mobile terminal 200, the motion detector 214 may perform the mobile terminal. Detect the direction of rotation of the 200 and the direction of gravity.

To this end, the motion detector 214 includes an inertial sensor (not shown) installed in three reference axes (x-axis, y-axis, and z-axis) that are perpendicular to each other, so that the user grips the mobile terminal 200. Accordingly, when the mobile terminal 200 moves, the rotation angle of the mobile terminal 200 with respect to each reference axis may be measured. In addition, when the motion detector 214 includes an acceleration sensor, the motion detection unit 214 may detect the direction of the mobile terminal 200 by measuring an angle formed by each reference axis with the direction of gravity.

Equation 2 below may be used to detect an operation of shaking the mobile terminal 200.

는 가속도 센서의 출력값이고, g는 중력 상수(9.8m/s²)이고, m_th는 임계값이다. m(t)가 TRUE인 경우, 휴대 단말(200)이 흔들렸다고 결정될 수 있다. From here,

Is the output of the acceleration sensor, g is the gravity constant (9.8 m / s ² ), and m _th is the threshold. When m (t) is TRUE, it may be determined that the mobile terminal 200 is shaken.

In addition, although the sensing unit 210 is illustrated as including the touch sensing unit 212 and the motion sensing unit 214, the sensing unit 210 may include only the touch sensing unit 212, other types of The apparatus may further include a sensor for sensing data.

The controller 220 may control the overall operation of the mobile terminal 200, and may include a recognizer 222, a feedback provider 224, and a mode executor 226.

The recognition unit 222 recognizes a gesture according to the sensing data according to an embodiment. According to an embodiment, the recognizer 222 determines whether a start gesture for starting recognition is input based on the input sensing data.

When the start gesture is input, when the sensing data input, that is, the function selection gesture is input, the recognition unit 222 selects the function mode using the gesture mode-specific function mode mapping information. Then, according to the selected function mode of the recognizer 222, the feedback provider 224 provides feedback for indicating at least one function mode. The feedback provider 224 may provide a message requesting confirmation that the selected function mode provided as feedback by the function selection gesture is a function mode intended by the user. The feedback provider 224 may provide an operation selection menu belonging to a function mode provided as feedback.

The mode execution unit 226 executes an operation mode according to the recognition of the recognition unit 222. The operation mode may include various operation modes for allowing the mobile terminal 200 to perform a predetermined algorithm in addition to the plurality of function modes for performing the plurality of functions. Here, the function mode may include at least one of a call mode, a text message service mode, a camera mode, an audio playback mode, and a video playback mode. The manual mode is a mode in which the gesture recognition operation by the sensing data is stopped and the user is operated according to a manual input, and the initial mode is a mode set after initialization of the portable terminal.

The recognition unit 222 may determine the type of response to the user's feedback from the gesture based on the sensing data input after providing the feedback. The recognizer 222 may determine whether the response to the feedback indicates the approval or rejection of the provided feedback.

If it is determined that the response to the feedback indicates the approval, the mode execution unit 226 may execute an application program corresponding to the provided feedback. In addition, when the response to the feedback is a rejection, the mode execution unit 226 may determine whether to reject the request for returning to the initial mode or the rejection request for re-recognition.

The storage unit 230 includes an operating system and applications necessary for the operation of the mobile terminal 200. The storage unit 230 may store a sensing data model for determining an operation mode of the mobile terminal 200 according to an exemplary embodiment. The storage unit 230 may include a recognition model for recognizing a recognition operation initiation gesture, a recognition model for recognizing a function selection gesture for selecting a plurality of function modes, a recognition model for recognizing a type of a response to a function selection gesture, and the like. Can be stored.

The output unit 240 outputs a result of performing the operation of the controller 220. The output unit 240 may include various output means to provide various types of information such as visual, auditory, and tactile information to various users such as a display device, an audio device, and a vibration device.

According to an embodiment of the present disclosure, it is possible to clarify a starting point of a recognition operation in a portable terminal capable of recognizing a gesture of a user using a sensor, thereby preventing malfunction of the portable terminal by the sensor. In addition, it is possible to provide an opportunity for a response for confirming whether the recognition result recognized according to the gesture of the user fits the intention of the user, thereby enabling efficient switching of the desired function mode. In addition, using the method of operating the portable terminal, since the portable terminal can realize a function using only the sensed data, the portable terminal can be implemented to simultaneously provide aesthetic stability of the type without a button and improved usability.

3 is a flowchart illustrating a mobile terminal operating method according to an exemplary embodiment.

The mobile terminal 200 acquires the sensed data (S 310). The mobile terminal 200 determines whether a start gesture for starting recognition is input based on the input sensing data (S 320). The portable terminal 200 may determine whether the start gesture is based on a preset recognition model.

If it is determined that the recognition start gesture is input, a feedback for indicating at least one function mode among the plurality of function modes is provided based on the input sensing data (S 330). The mobile terminal 220 may select a function mode corresponding to the recognized start gesture by using a preset recognition mode for each function mode.

Then, the mobile terminal 200 may determine the type of response to the user's feedback based on the sensing data input after providing the feedback (S 340). According to the type of response, that is, when the response is determined to be approved, the function is executed by executing the application program corresponding to the function mode provided with the feedback (S 350). When the response to the feedback is a rejection, an operation according to the gesture recognition mode may be performed from the manual mode, the initial mode, or newly input sensing data.

After the mobile terminal 200 provides feedback, the user's approval and rejection gestures may be variously defined by combining touch and movement. For example, when the grip is held for a specified time T, it may be determined as an approval operation, and when it is determined by other gestures, it may be determined as a rejection operation. In addition, according to the type of rejection operation, when the motion of shaking the mobile terminal 200 is detected or the tilt of the mobile terminal 200 is detected, the portable mode 200 is determined to enter the manual mode, and the pressure is applied to the mobile terminal 200. When a gesture of applying is detected, the gesture may be determined as a mode for recognizing the gesture and enter the recognizing mode, and when the gripping is terminated, the mode may be entered and operated in the initial mode.

4 is a flowchart illustrating a method of operating a portable terminal when the sensed data is pressure sensed data according to an exemplary embodiment.

In FIG. 4, it is assumed that a value of g (t) is PRESSURE using Equation 1 as a recognition start gesture. Also, if the value of g (t) is PRESSURE again after providing feedback on the recognition result of the function selection gesture, it is a response requiring re-recognition as a rejection of the recognition result, and if the value of g (t) is NO TOUCH, the recognition result is The response is to proceed to the initial mode as a rejection. If the g (t) value is CONTACT for a time T, the response is assumed to be an acknowledgment of the recognition result.

If the sensed data is acquired (S410) and the value of g (t) is PRESSURE (S412), the recognition operation is determined by the recognition start gesture (S414). If the value of g (t) is not PRESSURE (S412), the flow returns to step S410.

After starting the recognition operation (S 414), a function selection gesture is input by the user (S 416), and the mobile terminal 200 provides feedback on a recognition result of recognizing the input function selection gesture (S418). When the feedback of the recognition result is set to t = 0 (S420), and if the calculated result g (t) of the input user gesture is PRESSURE (S422), the recognition result of the portable terminal 200 is determined. In response to the request for re-recognition as a rejection, the process returns to step S414. If the g (t) value is not CONTACT and the g (t) value is determined as NO TOUCH (S424), the mobile terminal 200 proceeds to the initial mode as a rejection result. Is returned in step S410.

If the time t does not reach time T with the value of g (t) as CONTACT, time is increased to increase t (S428), and the flow returns to step S422. If t passes more than the time T, the value of g (t) has been maintained for the time T as CONTACT, so it is determined as an acknowledgment response to the recognition result (S426), and the application program corresponding to the feedback provided mode is executed (S). 430).

One aspect of the present invention may be embodied as computer readable code on a computer readable recording medium. The code and code segments implementing the above program can be easily deduced by a computer programmer in the field. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, and the like. The computer-readable recording medium may also be distributed over a networked computer system and stored and executed in computer readable code in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the scope of the present invention should not be limited to the above-described embodiments, but should be construed to include various embodiments within the scope of the claims.

1 is a diagram illustrating a relationship between a holding posture and a portable terminal mode of a portable terminal according to an exemplary embodiment.

2 is a block diagram illustrating a configuration of a portable terminal according to an exemplary embodiment.

3 is a flowchart illustrating a mobile terminal operating method according to an exemplary embodiment.

4 is a flowchart illustrating a method of operating a portable terminal when the sensed data is pressure sensed data according to an exemplary embodiment.

Claims (16)

A sensing unit for obtaining sensing data; A controller for determining whether a start gesture for starting recognition is input based on the input sensing data and providing feedback for indicating at least one function mode based on the input sensing data when the start gesture is input; And A portable terminal including an output unit for outputting a result of performing the operation of the controller. The method of claim 1, The sensing data includes pressure sensing data and movement data. The method of claim 1, And the control unit provides, as the feedback, a message requesting confirmation that the provided function mode is a function mode intended by a user. The method of claim 1, And the control unit provides an operation selection menu belonging to the provided function mode as the feedback. The method of claim 1, The controller determines a type of response to the feedback of the user from the gesture based on the sensing data input after the feedback is provided. The method of claim 5, The controller determines whether the response to the feedback indicates the approval or rejection of the provided feedback. The method of claim 6, And the controller is configured to execute an application program corresponding to the provided feedback when it is determined that the response to the feedback indicates the approval. The method of claim 6, And if the response to the feedback is a rejection, determining whether to reject the request for returning to the initial mode or the rejection request for re-recognition. The method of claim 1, The plurality of function modes include at least one of a call mode, a text message service mode, a camera mode, an audio playback mode, and a video playback mode. Obtaining sensory data; Determining whether a start gesture for initiating recognition is input based on the input sense data; And And providing feedback for indicating at least one function mode among a plurality of function modes based on the sensing data input when the start gesture is input. The method of claim 10, The sensing data may include pressure sensing data and movement data. The method of claim 10, And determining a type of a response to the feedback of the user from a gesture based on the sensed data input after the feedback is provided. The method of claim 12, And in the determining of the type of response, determining whether the response to the feedback represents an approval or rejection of the provided feedback. The method of claim 13, And if it is determined that the response to the feedback indicates the approval, executing the application corresponding to the provided feedback. The method of claim 13, And if the response to the feedback is a denial, determining whether to reject the request to return to the initial mode or to reject the request for re-awareness. The method of claim 10, The plurality of function modes include at least one of a call mode, a text message service mode, a camera mode, an audio playback mode, and a video playback mode.

Images