WO2016192622A1

WO2016192622A1 - Control method for smart terminal/mobile phone

Info

Publication number: WO2016192622A1
Application number: PCT/CN2016/084234
Authority: WO
Inventors: 单正建
Original assignee: 单正建
Priority date: 2015-06-04
Filing date: 2016-06-01
Publication date: 2016-12-08
Also published as: CN106686202A; CN106686202B

Abstract

The present invention relates to a method of monitoring an external trigger, identifying the trigger and executing a command corresponding to the trigger by using a sensor having an ability to sense external objects of a smart terminal or a mobile phone, wherein the subject executing the command can be a mobile operating system or an app based on the operating system, and the command is programmed by a combination of a length of the trigger, a direction of the trigger, a state of the smart terminal or a state of the app. The method is particularly suitable for enabling a user of the smart terminal/mobile phone to operate the smart terminal/mobile phone when the use of eyes, hands and fingers are limited, and effectively complements the existing smart terminal/mobile phone as an addition to a touch screen and voice control. The sensor having the ability to sense external objects comprises a proximity sensor unable to sense a trigger direction and a proximity sensor or a radar sensor having trigger direction feedback.

Description

Control method of intelligent terminal/mobile phone

Technical field

The method is a method for monitoring an external trigger, recognizing a trigger, and executing a trigger corresponding instruction by using a sensor of a smart terminal or a mobile phone capable of sensing an external object, and the main body of the execution instruction may be the mobile operating system itself or based on an operating system. App, the instruction code is a combination of the duration of the trigger, the direction of the trigger, and the state of the smart terminal or the state of the App. The method is particularly suitable for a user of a smart terminal/mobile phone in a scene where the smart terminal/mobile phone is inconvenient to operate with an eye or a finger. It is an effective supplement to the current smart terminal/mobile phone in addition to the touch screen and voice control. Sensors that can sense the capabilities of external objects include a proximity sensor with no triggering direction, a proximity sensor group with triggering direction feedback, or a radar sensor.

Background technique

People usually control the smart terminal through the touch screen. Obviously, this method requires the eyes, hands and fingers to operate the smart terminal/cell phone. However, in some scenarios, such as driving, running, cycling, fishing, etc., the method of touch screen control is obviously inconvenient; of course, the voice input method is an effective improvement, and the condition that the user can press the smart terminal function key The voice input, recognition and judgment commands are started, but this requires no background noise, otherwise the recognition error is high and the user experience is poor. The method utilizes a sensor with a sensing external object such as a proximity sensor or a radar sensor, and triggers the triggering time of the sensor with an external object (such as a hand) as an instruction code, combined with the direction of the trigger, the state of the smart terminal/phone. Or the specific state of the App is a condition, and the instruction input and control mode of the combination are implemented.

At present, a sensor that is equipped with a smart terminal/cell phone to sense an external object, such as a proximity sensor, is used when the ear/face approaches the touch screen of the mobile phone when the traffic is in use, the touch screen will automatically turn off to save power for the mobile phone while avoiding the ear, The face is triggered by the wrong screen. The proximity sensor of the smart terminal/mobile phone can usually return the value in centimeters, but in fact many smartphones only return far or near two values, so in the embodiment of the method, the far or near two values are used (such as A trigger with a definition of less than 1 cm is defined as a trigger threshold value, and various definitions can be satisfied. If it is greater than 1 cm, it is considered to be far), and a command code is formed with a long or near trigger time length. But in fact, as the user's demand increases, this type of sensor will not only return the distance value in the future, but also return the direction value of the trigger, that is, the direction of the triggering object, such as having three or more triangles/diamonds. The proximity sensor group or the radar sensor of the distributed sensor probe can form a command mode of triggering time plus direction value plus state value by using the method, which is more convenient for the user to operate the intelligent terminal; one of the sensors for sensing the external object, the radar sensor, The sensor can sense the shape of the external object, the distance of contact, and the direction of contact. Although it is designed to judge the gesture, there are some restrictions on the gesture input, such as when driving and when the response is fast, if the contact direction and the contact duration are used as instructions, It is more suitable for a variety of scenes than gesture judgment. This method is also for radar transmission. A supplement to the sensor usage method makes the sensor not only limited to gesture judgment.

The method is to monitor a sensor having the capability of sensing an external object; determining whether the trigger is an instruction trigger (in this method, the combination of the duration of the sensor triggered by the external object, the trigger direction, and the state condition of the smart terminal/mobile phone or the App) Code); The function and command to execute the corresponding instruction. Therefore, the user who is convenient for the user to operate and use the smart terminal can satisfy the operation of the smart terminal/mobile phone in various scenarios.

Summary of the invention

In order to overcome the mandatory dependence of the user's eyes, hands, fingers, etc. during the use of the smart terminal/mobile phone, the method utilizes a smart terminal/mobile phone with a sensor capable of sensing external objects such as a proximity sensor, a radar sensor, and the like. The trigger duration of the object (such as the hand) triggering sensor is the basis of the command encoding, the direction of the combined trigger (if the sensor contains directionality), the state of the smart terminal/mobile phone or the specific state of the App, and the command input and control method of the combined implementation, The method can enable the user to complete control of the smart terminal/mobile phone in various scenarios, such as music, telephone, photo/video, recording, voice message, half-duplex voice communication (walking machine), covert help (SOS), And the control of various App function modules, and the mobile operating system itself can also be solidified into a standard input system, thereby improving the universality of the smart terminal/mobile phone.

Sensors that have the ability to sense external objects, such as radar sensors, proximity sensors, etc., usually return the distance value after the external object approaches. Of course, the proximity sensor currently used in large quantities returns a distance value of 0-5 cm, and some return. Is close to or not close to true or false, ie 0 or 1; thus the operating system of the intelligent terminal monitors according to the trigger value of the proximity sensor, and if the object approaches when the traffic is approached, the screen is closed, when the object leaves, The screen is turned on; the radar sensor feeds back the exact value of the external object and is used to calculate the spatial imaging of the external object; and the method uses a proximity trigger of such a sensor that is less than a certain value, such as a threshold of 1, less than the threshold. Analyze whether the trigger is a trigger of the nature of the instruction; thus the instruction input can be implemented with minimum cost (calculation cost and time) regardless of the proximity sensor or the proximity sensor group and the radar sensor.

When the object is close to the sensor with the ability to sense the external object, if the detected object distance is less than the threshold, the system records the trigger time t1. When the object leaves the sensor is greater than the threshold, the system records the time t2, and the duration of a near trigger is T2-t1. The method is based on the length of t2-t1 as the instruction coding. For example, t2-t1<200ms is defined as a short trigger, and 200ms<t2-t1<2000ms is defined as a long trigger. If the Morse code is taken as an example, the short trigger is the "." (drop) of the Morse code, and the long trigger is the "-" (嗒) of the Morse code. We know the Morse code. It is in this way to form a code, to transmit information and messages. If the short trigger is defined as 1, and the long trigger is defined as 0, then binary encoding can be formed. We know that binary encoding can be combined into any information, which is the basis of modern computer and communication technology. For example, in the case of covert help, you can use a short, long trigger to send an SOS call, ie "...---...", which is received by the smart terminal/mobile operating system. After the trigger, the location, live sound, image and other information can be sent to the police or a pre-set rescuer (of course the code can be ".-." or "111", which kind of help code is a kind of this method The specific implementation is only because the implementation basis of the method is based on the duration of the trigger; but the binary is convenient to identify during calculation and transmission, and the multi-ary code has higher requirements on the system during transmission and calculation, so the practical system is less and more In the experimental system; in the method, according to the characteristics of the control object, a longer duration trigger is also introduced for the state/condition switching, such as music control, switching from music selection to volume control. After completing the music track, if you want to adjust the volume, trigger the sensor for a long time, enter the volume adjustment, and define the trigger without t2. For example, if the smart terminal is loaded into the package, only t1, the current system clock -t1>10s, system or application Return to the listening state regardless of the previous conditions or conditions; when there is no defined trigger within 10 seconds in a certain state, it will return to the listening state. Therefore, the user does not misuse the operation, and usually cooperates with the voice prompt when switching, and the user is more effectively assisted. The above specific time data is only for explaining the method, not the data that must be relied upon by the method; The basis is to form the instruction encoding mechanism based on the trigger duration. In combination with the application or function that needs to be controlled, it can be a Morse code, a binary code, or a combination of a multi-digit code or a state-added code. Application features (such as covert help does not require multi-code or combination code, Morse code or binary code is competent, and the fine-tuning of the volume in the music requires a combination of codes is more convenient, first enter the volume control state, then Short trigger is volume plus, long trigger is volume reduction, and when using binary code control, for example, the volume plus command is “111”. If the input volume is reduced by 5, the volume is reduced from 100 by 50. It needs to be triggered 30 times, obviously not Too reasonable, and the combined code is after entering the volume control state, the long trigger is to reduce the volume, from 100 to 50, only need to trigger 10 times). It depends on the application environment combined with the state of trigger-based long.

DRAWINGS

Further description of the method will be given below with reference to the accompanying drawings.

Figure 1 is a schematic diagram of the method.

Fig. 2 is a first embodiment of music control by taking a proximity sensor as an example.

Fig. 3 is a second embodiment of music control by taking a proximity sensor as an example.

4 is a third embodiment of a music control with a directional proximity sensor group or a radar as an example.

Figure 5 is an embodiment of controlling a smart terminal/phone camera using a perceptible external object sensor.

Detailed ways

The embodiments and specific data described in the following exemplary embodiments, such as time, code, etc., do not represent all embodiments consistent with the method, but rather, they are only as described in the appended claims. Some aspects of the method are consistent, that is, the sensor that senses the ability of the external object accepts the external trigger, and according to the coding of the trigger duration, identifies whether it is a trigger instruction, and combines the state of the smart terminal/mobile system/App, the directionality of the sensor, and executes Sensor trigger Corresponding instructions and corresponding functions, thereby realizing the purpose of controlling the smart terminal/mobile phone or App by using an external sensor.

The process shown in Figure 1. S101 is the initialization sensor. When the initialization is completed, the sensor will work according to the set parameters. S102. Monitor the sensor. When the initialization is completed and the sensor works normally, the system or the App monitors the trigger of the sensor. When the sensor is triggered, the step S103 is performed to identify whether the trigger is a predetermined instruction, which instruction is used, and when the trigger is determined. After the instruction is determined and the corresponding instruction is determined, the step S104 is executed to execute the instruction or the corresponding function module. In the actual App programming, S101 to S104 may be implemented in a certain code segment according to the characteristics of the application, or may be distributed in different functional modules. From the logical point of view of the project, after the sensor is initialized, the system always monitors the trigger of the sensor. When the legal trigger is received, it determines whether the trigger is a predefined command. After determining the pre-defined command, the corresponding command or function is executed. Module.

In step S101, the sensor is initialized, and the parameters of the sensor operation are set, generally including the frequency of sampling the sensor, whether the sensor is in the foreground or background, the threshold value triggered by the sensor, and the parameter associated with the sensor feature. The sampling frequency setting should be set according to the scene characteristics. For example, the trigger that needs to be executed immediately, the sampling frequency of the sensor cannot be the second level. The faster the response is, the higher the sampling frequency of the sensor. According to the scene requirements, you can set Sampling frequency from 1 millisecond to second. Usually, when the sensor is triggered, it is generally not necessary to turn on the terminal screen. Secondly, the sensor should wait for triggering at any time, so usually the sensor should be set to work in the background. The above two types of parameters are more common. As for the parameters of other sensors, it needs to be defined according to the type of the sensor, such as directionality.

Step S102 is a monitoring sensor. In a smart terminal or a mobile phone, the function is usually processed by an operating system as an event, but after the sensor is triggered, the operating system will trigger the event as an event, and the associated information is sent to the App that invokes the sensor. The code snippet, so the code that monitors the sensor in the app is actually listening for event information fed back by the operating system. Of course, the application can also bypass the operating system's resources and directly monitor the sensor. Either way, the mechanism of event processing is followed, and the corresponding code is executed immediately after the trigger event occurs in response to the event.

Step S103 is to identify the command, because the sensor receives the trigger, only the feedback trigger, but whether the trigger is a so-called command requires S103 to judge, S103 is to be based on the S102 trigger system feedback information, such as the proximity time, the formed waveform, the received signal , contact distance, contact shape, direction, etc. for identification and judgment. But generally divided into deterministic instructions and similar instructions. The deterministic command uses, for example, a proximity sensor, and the proximity trigger that is less than 400 ms twice in 3 seconds is the start command, and triggering the command requires the object to quickly approach the distance sensor twice within 3 seconds. Once the discrimination is the determined instruction, there is no error. If the radar sensor is used, it is actually an approximate trigger command. When the command is initially set, the radar sensor receives the signal of a certain gesture and uses the signal feature as a specific instruction template. When the sensor receives the external trigger signal. After that, the characteristics of all the instructions will be compared to find the template with the highest degree of approximation. For example, the approximate degree of approximation may be only 60%. If the approximate threshold value is set to 60%, the gesture is considered. That is to execute the command, but in fact, the gesture may be similar to the triggering instruction, but not the initially determined gesture. When the threshold is adjusted to 100%, since the feature template of the command and the signal characteristics generated by the trigger may not be completely identical, even if the gesture is triggered, it may need to be triggered multiple times to trigger the command, so the radar and image recognition are both It is an approximate command mode. There is a certain systematic error. The threshold of the feature comparison is usually set. When a characteristic exceeding a certain value, such as 90%, is similar, it is recognized that the gesture input command is a preset command. However, the radar sensor recognition trigger can be defined as the object approaching less than 1cm, the length of time close to less than 1cm, and the direction and direction of the object, then a deterministic command can be formed, and the judgment speed is much faster than the gesture recognition, and the method utilizes A method of deterministic instructions for radar sensors. Although it is in violation of the radar sensor design usage mode, this method is suitable for more scenes and is not limited by eyes, fingers, etc., such as when wearing gloves, or when driving with eyes restricted, such as driving, and the recognition command is fast.

Step S104 is an execution instruction and a corresponding function. Generally, the control of the system or the application that needs human operation is implemented by touching the screen, so the corresponding function or function is completed when the program is designed, and the sensor trigger is to simplify the operation, so when S103 is recognized After that, the function and function module of the corresponding instruction are directly called, and the control of the App by the sensor is realized.

Embodiment 1: FIG. 2 is an example of a proximity distance sensor (the radar sensor is also applicable to the present embodiment when no directivity is used), and the music control embodiment 1 uses the trigger duration as an instruction code, and the player The state is combined. In this example, the short trigger is a proximity trigger of <200ms, that is, the aforementioned t2-t1<200ms, the long trigger is greater than 200ms, and the proximity trigger is less than 2000ms, that is, 200ms<t2-t1<2000ms mentioned above. The control of music and volume is defined as: in the music control state, the short trigger changes the next song in the playlist, the long trigger is the upper song in the music list; in the volume control state, the short trigger is the volume plus 5 Long trigger is the volume minus 5; while the music being played is paused or the music being paused starts playing, it is completed with two short triggers and two short triggers are completed within 1600ms; and manually switching from one state requires one The trigger is greater than 2000ms (the above triggers are all close triggers). If it is automatically switched out, if there is no trigger within 10 seconds, it will automatically switch to the monitor sensor state. Such a design is that after the terminal is triggered by mistake or the instruction is input, it automatically returns to the monitoring, so that the user's instruction input is not wrong, and the system waits for the input of the new instruction at any time. The advantage of this method is that the user only needs to master the long and short trigger rhythm, instead of memorizing the instruction code encoding such as "...-" of the Morse code or "101" of the binary code, the sound prompt after the matching state is entered. , it is extremely convenient to use, and the quick meaning of the trigger is "plus", such as increasing the volume or the next song, in line with people's daily cognition;

As shown in step S201 of Figure 2, the event-driven processing mechanism monitors the triggering and changes of the sensor. The return trigger value is far or near, and since the system clock is monitored synchronously with it, the state duration that is triggered, far or near is the input of S202.

For the step S202 in FIG. 2, when the trigger is not zero distance or close range triggering, step S203 in FIG. 2 determines whether the current state is in the control state, and if in the control state, proceeds to step S204 to determine whether the remote distance state exceeds 10 seconds, if it exceeds 10 seconds, all control modes, music control mode and volume control mode are set to False in step S205. If the determination in S203 is No, that is, the current state is not in the control state, the process returns directly, and the system event is detected. In the step S204, if the remote state is less than 10 seconds, the process returns directly, and the system event is detected.

The purpose of setting the above steps is that when in the control state, if there is no near/zero distance trigger for 10 seconds, the system returns to the non-control state, then in this non-control state, the non-instruction trigger will not cause The system is malfunctioning. At the same time, the system will not stay in a certain control state and the next control system may cause an error to execute the instruction;

When the step S202 determines that the trigger is zero distance or close proximity trigger, then step S206 is performed. When the step S206 determines that the control mode is not in the control mode, it indicates that the short distance or zero distance trigger may be to make the system enter a certain control mode;

If the process proceeds to step S207, that is, there are two zero or close-range triggers less than 200ms in 1600ms twice. If the judgment of step S207 is established, the music being played will be paused or the music that has been paused will be played, when S207 judges If not, proceed to step S208 to determine whether the near/zero distance trigger is >200ms and the near/zero distance trigger of <2000ms. If the result of the interpretation in S208 is true, proceed to step S209, set the state of the control mode and the state of the music control mode to true, and then return to the system event listening; if S207, S208 determines that the determination is not established, the process proceeds to step S210;

When the S210 receives the trigger of the near or zero distance of >=2000ms, the process proceeds to step S211, and the process proceeds to step S211, and the state of the control mode and the state of the volume control mode are both set to true, and then returns to the system event interception;

The purpose of the above-mentioned event detection and processing in the non-control mode is to enter from a non-control mode to a specific control mode such as music control, volume control, and the like. For example, if a close/zero distance trigger of more than 200ms and less than 2000ms is received, the control mode and the music control mode are entered; when the next near/zero distance trigger of more than 200ms and less than 2000ms occurs, the trigger is in the music control mode. Then it becomes the command of the first song or the previous channel; the same method > 2000ms triggers to enter the volume control mode, while the long trigger is to lower the volume, increase the volume when the trigger is fast; through this trigger time and the control The combination of states greatly reduces the complexity of the instructions and is convenient for the user to use.

When the step S206 determines that Yes is, that is, the system is already in the control mode, the event-driven processing mechanism determines which specific control mode is in, for example, proceeds to step S212 to determine whether it is already in the music control mode, and if so, Listening to the state time of the proximity/zero distance trigger of the proximity sensor. If the trigger time is less than 200 ms, as shown in step S213, the next song is played in S214. If it is greater than 200 ms and less than 2000 ms, as shown in step S215, step S216 is performed. , play the first song, if >=2000ms, such as step S217, then execute step S218, exit control mode, exit music control mode, in the design of the program is to set the state value of the control mode and the state value of the music control mode False. When S214, S216 and S218 are respectively executed, they all directly return to the system event interception, as shown in FIG. 2, and listen to the occurrence of the next trigger event.

When the step S206 determines that Yes is, that is, the system is already in the control mode, the event-driven processing mechanism will judge In which specific control mode, such as entering step S219, it is judged whether it is in the volume control mode, and if so, the state time of the proximity sensor near/zero distance trigger is detected, if the trigger time is <200 ms, as shown in S220. Then, step S221 is performed, and the volume is increased from the current volume value by 5 to 100 (usually the volume value of the mobile phone is 0-100). If the trigger time is >200ms and <2000ms, as shown in step S222, step S223 is performed, and the volume is performed by step S223. The current volume value is decremented by 5 until 0; if >=2000 ms, as indicated by step S224, it means that the instruction to exit the volume control mode is accepted, and as shown in step S225, the control mode and the volume control mode are set to False. When S221, S223, and S225 are respectively executed, they all directly return to system event interception, as shown in Figure 2, to listen for the occurrence of the next trigger event.

2 is an event-driven processing mechanism and flow in a mobile phone verification program written to verify the method, mainly including music control and volume control. As for the similar channel control and volume control in mobile internet radio stations, the same method and method can be used, and as for the specific trigger state time setting, the specific user can adjust according to his own preferences. In the test of the actual program implemented in accordance with the above process in the state of motion, the method is superior to the control mode set by the current mobile phone manufacturer and the earphone manufacturer regardless of whether the control and non-wire-controlled sports headphones are worn or even not worn. .

It is worth mentioning that when the instruction that changes the control state, such as step S209/S211, is executed in FIG. 2, the short prompt sound is used to make the user more accurate and convenient to manipulate the music during exercise. Various instructions related to traffic.

For controlling traffic, the method is similar to controlling music, but the premise is that the event-driven mechanism will listen to whether there is a call or call state, whether it is in the middle of the phone, that is, online, when the music is played, the mobile operating system listens. When the call comes in, the system will stop the music playing. When the call is over, the concert will continue to play, so the pause of the music and the connection and hanging of the phone can use the same command. In this example, two shorts within 1600 mm are used. trigger. For example, in the incoming call state, if the near/zero distance contact exceeds 2s, it can be defined as rejecting the call. In 1600ms, two short triggers of <200ms are consecutive, that is, the call is answered. When the call is connected, two consecutive <200ms in 1600ms. A short trigger is to hang up the phone. The control mechanism is the same as music, which is based on the state and trigger duration. When the telephone service is different from the music, the status is generated by the system itself, such as the incoming call status and online status. The first embodiment is based on the instruction mode of the trigger time and state of the sensor, and does not need to memorize the specific coding, only the fast and slow sections are required to trigger the rhythm, so it is one of the best methods for relatively simple control such as music and traffic. . The proximity distance sensor, the proximity distance sensor group (with directionality), and the radar sensor can all use the embodiment to realize the control of music and traffic. In the actual App, when the incoming call is made, the calling number will be TTS (text to voice). Play, if the phone in the phone book is the name of the corresponding phone number in the TTS phone book, if the phone book is in the phone book, then the TTS phone number.

Embodiment 2: FIG. 3 is an example of a proximity control sensor and a music control embodiment 2. This embodiment is based on short and long trigger coding, in the embodiment according to the Morse code form, and of course it can also be a binary code. The definition of the instruction is as follows. The two-digit code of "." and "-" is received within 3000 mm. The former is a trigger of less than 200 ms, and the latter is >200 ms, <2000 ms. Trigger; define ".-" for entering music control mode, "-." for entering volume control mode; ".." for music pause/continue; after entering any mode, if there is no command trigger within 3000 mm, exit status After entering the state, the short touch is ".", the long trigger is "-", the corresponding volume control is the volume addition and subtraction, and in the song control is the switching of the next song or the first song;

As shown in FIG. 3, S301 is a trigger for monitoring the sensor. When the trigger occurs, the process proceeds to step S302, and it is determined whether it is in the control state. If not, the process proceeds to step S303, where the counter starts at the trigger, in a 3000ms In the instruction window, if the contract instruction is received, in S303, if the Cst command input is ".-", that is, a short and a long trigger, then step S304 is performed, and the control mode is set to True because the command is Enter the music control command, so set the music control mode to True, clear the command Cst, then return to the sensor to listen and wait for the music control command input.

If the determination in S303 is not ".-", the process proceeds to step S305, and it is judged whether it is "-.". If yes, the control mode, the volume control mode, etc. are set to True, then the command Cst is cleared, the sensor is returned, and the volume command is awaited. That is, step S306.

If the determination in S305 is NO, the step S307 is performed. If the step receives ".." in the instruction window period, the step S308 is performed, if the music is playing, the pause is made, and if the music is in the pause state, the playback starts.

After the trigger occurs, after the control mode of the S302 is True, the process proceeds to a step of determining whether the music control mode is True, that is, step S309. If it is true, and then receiving “.” in the command window, step S311 is executed to switch the playlist. If the middle song reaches the next song, if "-" is received, as in step S312, then S313 is executed to switch the song in the playlist to the previous song. After switching, Cst is cleared, waiting for the next trigger, and because there is an instruction trigger in the instruction window, the instruction window t is re-timed and waits for the next instruction. If there is no trigger in the instruction window, then step S319, t>3000ms, ie instruction If there is no trigger in the window, set the control mode and music/volume control mode to false, Cst to clear, and then return to sensor listening.

When the control mode of S302 is True, if the volume control mode is True, step S314 is performed. When "." is received in the command window, that is, S315 is judged as true, and step S316 is performed, and the volume is increased by 5, otherwise, if "- When S317 is true, S318 is executed, the volume is reduced by 5, and after S316 and S318 are executed, the sensor returns to trigger detection and waits for the next instruction. If the command window times out without receiving long and short triggers, execute S319. And step S320.

The embodiment of FIG. 3 enters the state by means of instruction encoding, and then completes the music control with fast triggering or slow triggering. The advantage of this method is that because of the encoding, multiple states can be designed, with the length of the instruction encoding, For example, if 3 or 4 bits, 8 to 16 instructions can be combined. Then, in each state, the combination of 1 bit, 2 bit or multi-bit code can form a lot of instructions. The disadvantage is that the user wants to memorize the code, just like memorizing the Morse code or the binary code, adding memory burden to the user. . However, it is more convenient to define an instruction such as "..." or "111" for increasing the volume.

It can be seen from the above that the method of encoding the sensor with the trigger time is an extremely flexible way. Instead of using the traditional binary or Morse code as the benchmark, it is combined with Morse with the characteristics of the controlled object. Code, binary code or different The combination of duration, for example, in controlling half-duplex voice communication, is the long trigger of the sensor when speaking, how long it takes to press, when the message ends, leaving the sensor, the message is automatically sent; when listening to other party's new message, it can be "", if you re-place the message, it can be "-". If you switch multiple previous messages, it can be "-". Trigger a "-" and switch one forward. For example, if you switch to the first 5, the "-" is triggered five times in succession.

Embodiment 3: FIG. 4 is an embodiment in which music control is performed in combination with a sensor such as a proximity distance sensor group or a radar having a sensing direction capability. In this embodiment, the control of the music and the volume control utilize the directivity of the sensor. The mode of entering the control state and the music or volume control adopts a combination of short duration triggering and long duration triggering combination encoding. Of course, entering the control state can also be triggered by the agreed direction. However, in actual use, a single direction trigger can easily cause false triggering, so the direction trigger also needs to be encoded, such as two consecutive left triggers, but in actual use, The method of triggering the duration encoding is simpler. For example, the triggering of the mobile phone in the armband from left to right is inconvenient for the user to use, and the triggering of the long and short is relatively convenient. In the actual engineering implementation, the flow of FIG. 3 and FIG. 4 can be used in combination, that is, the user can switch to the next song by short duration triggering, or can switch to the lower end of the music list by triggering from top to bottom. The process of songs.

In FIG. 4, except for S410, S412, S415, and S417, which are different from S310, S312, S315, and S317 in FIG. 3, the other logics are identical and will not be described again. After entering the music control state, in the 3-second instruction window, if the trigger from top to bottom is received, that is, step S410, step S311 is performed, and if the trigger from bottom to top is received, that is, S412, then S313 is executed. Step S15: When the triggering step S415 receives the trigger from bottom to top, the S316 volume is added. If the step S417 receives the trigger from top to bottom, the process proceeds to S318, and the volume is decreased. After each legal trigger is entered, the command window will continue to be kept for 3 seconds. If there is no legal trigger or no trigger within 3 seconds, the control mode is exited and the monitor status is returned, and the corresponding data and instructions are cleared.

In Embodiments 1-3, music control is taken as an example. Nowadays, many network music stations, which switch radio stations, can adopt the same control method as switching songs, so Embodiment 1-3 not only satisfies the music player but also satisfies the radio type App. Control, but also suitable for the control of various multimedia broadcast app. By the same token, the direction can also be the command input of the telephone control. For example, the call is triggered from the upward direction, the hanging call is triggered from the top to the bottom, and the hanging call can be the proximity trigger of >2S.

Embodiment 4: FIG. 5 is an embodiment in which a smart terminal/mobile phone camera is controlled by a sensor that senses an external object such as a proximity distance sensor and a radar sensor. The background of this embodiment is that a person who likes to exercise is good at running, climbing, riding a bicycle. When viewing landscapes or things, or process records, you need to take photos or videos, or when the intelligent terminal user encounters an external threat, you need to take photos, videos, etc. as evidence, but it is not convenient for others to notice the photos or videos. The sportsman usually installs the smart terminal or mobile phone in the sports arm belt or the sports bag. When the sports arm belt or the sports bag can support the sensor and the front camera that can sense the external object, the embodiment can be very practical. Achieve the goal. As for the scene of the threat, the user can choose to shoot according to the scene.

In this embodiment, the instruction is coded in binary mode, and the instruction is two bits, which are respectively “11”, “10”, “01”, “00”, wherein “11” is defined as a photograph, and “10” is defined as a camera. “01” is defined as stopping the recording, and “00” is sharing the newly taken photos or videos to the set website, webpage, community, etc. The definition of "1" is <200ms fast proximity trigger, 0 is greater than 200ms, and less than 2000ms slow approaching trigger. Of course, it can also be implemented by "." and "-" of Morse code. This embodiment only wants to illustrate the flexibility of the method by binary instruction coding. For example, for a particularly complex system, when a 4-bit encoding is required, both the binary code and the Morse code are better. For the agent, the method can be used to cover the information for the service organization. After the smart terminal or the mobile phone receives the trigger, it is sent to the corresponding person or organization through the App, and the surrounding people do not observe it carefully, which is difficult to detect.

In FIG. 5, the system monitors the trigger state of the S501 sensor. When triggered, the process proceeds to S502, and the command window is determined to receive one of the 2-bit command codes within 3000 milliseconds, and the corresponding step is executed. If the command window period is exceeded, the system does not receive When the instruction is reached, the instruction window is closed, and the instruction Cst is cleared, that is, the step S511 is executed and the trigger of the listening sensor is returned. The opening of the instruction window is triggered by the first legal trigger, ie "1" or "0", while other false triggers are invalid triggers. When the step S502 determines that the received trigger is an instruction, the subsequent steps S503, S505, S507, and S509 are performed. If the command is received, that is, Cst=“11”, that is, step S503, according to the instruction, the step S504 is performed, and the photograph is taken. Archive. After the photographing is completed, the S511 step is executed, the sensor is returned, and the command window is closed and the command is cleared. When the command is "10", that is, when S505 is true, the step S506 is performed, the camera is photographed, and after the camera is turned on, S511 is executed. Step; when the instruction is "01", that is, after completing the step S507, the step S508 is executed, that is, the camera is stopped and archived; after the archiving is completed, the step S511 is executed, the instruction is cleared and the instruction window is closed; when the command is "00", that is, S509 When it is judged that Cst=“00” is received, S510 is executed, and the last document is shared to the background or the network, and after the sharing is completed, S511 is executed.

Through this simple implementation example, we know that this method can control the camera of the smart terminal/mobile phone in binary form, and take photos or video according to the user's wishes, and share it to the network at any time. Note that the camera of this embodiment generally uses a front camera. After receiving the command S503, it is necessary to perform a step 504 for a delay of 1-2 seconds, which is related to camera imaging, focusing, etc., sometimes it is impossible to perform photographing immediately. After the S510 is executed, a vibration is usually given to remind the user to share.

There is a special case of this method, that is, when the smart terminal or the mobile phone is in the bag or the pocket, the sensor always inputs the proximity state, and when the user uses it at this time, the trigger also takes the form of inversion, that is, the object (hand) is The distance from 0 to greater than 1 is t1, and from greater than 1 to 0 is t2. The duration of t2-t1 can be regarded as a trigger according to the instruction definition, and the time of this trigger is as long as the instruction is met, because the sensor is always covered. , the input is also treated as an instruction, which is more in line with the scene where the phone needs to be directly operated in the pocket. If you look at the square pulse map from the time when the time is the X axis and the distance is the Y axis, the method can be operated in the pocket as well. This is a function that can not be realized by screen touch control, voice control, and radar control. It is especially suitable for concealed help or smart terminal operation in a pocket.

This method can not only input instructions, but also input information, but the information input should be directed to specially trained people, such as using Morse code to send messages, and the information can be very concealed when entering information, such as in a pocket or a bag. Suitable for applications in special scenarios.

The method can be applied to any electronic device, such as a watch, an audio, a wearable device, a walkie-talkie, a car electronic, etc., and the method can be more suitable for people's living scenes, and the people are restricted in certain eyes and fingers. Under the place (such as when driving), the electronic device can be conveniently controlled. At the same time, the method also provides a more convenient method for the disabled to use the smart terminal or the mobile phone, such as using the foot, the arm, the prosthesis, etc., to control the intelligence. Terminal or mobile phone.

The method combines the trigger duration, the trigger direction and the state, and can create several instruction modes for an application scenario, but in fact, it is a specific embodiment of the method, and the method is characterized by monitoring the smart terminal or The sensor of the mobile phone that can sense the external object, monitors the external trigger, recognizes the trigger, and executes the trigger corresponding command. The instruction is encoded by the duration of the trigger (morse code, binary code, multi-ary code, short and long trigger code), combined with the state of the system or application and the directionality of the sensor, etc., to form an instruction, when the external trigger is determined When the instruction is executed, the corresponding instruction is executed, thereby implementing the input of the external instruction and the execution of the internal corresponding instruction and function.

Claims

A smart terminal/cell phone control method using a sensor capable of sensing an external object such as a proximity sensor, a directional proximity sensor group or a radar sensor, etc., with a trigger duration as an instruction coding basis and a system state or App The specific state and the triggering direction of the sensor are combined to form an instruction, so that the manipulation of the smart terminal/mobile phone such as music, traffic, duplex/half duplex voice communication, camera, control system itself or various App can be completed by external triggering. It is suitable for the scene where the eyes, hands and fingers are inconvenient to operate the smart terminal/mobile phone. The method is also applicable to other electronic devices that require such control functions to suit the needs of the user in various scenarios.
According to claim 1, the method is characterized in that a sensor that can sense the ability of an external object such as a proximity distance sensor, a directional proximity sensor group or a radar sensor or the like is used as the command input device.
According to claim 1, the method is characterized in that the duration of triggering the sensor is based on the instruction encoding.
According to claim 1, the method is characterized in that the triggering time is combined with the direction feedback of the sensor such as the proximity distance sensor group and the radar sensor.
According to claim 1, the method is characterized in that the command code of the trigger of the sensor is combined with the specific state of the operating system/App of the smart terminal to form an instruction.
According to claim 1, the method can control the music, the telephone, the duplex/half duplex voice communication, the camera and the operating system itself or the application on the operating system by triggering the sensor.
According to claim 1, the method is suitable for other electronic devices to adapt to the manipulation of electronic devices in different scenarios.
According to claim 1, the method is particularly suitable for operating a smart terminal/mobile phone in a scene in which eyes, hands, and fingers are inconvenient to operate, such as sports, driving, or disabled.
According to claim 3, the method is characterized in that the trigger duration is based on the instruction encoding, and the trigger duration can be encoded as a binary, or a Morse code, a multi-ary code, or only a trigger duration. For the defined encoding, what encoding is used to control the characteristics of the object.