CN110673724A - Interface switching method and device, storage medium and terminal - Google Patents
Interface switching method and device, storage medium and terminal Download PDFInfo
- Publication number
- CN110673724A CN110673724A CN201910873047.1A CN201910873047A CN110673724A CN 110673724 A CN110673724 A CN 110673724A CN 201910873047 A CN201910873047 A CN 201910873047A CN 110673724 A CN110673724 A CN 110673724A
- Authority
- CN
- China
- Prior art keywords
- switching
- interface
- display screen
- pupil
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000000007 visual effect Effects 0.000 claims abstract description 106
- 210000001747 pupil Anatomy 0.000 claims abstract description 94
- 238000012545 processing Methods 0.000 claims description 20
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 7
- 230000007547 defect Effects 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 10
- 230000007246 mechanism Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 4
- 230000007257 malfunction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 230000007123 defense Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 208000000044 Amnesia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003466 welding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses an interface switching method, an interface switching device, a storage medium and a terminal; the method can start the camera device to acquire the current pupil image information of the user; analyzing the image information and determining the visual direction of the pupil; calculating an angle value between the pupil visual direction and the display screen; determining attribute information of a current interface; if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule; and if the angle value is located in a second preset angle interval, switching the current interface to the target interface according to the attribute information and a second switching rule. According to the scheme, the page turning by using the eye function in the application program is realized according to the setting of the corresponding visual range between the pupil vision of the user and the display screen, the defect that the application scene of manual page turning is limited is overcome, and the rate of interface switching by using the application program by the user is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an interface switching method and apparatus, a storage medium, and a terminal.
Background
With the continuous development of mobile communication and the continuous improvement of the living standard of people, various terminals such as mobile phones are more and more popular, and the mobile phones become indispensable communication tools in the life of people.
Most of the browsing operations of the display interface of the terminal are performed through touch operations, for example, when viewing a web page or reading an electronic book, a corresponding button needs to be clicked to perform a corresponding operation, for example, a button of a next page is clicked to perform a page turning operation. However, if the reader just has two hands which are inconvenient to operate the interface, for example, the user is taking a subway, the number of people on the subway is too large, the user has to operate with one hand, and if the display screen of the terminal is too large, the related browsing operation is difficult to perform with only one hand.
Disclosure of Invention
The embodiment of the application provides an interface switching method, an interface switching device, a storage medium and a terminal, and improves the rate of interface switching by a user through an application program.
The embodiment of the application provides an interface switching method, which is applied to a terminal and comprises the following steps:
starting a camera device to acquire the pupil image information of the current user;
analyzing the image information and determining the visual direction of the pupil;
calculating an angle value between the pupil visual direction and the display screen;
determining attribute information of a current interface;
if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of a display screen of the terminal is located in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval;
and if the angle value is located in a second preset angle interval, switching the current interface to a target interface according to the attribute information and a second switching rule, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
Correspondingly, the embodiment of the present application provides an interface switching apparatus, which is applied to a terminal, and includes:
the starting unit is used for starting the camera device to acquire the pupil image information of the current user;
the analysis unit is used for analyzing the image information and determining the visual direction of the pupil;
the calculating unit is used for calculating the angle value between the pupil visual direction and the display screen;
the determining unit is used for determining the attribute information of the current interface;
correspondingly, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and the computer program is suitable for being called by a central processing unit, and is used to execute the steps in the interface switching method provided in any embodiment of the present application.
Correspondingly, the embodiment of the present application further provides a terminal, including: a central processing unit and a memory; the memory medium stores a computer program, and the central processing unit is used for executing the steps in the interface switching method provided by any one of the embodiments of the present application by calling the computer program stored in the memory.
The embodiment of the application discloses an interface switching method, an interface switching device, a storage medium and a terminal; the method can start the camera device to acquire the current pupil image information of the user; analyzing the image information and determining the visual direction of the pupil; calculating an angle value between the pupil visual direction and the display screen; determining attribute information of a current interface; if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule; and if the angle value is located in a second preset angle interval, switching the current interface to the target interface according to the attribute information and a second switching rule. The scheme aims to judge the interface switching mechanism triggered by the user according to the setting of the corresponding visual range between the pupil vision of the user and the display screen, so that the purpose of turning pages by using the eye function in the application program is realized, the defect that the application scene of manual page turning is limited is overcome, and the rate of switching the interface by using the application program by the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of an interface switching method provided in an embodiment of the present application;
fig. 2 is a first flowchart of an interface switching method according to an embodiment of the present disclosure;
fig. 3 is a second flowchart of an interface switching method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a first interface switching device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a second interface switching device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a third interface switching device according to an embodiment of the present application;
fig. 7 is a specific structural block diagram of an interface switching terminal according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides an interface switching method, an interface switching device, a storage medium and a terminal. The interface switching device may be integrated in a network device, and the network device may be a server or a terminal.
For example, as shown in fig. 1, the interface switching device is integrated in a terminal. Firstly, starting a camera device of the terminal to acquire pupil image information of a current user, and analyzing the image information to determine the pupil visual direction of the current user; then, calculating an angle value between the pupil visual direction and a terminal display screen, and determining the current interface attribute information displayed by the display screen; then, analyzing the angle value between the user and the display screen in two aspects; on one hand, if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule; on the other hand, if the angle value is in a second preset angle interval, the current interface is switched to the target interface according to the attribute information and a second switching rule.
The following are detailed below. It should be noted that the following description of the embodiments is not intended to limit the preferred order of the embodiments.
In this embodiment, the interface switching apparatus will be described from the perspective of an interface switching apparatus, where the interface switching apparatus may be specifically integrated in a network device, and the network device may be a server or a terminal; the terminal can comprise a smart phone, a tablet computer and other devices.
An interface switching method comprises the following steps: starting a camera device to acquire the pupil image information of the current user; analyzing the image information and determining the visual direction of the pupil; calculating an angle value between the pupil visual direction and the display screen; determining attribute information of a current interface; if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of a display screen of the terminal is located in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval; and if the angle value is located in a second preset angle interval, switching the current interface to a target interface according to the attribute information and a second switching rule, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
Referring to fig. 2, the method specifically comprises the following steps:
In some embodiments, the terminal may include a camera, which may generally be comprised of components such as a PCB board, a lens, a holder, a color filter, a digital signal processor, and a sensor.
The printed Circuit board (printed Circuit board) is a support body of electronic components, is a carrier for electrical connection of the electronic components, and is divided into a hard board, a soft board and a soft-hard combined board. After the electronic equipment adopts the printed circuit board, the error of manual wiring is avoided, the automatic insertion or mounting, the automatic welding and the automatic detection of electronic components can be realized, the quality of the electronic equipment is ensured, and the cost is reduced.
Among them, a lens is a device for imaging a photographed subject on a sensor, and is generally composed of several lenses. From the material, the lens of camera can be divided into two kinds of plastic lens and glass lens. The lens has two more important parameters, one is an aperture which is a device arranged on the lens and used for controlling the quantity of light reaching the sensor through the lens, the aperture has the function of controlling the depth of field besides controlling the light flux, and the larger the aperture is, the larger the depth of field is; the depth of field is a distance range between the front and rear of the subject measured before the camera lens to enable imaging of a sharp image. The second is the focal length, which is the distance from the central point of the lens to the clear influence formed on the sensor plane; according to the imaging principle, the focal length of the lens determines the size of an image formed on the sensor by an object shot by the lens.
The fixer is used for fixing the lens, a color filter is arranged on the fixer, and the color separation mode of the color filter is two, namely a primary color separation method and a complementary color separation method.
The digital signal processor is used for optimizing digital image signals through a series of complex digital algorithm operations and finally transmitting the processed signals to a display screen.
The sensor is the core of the camera, and is also the most critical technology, and it is a device for receiving the light passing through the lens and converting the light signal into an electrical signal.
In some embodiments, the type of the terminal camera device may be a front camera device installed in the same direction as the display screen of the terminal, or a side camera device installed in the side of the terminal and capable of extending and contracting to reach the same direction as the display screen, or a back camera device installed in the back of the terminal and capable of extending and contracting by rotating, and reaching the same defense line as the display screen.
And 102, analyzing the image information and determining the pupil visual direction.
In some embodiments, the pupil image information captured by the terminal through the image capturing device is an optical signal generated between the terminal display screen and the current pupil of the user by the image capturing device, and is converted into an electrical signal through the analysis and processing of the digital signal processor and the sensor, and the processed signal is transmitted to the terminal display screen to determine a visual range generated when the pupil of the user gazes at the terminal display screen, so as to obtain the pupil visual direction.
And 103, calculating an angle value between the pupil visual direction and the display screen.
In some embodiments, the display screen may be divided into two area ranges by calculating an angle value between the pupil visual direction and the display screen, so as to trigger two mechanisms to perform interface switching processing on the current interface.
For example, the angle between the pupil visual direction and the top of the display screen may be set to 0 degree, that is, the pupil visual direction looks at the top of the display screen at the head level, the angle between the pupil visual direction and the middle of the display screen may be set to a degree, and at this time, the corresponding visual range is greater than or equal to 0 degree to less than a degree, and this region is set as the first preset angle interval. Similarly, the angle between the pupil visual direction and the middle end of the display screen is set as a degree, the angle between the pupil visual direction and the bottom end of the display screen is set as B degree, at this time, the corresponding visual range is from greater than or equal to a degree to less than or equal to B degree, and the area is set as a second preset angle interval.
And step 104, determining the attribute information of the current interface.
The attribute information may include information of an application to which the current interface belongs, and a page property (such as a primary page, a secondary page, and the like) of the current interface in the application.
For example, the attribute information may be obtained by clicking a user to enter a terminal reading application program, clicking an article name list or a history record in a current interface to check to determine article content to be checked by the user, and then entering a corresponding article content interface to determine that the current interface attribute information is for article reading.
And 105, if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of the display screen of the terminal is located in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
Specifically, the interface architecture centered on the current interface may be determined according to the attribute information. For example, the interface set of the previous interface, the next interface, and the same level of the current interface is determined according to the attribute information, so as to obtain an interface architecture centered on the current interface. Then, switching from the current page to the target interface according to a first switching rule based on the determined interface architecture. For example, if the first rule is to perform a switchback in the same-level interfaces, based on the interface architecture, a position ranking of the current interface in the interface set at the same level as the current interface is determined, and the current interface is switchback to a corresponding interface in the same-level interfaces according to the position ranking.
In some embodiments, before switching the current interface to the target interface, the method may further include:
judging whether the time length of the pupil visual direction staying at the top end of the display screen is less than a first preset time threshold value or not; if not, switching the current interface to the target interface according to the first switching rule.
Wherein the first preset time threshold is set for the purpose of avoiding the occurrence of a malfunction condition. For example, the eyes turn from the display screen to another place to pass through the first preset angle interval or the second preset angle interval.
For example, the first preset time threshold may be set by a person skilled in the art, the first preset time threshold is set to 3 seconds, and when the time that the user stays at the top of the display screen in the pupil visual direction reaches 3 seconds, the current interface is switched to the target interface according to the first switching rule. The setting of the first switching rule may also be set by a person skilled in the art, for example, based on the setting of the angle value in step 103, which is not described in detail herein.
In some embodiments, after switching the current interface to the target interface, the method may further include:
and if the current interface is switched to the target interface according to the attribute information and a first switching rule, the information displayed at the top end of the current interface is consistent with the information displayed at the bottom end of the target interface.
The purpose of enabling the information displayed at the top end of the current interface to be consistent with the information content displayed on the target interface is that if the user switches the interfaces by the method, if the time that the sight line is lost on the display screen is too long due to calling around, when the user gazes the display screen again, the memory loss of the context of the previously read content can occur, and therefore the information displayed at the top end of the current interface is enabled to be consistent with the information content displayed on the target interface, and memory support can be provided for the user to read again.
In some embodiments, the first predetermined angle interval includes a plurality of angle segments; if the angle value is located in a first preset angle interval, switching the current interface to the target interface according to the attribute information and a first switching rule, which may include:
determining a target angle section in which the angle value is located from a plurality of angle sections; acquiring interface switching parameters corresponding to the target angle interval; and switching from the current interface to the target interface according to the interface switching parameter and the first switching rule.
And 106, if the angle value is located in a second preset angle interval, switching the current interface to a target interface according to a second switching rule according to the attribute information, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
In some embodiments, before switching the current interface to the target interface, the method may further include:
judging whether the time length of the pupil visual direction staying at the bottom end of the display screen is smaller than a first preset time threshold value or not; if not, switching the current interface to the target interface according to the second switching rule.
The setting of the second switching rule may be set by a person skilled in the art, for example, based on the setting of the angle value in step 103, which is not described in detail herein.
In some embodiments, after switching the current interface to the target interface, the method may further include:
and if the current interface is switched to the target interface according to the attribute information and a second switching rule, the information displayed at the bottom end of the current interface is consistent with the information content displayed at the top end of the target interface.
Similarly, this part is described in detail in step 105, and is not described in detail here.
In some embodiments, the second predetermined angle interval includes a plurality of angle segments; if the angle value is located in a second preset angle interval, switching the current interface to the target interface according to the attribute information and a second switching rule, which may include:
determining a target angle section in which the angle value is located from a plurality of angle sections; acquiring interface switching parameters corresponding to the target angle interval; and switching from the current interface to the target interface according to the interface switching parameter and the second switching rule.
In some embodiments, the interface switching method may further include:
judging whether the stay time of the pupil visual direction in the display area of the display screen is less than a second preset time threshold or not; if not, determining the application program to which the current interface belongs; and collecting the content displayed by the current interface into the application program in a specified format.
If the user reads the article according to the attribute information, that is, when the user reads the article, the content appearing in the article may be read again by the user or shared with another person for reading, which may be implemented by setting a second preset time threshold. For example, the second preset time threshold is set to 10 seconds, when the time that the user stays on the display screen in the pupil visual direction exceeds 10 seconds, the content displayed on the current interface may be stored in the reading application program in the form of a picture, or the content displayed on the current interface may be stored in a favorite of the reading application program in the form of a text.
The interface switching method provided by the embodiment comprises the following steps: firstly, starting a terminal camera device to acquire pupil image information of a current user; then, analyzing the image information to determine the visual direction of the pupil; then, calculating an angle value between the pupil visual direction and the display screen, and setting a first preset angle interval and a second preset angle interval; determining attribute information of a current interface; finally, if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of a display screen of the terminal is in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not in the visual range corresponding to the first preset angle interval; and if the angle value is located in a second preset angle interval, switching the current interface to the target interface according to the attribute information and a second switching rule, wherein the bottom end of the display screen of the terminal is in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not in the visual range corresponding to the first preset angle interval. The embodiment aims to judge the interface switching mechanism triggered by the user according to the setting of the corresponding visual range between the pupil vision of the user and the display screen, so that the purpose of using the eye function to turn pages in the application program is achieved, the defect that the application scene of manual page turning is limited is overcome, and the rate of using the application program to switch the interface by the user is improved.
The method described in the previous embodiment is further detailed by way of example.
The present embodiment will be described from the perspective of an interface switching device that is specifically integrated in a smartphone. Referring to fig. 3, an interface switching method includes the following specific steps:
In some embodiments, the type of the terminal camera device may be a front camera device installed in the same direction as the display screen of the terminal, or a side camera device installed in the side of the terminal and capable of extending and contracting to reach the same direction as the display screen, or a back camera device installed in the back of the terminal and capable of extending and contracting by rotating, and reaching the same defense line as the display screen.
And the user clicks a reading application program icon on the desktop of the mobile phone to enter the reading application program.
In some embodiments, the pupil image information captured by the terminal through the image capturing device is a light signal generated between the terminal display screen and the current pupil of the user by the image capturing device, and is converted into an electrical signal through analysis processing of the digital signal processor and the sensor, and the processed signal is transmitted to the terminal display screen to determine a visual range generated when the pupil of the user gazes at the terminal display screen, so as to obtain the pupil visual direction.
And step 203, calculating an angle value between the pupil visual direction and the display screen.
In some embodiments, the display screen may be divided into a first preset angle interval and a second preset angle interval by calculating an angle value between the pupil visual direction and the display screen, so as to trigger two mechanisms to perform interface switching processing on the current interface.
And step 204, determining the attribute information of the reading application program.
In some embodiments, the attribute information may be obtained by entering a reading application program of the terminal, determining the article content to be viewed by the user by clicking an article name list or a history record in the reading application program, and entering a corresponding article content interface, so that it is determined that the current interface attribute information is article reading.
And step 205, judging the angle interval to which the angle value belongs.
In some embodiments, the angle between the pupil visual direction and the top of the display screen may be set to 0 degree, that is, the pupil visual direction is focused on the top of the display screen in a head-up state, and the angle between the pupil visual direction and the middle of the display screen is set to a degree, at this time, the corresponding visual range is greater than or equal to 0 degree to less than a degree, and this area is set as the first preset angle interval. Similarly, the angle between the pupil visual direction and the middle end of the display screen is set as a degree, the angle between the pupil visual direction and the bottom end of the display screen is set as B degree, at this time, the corresponding visual range is from greater than or equal to a degree to less than or equal to B degree, and the area is set as a second preset angle interval.
In step 206, if the angle value is within the first predetermined angle range, the reading mode turns up the page.
In some embodiments, a situation may occur that may cause a malfunction, for example, an eye turning from the display screen to another location passes through the first predetermined angle interval or the second predetermined angle interval. Therefore, the first preset time threshold is set to avoid the occurrence of a malfunction condition.
For example, the first preset time threshold may be set by a person skilled in the art correspondingly, the first preset time threshold is set to 3 seconds, when the time that the pupil visual direction of the user stays at the top end of the display screen reaches 3 seconds, the current interface turns up one page, the number of pages turned over may also be set according to the angle value between the pupil visual direction of the user and the display screen, and specifically, the first preset time threshold may be set by the person skilled in the art correspondingly, and is not described herein again.
In some embodiments, similarly, the determination manner in step 207 is similar to that in step 206, and is not described herein again.
And step 208, saving the current reading interface.
In some embodiments, when the user reads the article, the content appearing in the article may occur when the user reads the article again or shares the article with another person to read the article, and the content may be read by setting the second preset time threshold. For example, the second preset time threshold is set to 10 seconds, when the time that the user stays on the display screen in the pupil visual direction exceeds 10 seconds, the content displayed on the current interface may be stored in the reading application program in the form of a picture, or the content displayed on the current interface may be stored in a favorite of the reading application program in the form of a text.
As can be seen from the above, the interface switching method provided by the embodiment of the present application may first start a mobile phone camera to obtain the pupil image information of the current user; then, analyzing the image information to determine the visual direction of the pupil; then, calculating an angle value between the pupil visual direction and the display screen, and setting a first preset angle interval and a second preset angle interval; determining attribute information of a current interface; and finally, judging that the angle value is positioned in a first or second preset angle range, and switching the current interface to a target interface according to the attribute information and corresponding rules. According to the method and the device, the interface switching mechanism triggered by the user is judged according to the setting of the corresponding visual range between the pupil vision of the user and the display screen, the eye function is used for turning the page, the defect that the application scene of manual page turning is limited is overcome, and the rate of interface switching by the user through the application program is improved.
In order to better implement the above method, an embodiment of the present application further provides an interface switching apparatus, as shown in fig. 4, which may include an opening unit 301, an analyzing unit 302, a calculating unit 303, a determining unit 304, a first switching unit 305, and a second switching unit 306, and specifically may be as follows:
(1) a starting unit 301;
the starting unit 301 is configured to start the image capturing apparatus to acquire pupil image information of the current user.
In some embodiments, the opening unit 301 may be specifically configured to capture the pupil image information of the current user when the terminal image capturing device needs to focus on the terminal display screen with the pupil of the user, and store the pupil image information.
(2) An analysis unit 302;
an analyzing unit 302, configured to analyze the image information and determine a pupil visual direction.
In some embodiments, the analysis unit 302 may be specifically configured to convert, by the imaging device, an optical signal generated between the terminal display screen and the current pupil of the user into an electrical signal through analysis processing of the digital signal processor and the sensor, and transmit the processed signal to the terminal display screen, so as to determine a visual range generated by the pupil of the user gazing at the terminal display screen, and obtain the pupil visual direction.
(3) A calculation unit 303;
and the calculating unit 303 is configured to calculate an angle value between the pupil visual direction and the display screen.
In some embodiments, the calculating unit 303 may be specifically configured to divide the display screen into two area ranges by calculating an angle value between the pupil visual direction and the display screen, so as to trigger two mechanisms to perform interface switching processing on the current interface.
The manner of calculating the angle value may refer to the foregoing method embodiments, and is not described herein again.
(4) A determination unit 304;
a determining unit 304, configured to determine attribute information of the current interface.
For example, the attribute information may be obtained by clicking to enter a reading application program of the terminal, clicking an article name list or a history record in the reading application program to check to determine article content to be checked by the user, and entering a corresponding article content interface, so that it is determined that the current interface attribute information is article reading.
(5) A first switching unit 305;
a first switching unit 305, configured to switch the current interface to a target interface according to a first switching rule according to the attribute information if the angle value is located in a first preset angle interval, where a top end of a display screen of the terminal is within a visual range corresponding to the first preset angle interval, and a bottom end of the display screen of the terminal is not within the visual range corresponding to the first preset angle interval.
Optionally, in some embodiments, as shown in fig. 5, the interface switching apparatus may further include a first determining unit 307:
the first judging unit 307 is configured to judge whether a time length of a pupil visual direction staying at the top end of the display screen is less than a first preset time threshold before the current interface is switched to the target interface; if not, switching the current interface to the target interface according to the first switching rule.
Optionally, in some embodiments, as shown in fig. 5, the interface switching apparatus may further include a first display unit 309:
after the current interface is switched to the target interface, the first display unit 309 is configured to, if the current interface is switched to the target interface according to the attribute information and according to a first switching rule, determine that the information displayed at the top end of the current interface is consistent with the information displayed at the bottom end of the target interface.
Optionally, in some embodiments, as shown in fig. 5, the first switching unit 305 may include a first determining subunit 3051, a first obtaining subunit 3052, and a first switching subunit 3053:
the first determining unit 3051, configured to determine a target angle segment in which the angle value is located from among the plurality of angle segments;
the first obtaining subunit 3052 is configured to obtain an interface switching parameter corresponding to the target angle interval;
the first switching subunit 3053 is configured to switch, according to the interface switching parameter and according to the first switching rule, from the current interface to the target interface.
(6) A second switching unit 306;
and a second switching unit 306, configured to switch the current interface to the target interface according to a second switching rule according to the attribute information if the angle value is located in a second preset angle interval, where a bottom end of a display screen of the terminal is within a visual range corresponding to the second preset angle interval, and a top end of the display screen of the terminal is not within the visual range corresponding to the first preset angle interval.
Optionally, in some embodiments, as shown in fig. 6, the interface switching apparatus may further include a second determining unit 308:
the second determining unit 308 determines whether the time length of the pupil visual direction staying at the bottom end of the display screen is less than a first preset time threshold before the current interface is switched to the target interface; if not, switching the current interface to the target interface according to the second switching rule.
Optionally, in some embodiments, as shown in fig. 6, the interface switching apparatus may further include a second display unit 310:
the second display unit 310 is configured to, after switching the current interface to the target interface, if the current interface is switched to the target interface according to the attribute information and according to a second switching rule, determine that the information displayed at the bottom of the current interface is consistent with the information displayed at the top of the target interface.
Alternatively, in some embodiments, as shown in fig. 6, the second switching unit 306 may include a second determining subunit 3061, a second obtaining subunit 3062, and a second switching subunit 3063:
the second determining subunit 3061, configured to determine a target angle segment at which the angle value is located from the plurality of angle segments;
the second obtaining subunit 3062 is configured to obtain the interface switching parameter corresponding to the target angle interval;
the second switching subunit 3063 is configured to switch from the current interface to the target interface according to the second switching rule according to the interface switching parameter.
Optionally, in some embodiments, as shown in fig. 5 or 6, the interface switching apparatus may further include a third determining unit 311:
the third determining unit 311 is configured to determine whether a duration of the pupil visual direction staying in the display area of the display screen is less than a second preset time threshold; if not, determining the application program to which the current interface belongs; and collecting the content displayed by the current interface into the application program in a specified format.
In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.
Correspondingly, an embodiment of the present application further provides a terminal 401, where the terminal 401 may be a smart phone or a tablet computer, as shown in fig. 7, the terminal 401 may include a central processing unit 402 having one or more processing cores, a memory 403 connected to the central processing unit 402 and including one or more computer-readable storage media, a display unit 404, a camera unit 405, and a power supply 406. Fig. 7 shows only some of the components of the terminal 401, but it is to be understood that not all of the shown components are required to be implemented, and that more or fewer components may be implemented instead. Wherein:
the Central Processing Unit 402 (CPU) is a control center of the terminal, connects various parts of the entire smart phone by using various interfaces and lines, and executes various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 403 and calling data stored in the memory 403, thereby integrally monitoring the smart phone.
The memory 403 may be used to store application software and various data installed in the terminal 401, thereby performing various functional applications and data processing. The memory 403 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created according to the use of the terminal 401, and the like.
The display unit 404 may be used to display information input by or provided to the user and various graphical user interfaces of the server, which may be made up of graphics, text, icons, video, and any combination thereof.
The terminal further includes a power supply 406 for supplying power to the various components, and preferably, the power supply 406 is logically connected to the central processor 402 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system.
The terminal 401 may further include an image capturing unit 405, where the image capturing unit 405 may be configured to acquire pupil image information of a current user, and specific functions refer to the foregoing embodiments and are not described herein again.
Specifically, in this embodiment, the central processing unit 402 in the terminal 401 loads the executable file corresponding to the process of one or more application programs into the memory 403 according to the following instructions, and the central processing unit 402 runs the application programs stored in the memory 403, so as to implement the following functions:
starting a camera device to acquire the pupil image information of the current user;
analyzing the image information and determining the visual direction of the pupil;
calculating an angle value between the pupil visual direction and the display screen;
determining attribute information of a current interface;
if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of a display screen of the terminal is located in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval;
and if the angle value is located in a second preset angle interval, switching the current interface to a target interface according to the attribute information and a second switching rule, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
The above operations can be referred to the previous embodiments specifically, and are not described herein again.
In the embodiment, when the user switches the interface, the user does not need to touch the display screen manually, and the interface switching mechanism triggered by the user is judged only according to the setting of the corresponding visual range between the pupil vision of the user and the display screen, so that the purpose of turning pages by using the eye function in the application program is realized, the defect that the application scene of manually turning pages is limited is technically overcome, and the rate of switching the interface by using the application program by the user is improved.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, the present application provides a storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a central processing unit to execute any of the steps provided in the present application, which are applied to the interface switching method. For example, the instructions may perform the steps of:
when the terminal starts a camera device to acquire the pupil image information of the current user; analyzing the image information and determining the visual direction of the pupil; calculating an angle value between the pupil visual direction and the display screen; determining attribute information of a current interface; if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule; and if the angle value is located in a second preset angle interval, switching the current interface to the target interface according to the attribute information and a second switching rule.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any interface switching method provided in the embodiments of the present application, beneficial effects that can be achieved by any interface switching method provided in the embodiments of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The interface switching method, the interface switching device, the storage medium and the terminal provided by the embodiment of the present application are described in detail above, a specific example is applied in the description to explain the principle and the implementation of the present application, and the description of the above embodiment is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, modifications may be made to the technical solutions described in the foregoing embodiments, or some technical features may be equivalently replaced; such modifications or substitutions do not depart from the spirit and scope of the present disclosure as defined by the appended claims.
Claims (10)
1. An interface switching method is applied to a terminal and is characterized by comprising the following steps:
starting a camera device to acquire the pupil image information of the current user;
analyzing the image information and determining the visual direction of the pupil;
calculating an angle value between the pupil visual direction and the display screen;
determining attribute information of a current interface;
if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, wherein the top end of a display screen of the terminal is located in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval;
and if the angle value is located in a second preset angle interval, switching the current interface to a target interface according to the attribute information and a second switching rule, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
2. The method of claim 1, further comprising, after the switching the current interface to the target interface:
if the current interface is switched to a target interface according to the attribute information and a first switching rule, the content of information displayed at the top end of the current interface is consistent with that of information displayed at the bottom end of the target interface;
and if the current interface is switched to the target interface according to the attribute information and a second switching rule, the information displayed at the bottom end of the current interface is consistent with the information content displayed at the top end of the target interface.
3. The method of claim 1, prior to said switching the current interface to the target interface, further comprising:
judging whether the time length of the pupil visual direction staying at the top end of the display screen is less than a first preset time threshold value or not;
if not, switching the current interface to a target interface according to the first switching rule;
judging whether the time length of the pupil visual direction staying at the bottom end of the display screen is smaller than a first preset time threshold value or not;
if not, switching the current interface to the target interface according to the second switching rule.
4. The method of claim 1, wherein the first preset angle interval comprises a plurality of angle segments; if the angle value is located in a first preset angle interval, switching the current interface to a target interface according to the attribute information and a first switching rule, including:
determining a target angle segment in which the angle value is located from the plurality of angle segments;
acquiring interface switching parameters corresponding to the target angle interval;
and switching from the current interface to the target interface according to the interface switching parameter and the first switching rule.
5. The method of claim 1, further comprising:
judging whether the stay time of the pupil visual direction in the display area of the display screen is less than a second preset time threshold or not;
if not, determining the application program to which the current interface belongs;
and collecting the content displayed by the current interface into the application program in a specified format.
6. An interface switching device is applied to a terminal and is characterized by comprising:
the starting unit is used for starting the camera device to acquire the pupil image information of the current user;
the analysis unit is used for analyzing the image information and determining the visual direction of the pupil;
the calculating unit is used for calculating the angle value between the pupil visual direction and the display screen;
the determining unit is used for determining the attribute information of the current interface;
the first switching unit is used for switching the current interface to a target interface according to the attribute information and a first switching rule if the angle value is located in a first preset angle interval, wherein the top end of a display screen of the terminal is in a visual range corresponding to the first preset angle interval, and the bottom end of the display screen of the terminal is not in the visual range corresponding to the first preset angle interval;
and the second switching unit is used for switching the current interface to the target interface according to a second switching rule according to the attribute information if the angle value is located in a second preset angle interval, wherein the bottom end of the display screen of the terminal is located in a visual range corresponding to the second preset angle interval, and the top end of the display screen of the terminal is not located in the visual range corresponding to the first preset angle interval.
7. The apparatus of claim 6, further comprising:
the first display unit is used for switching the current interface to a target interface according to the attribute information and a first switching rule, and then the information displayed at the top end of the current interface is consistent with the information displayed at the bottom end of the target interface;
and the second display unit is used for switching the current interface to the target interface according to the attribute information and a second switching rule, and then the information displayed at the bottom end of the current interface is consistent with the information displayed at the top end of the target interface.
8. The apparatus of claim 6, further comprising:
the first judging unit is used for judging whether the time length of the pupil visual direction staying at the top end of the display screen is less than a first preset time threshold value before the current interface is switched to the target interface; if not, switching the current interface to a target interface according to the first switching rule;
the second judging unit is used for judging whether the time length of the pupil visual direction staying at the bottom end of the display screen is less than a first preset time threshold value or not before the current interface is switched to the target interface; if not, switching the current interface to the target interface according to the second switching rule.
9. A computer-readable storage medium, characterized in that the storage medium stores a computer program adapted to be called by a central processing unit for performing the steps in the interface switching method according to any one of claims 1 to 5.
10. A terminal, comprising: a central processing unit and a memory; the memory stores a computer program, and the central processing unit is used for executing the steps in the interface switching method according to any one of claims 1 to 5 by calling the computer program stored in the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910873047.1A CN110673724A (en) | 2019-09-16 | 2019-09-16 | Interface switching method and device, storage medium and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910873047.1A CN110673724A (en) | 2019-09-16 | 2019-09-16 | Interface switching method and device, storage medium and terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110673724A true CN110673724A (en) | 2020-01-10 |
Family
ID=69078413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910873047.1A Pending CN110673724A (en) | 2019-09-16 | 2019-09-16 | Interface switching method and device, storage medium and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110673724A (en) |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101291364A (en) * | 2008-05-30 | 2008-10-22 | 深圳华为通信技术有限公司 | Interaction method and device of mobile communication terminal, and mobile communication terminal thereof |
| CN101377738A (en) * | 2007-08-27 | 2009-03-04 | 汉王科技股份有限公司 | Method for implementing page turning of electric document |
| TW201005651A (en) * | 2008-07-24 | 2010-02-01 | Utechzone Co Ltd | Page-turning method for electronic document through eyeball control and system thereof, pupil position determination method and pupil analysis module |
| CN102081503A (en) * | 2011-01-25 | 2011-06-01 | 汉王科技股份有限公司 | Electronic reader capable of automatically turning pages based on eye tracking and method thereof |
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN103197755A (en) * | 2012-01-04 | 2013-07-10 | 中国移动通信集团公司 | Page turning method, device and terminal |
| CN104635929A (en) * | 2015-01-30 | 2015-05-20 | 深圳市中兴移动通信有限公司 | Page turning method and device based on camera |
| CN106598257A (en) * | 2016-12-23 | 2017-04-26 | 北京奇虎科技有限公司 | Mobile terminal-based reading control method and apparatus |
| CN107122102A (en) * | 2017-04-27 | 2017-09-01 | 维沃移动通信有限公司 | A kind of flipping-over control method and mobile terminal |
| CN107329663A (en) * | 2017-05-17 | 2017-11-07 | 江苏大学 | A kind of vehicle-mounted interface display method for being used to improve driving safety |
| CN107506751A (en) * | 2017-09-13 | 2017-12-22 | 重庆爱威视科技有限公司 | Advertisement placement method based on the dynamic control of eye |
| CN107608514A (en) * | 2017-09-20 | 2018-01-19 | 维沃移动通信有限公司 | Information processing method and mobile terminal |
| CN107943280A (en) * | 2017-10-30 | 2018-04-20 | 深圳市华阅文化传媒有限公司 | The control method and device of e-book reading |
| CN108874906A (en) * | 2018-05-25 | 2018-11-23 | 维沃移动通信有限公司 | A kind of information recommendation method and terminal |
| CN109240495A (en) * | 2018-08-23 | 2019-01-18 | 上海连尚网络科技有限公司 | A kind of method and apparatus controlling automatic page turning |
| CN109933205A (en) * | 2019-03-25 | 2019-06-25 | 一汽轿车股份有限公司 | A kind of vehicle-mounted expression in the eyes interactive device |
| CN110231871A (en) * | 2019-06-14 | 2019-09-13 | 腾讯科技（深圳）有限公司 | Page reading method, device, storage medium and electronic equipment |
-
2019
- 2019-09-16 CN CN201910873047.1A patent/CN110673724A/en active Pending
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101377738A (en) * | 2007-08-27 | 2009-03-04 | 汉王科技股份有限公司 | Method for implementing page turning of electric document |
| CN101291364A (en) * | 2008-05-30 | 2008-10-22 | 深圳华为通信技术有限公司 | Interaction method and device of mobile communication terminal, and mobile communication terminal thereof |
| TW201005651A (en) * | 2008-07-24 | 2010-02-01 | Utechzone Co Ltd | Page-turning method for electronic document through eyeball control and system thereof, pupil position determination method and pupil analysis module |
| CN102822771A (en) * | 2010-01-21 | 2012-12-12 | 托比技术股份公司 | Eye tracker based contextual action |
| CN102081503A (en) * | 2011-01-25 | 2011-06-01 | 汉王科技股份有限公司 | Electronic reader capable of automatically turning pages based on eye tracking and method thereof |
| CN103197755A (en) * | 2012-01-04 | 2013-07-10 | 中国移动通信集团公司 | Page turning method, device and terminal |
| CN104635929A (en) * | 2015-01-30 | 2015-05-20 | 深圳市中兴移动通信有限公司 | Page turning method and device based on camera |
| CN106598257A (en) * | 2016-12-23 | 2017-04-26 | 北京奇虎科技有限公司 | Mobile terminal-based reading control method and apparatus |
| CN107122102A (en) * | 2017-04-27 | 2017-09-01 | 维沃移动通信有限公司 | A kind of flipping-over control method and mobile terminal |
| CN107329663A (en) * | 2017-05-17 | 2017-11-07 | 江苏大学 | A kind of vehicle-mounted interface display method for being used to improve driving safety |
| CN107506751A (en) * | 2017-09-13 | 2017-12-22 | 重庆爱威视科技有限公司 | Advertisement placement method based on the dynamic control of eye |
| CN107608514A (en) * | 2017-09-20 | 2018-01-19 | 维沃移动通信有限公司 | Information processing method and mobile terminal |
| CN107943280A (en) * | 2017-10-30 | 2018-04-20 | 深圳市华阅文化传媒有限公司 | The control method and device of e-book reading |
| CN108874906A (en) * | 2018-05-25 | 2018-11-23 | 维沃移动通信有限公司 | A kind of information recommendation method and terminal |
| CN109240495A (en) * | 2018-08-23 | 2019-01-18 | 上海连尚网络科技有限公司 | A kind of method and apparatus controlling automatic page turning |
| CN109933205A (en) * | 2019-03-25 | 2019-06-25 | 一汽轿车股份有限公司 | A kind of vehicle-mounted expression in the eyes interactive device |
| CN110231871A (en) * | 2019-06-14 | 2019-09-13 | 腾讯科技（深圳）有限公司 | Page reading method, device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107493495B (en) | Interactive position determining method, system, storage medium and intelligent terminal | |
| CN111654629B (en) | Camera switching method and device, electronic equipment and readable storage medium | |
| US9612665B2 (en) | Information processing apparatus and method of controlling the same | |
| CN112866576B (en) | Image preview method, storage medium and display device | |
| CN111601066B (en) | Information acquisition method and device, electronic equipment and storage medium | |
| CN108668086B (en) | Automatic focusing method and device, storage medium and terminal | |
| CN111970456B (en) | Shooting control method, device, equipment and storage medium | |
| KR20210042952A (en) | Image processing method and device, electronic device and storage medium | |
| CN110636218B (en) | Focusing method, focusing device, storage medium and electronic equipment | |
| CN110248241B (en) | Video processing method and related device | |
| CN107835370A (en) | Camera switching method and device and electronic equipment | |
| JP2015232811A (en) | Display device and digital camera | |
| CN108920121A (en) | Control method, device and computer readable storage medium based on multi-screen terminal | |
| CN111970437B (en) | Text shooting method, wearable device and storage medium | |
| CN110677580B (en) | Shooting method, shooting device, storage medium and terminal | |
| JP6283329B2 (en) | Augmented Reality Object Recognition Device | |
| CN113037999A (en) | Shooting method and device, mobile terminal and storage medium | |
| CN112672058B (en) | Shooting method and device | |
| CN114079729B (en) | Shooting control method, shooting control device, electronic equipment and storage medium | |
| CN106851052B (en) | Control method and electronic equipment | |
| CN113866782A (en) | Image processing method and device and electronic equipment | |
| CN110673724A (en) | Interface switching method and device, storage medium and terminal | |
| CN113891002B (en) | Shooting method and device | |
| CN112653841B (en) | Shooting method and device and electronic equipment | |
| CN112153291B (en) | Photographing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200110 |
|
| RJ01 | Rejection of invention patent application after publication |