CN116360905B

CN116360905B - Tablet personal computer device based on ink screen, control method, system and medium

Info

Publication number: CN116360905B
Application number: CN202310270986.3A
Authority: CN
Inventors: 王亦方; 郑黎明; 赵小刚
Original assignee: Shenzhen Oudu Lifang Technology Co ltd
Current assignee: Shenzhen Oudu Lifang Technology Co ltd
Priority date: 2023-03-20
Filing date: 2023-03-20
Publication date: 2024-04-09
Anticipated expiration: 2043-03-20
Also published as: CN116360905A

Abstract

The embodiment of the specification provides a tablet computer device based on an ink screen, which comprises an electronic ink screen, wherein the electronic ink screen can be used for displaying picture information, displaying cache and storing data of the picture information; the electronic ink screen comprises a screen device, a screen display module and a screen display module, wherein the screen display module is used for displaying screen information, and the screen display module is used for displaying screen information.

Description

Tablet personal computer device based on ink screen, control method, system and medium

Technical Field

The present disclosure relates to the field of ink screen display technologies, and in particular, to a tablet computer device, a control method, a system, and a medium based on an ink screen.

Background

The electronic ink screen is a screen using electronic ink. Various terminal devices using electronic ink screens have become increasingly popular. The electronic ink screen is mainly used for reading the scenes with more static pictures, and in the using process, the conditions of low screen refreshing speed, poor dynamic display effect and the like easily occur, so that the using experience of a user is affected.

Therefore, it is desirable to provide an ink screen-based tablet computer device and a control method, which can match different screen states with different refresh rates, and provide better display effects.

Disclosure of Invention

One or more embodiments of the present specification provide an ink screen-based tablet computer device, the system comprising: the electronic ink screen is used for displaying picture information; a display buffer memory for storing the data of the picture information; and the refreshing control module is used for controlling the refreshing speed of the data of the picture information on the electronic ink screen, and the refreshing speed is determined at least based on the basic information or the picture information of the tablet computer device.

One or more embodiments of the present disclosure provide a method for controlling an ink screen-based tablet computer, the method being performed by a refresh control module of the ink screen-based tablet computer device, including: determining a refresh rate of data of the picture information on a display module based at least on basic information or picture information of the tablet computer device; and displaying the picture information based on the display module and the refresh rate.

One or more embodiments of the present disclosure provide an ink screen-based tablet computer system including a processor for executing the method of controlling an ink screen-based tablet computer device as in any one of the above embodiments.

One of the embodiments of the present disclosure provides a computer-readable storage medium storing computer instructions that, when read by a computer, perform the method for controlling an ink screen-based tablet computer device according to any one of the embodiments.

Drawings

The present specification will be further elucidated by way of example embodiments, which will be described in detail by means of the accompanying drawings. The embodiments are not limiting, in which like numerals represent like structures, wherein:

FIG. 1 is an exemplary schematic diagram of an ink screen based tablet computer device according to some embodiments of the present description;

FIG. 2 is an exemplary flowchart of a method of controlling an ink screen based tablet computer according to some embodiments of the present description;

FIG. 3 is an exemplary diagram of determining a refresh rate based on basic information as shown in some embodiments of the present description;

FIG. 4 is an exemplary flow chart for determining refresh sub-rates based on picture information according to some embodiments of the present description;

FIG. 5 is an exemplary schematic diagram of a sub-region refresh determination model shown in accordance with some embodiments of the present description;

FIG. 6 is an exemplary flow chart for determining refresh sub-rates based on region type according to some embodiments of the present description.

Description of the embodiments

In order to more clearly illustrate the technical solutions of the embodiments of the present specification, the drawings that are required to be used in the description of the embodiments will be briefly described below. It is apparent that the drawings in the following description are only some examples or embodiments of the present specification, and it is possible for those of ordinary skill in the art to apply the present specification to other similar situations according to the drawings without inventive effort. Unless otherwise apparent from the context of the language or otherwise specified, like reference numerals in the figures refer to like structures or operations.

It will be appreciated that "system," "apparatus," "unit" and/or "module" as used herein is one method for distinguishing between different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

As used in this specification and the claims, the terms "a," "an," "the," and/or "the" are not specific to a singular, but may include a plurality, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that the steps and elements are explicitly identified, and they do not constitute an exclusive list, as other steps or elements may be included in a method or apparatus.

A flowchart is used in this specification to describe the operations performed by the system according to embodiments of the present specification. It should be appreciated that the preceding or following operations are not necessarily performed in order precisely. Rather, the steps may be processed in reverse order or simultaneously. Also, other operations may be added to or removed from these processes.

Fig. 1 is an exemplary schematic diagram of an ink screen based tablet device according to some embodiments of the present description.

The ink screen based tablet device 100 may include an electronic ink screen 110, a display cache 120, a refresh control module 130, a pose sensor 140, a motion sensor 150, and a positioning module 160.

Electronic ink screen 110 may be used to display visual information. For more explanation of the picture information and how the picture information is displayed, see fig. 1 and its related description. The electronic ink screen comprises electronic ink. Electronic ink may be formed as a film comprised of a multitude of microcapsules having differently charged pigment particles therein. In the initial state, pigment particles are suspended in microcapsules. When an electric field in a certain direction is applied, the corresponding pigment particles are pushed to the top, and the microcapsules display different colors. The microcapsules of different colors can form various characters and patterns.

The display buffer 120 may be used to store data of picture information. In some embodiments, the display cache may include one or more storage components, such as Dynamic Random Access Memory (DRAM) and the like. In some embodiments, the data of the picture information may be stored in the display buffer in the form of a buffer queue. The buffer queue may include a plurality of frames of consecutive picture information data. In some embodiments, the display cache and the electronic ink screen may be collectively referred to as a display module, which may display visual information in conjunction with refresh rates. For more explanation of how picture information is displayed in conjunction with refresh rates, see fig. 1 and its associated description.

The refresh control module 130 may be configured to control a refresh rate of data of the screen information on the electronic ink screen. Refresh control module 130 may be electrically coupled to electronic ink screen 110, display buffer 120, pose sensor 140, motion sensor 150, and positioning module 160 to access and receive information and/or data to determine a refresh rate. For example, the refresh control module may determine a refresh rate of data of the screen information at the display module (e-ink screen, display cache) based at least on basic information or screen information of the tablet computer device. For more explanation on determining refresh rate, see fig. 2 and its associated description. For another example, the refresh control module may determine the refresh rate based on pose information acquired by the pose sensor, based on motion information acquired by the motion sensor, and based on position information acquired by the positioning module. For more explanation of determining a refresh rate based on the above information, see fig. 3 for a description thereof.

The pose sensor 140 may be used to obtain pose information of the electronic ink screen based tablet device. The pose sensors may be distributed at one or more points within the tablet device. For more explanation of pose information, see fig. 3 and its associated description.

The motion sensor 150 may be used to obtain motion information of the electronic ink screen based tablet device. The motion sensors may be distributed at one or more points within the tablet device. For more explanation of motion information see fig. 3 and its associated description.

The positioning module 160 may be used to determine location information for electronic ink screen based tablet devices. The positioning module may determine the location information by means such as satellite positioning. The positioning module may be distributed at one or more points within the tablet device. The positioning module can collect information of the location of the tablet computer device in real time and convert the information into position information. For more description of location information see fig. 3 and its associated description.

It should be understood that the apparatus shown in fig. 1 and its modules may be implemented in various ways. It should be noted that the above description of the tablet computer device 100 and its modules based on the ink screen is for convenience of description only, and the present disclosure should not be limited to the scope of the embodiments. It will be appreciated by those skilled in the art that, given the principles of the system, various modules may be combined arbitrarily or a subsystem may be constructed in connection with other modules without departing from such principles. In some embodiments, the electronic ink screen 110, the display buffer 120, the refresh control module 130, the pose sensor 140, the motion sensor 150, and the positioning module 160 disclosed in fig. 1 may be different modules in one device, or may be one module to implement the functions of two or more modules. For example, each module may share one memory module, or each module may have a respective memory module. Such variations are within the scope of the present description. It will be appreciated by those skilled in the art that, given the principles of the apparatus, it is possible to combine individual components arbitrarily or to construct a sub-apparatus in connection with other components without departing from such principles.

Fig. 2 is an exemplary flowchart of a method of controlling an ink screen based tablet computer according to some embodiments of the present description. As shown in fig. 2, the process 200 includes the following steps. In some embodiments, the process 200 may be performed by a refresh control module.

Step 210, determining a refresh rate of data of the screen information on the display module based at least on the basic information or the screen information of the tablet computer device.

For further description of tablet computer devices, see fig. 1 and its associated description.

The base information may reflect a current state of the tablet computer device, e.g., whether the tablet computer device is powered on, a current location of the tablet computer device, etc.

In some embodiments, the base information includes at least one of pose information, motion information, and position information of the tablet computer device. For more description about pose information, motion information and position information, see fig. 3 and its associated description.

The screen information refers to related image information displayed in a display module of the tablet computer device, for example, system information (e.g., system prompts, etc.), web page information (e.g., news website pages, etc.), application information (e.g., document applications, etc.), locally stored information (e.g., downloaded novels, videos, etc.), and the like. For more description of the display module, see fig. 1 and its associated description.

In some embodiments, the data of the picture information may be stored in a display buffer. The data of the picture information may be generated in real time by a processing module of the tablet computer device. For more description of the display cache and processing module, see FIG. 1 and its associated description.

The refresh rate refers to the number of updates of the picture information per unit time. For example, the refresh rate is 60Hz, which means that the picture information is updated 60 times in 1 second. It can be appreciated that the higher the refresh rate, the smoother the screen information displayed on the tablet device.

In some embodiments, the refresh control module may determine a refresh rate of data of the picture information at the display module based at least on basic information or picture information of the tablet computer device.

In some embodiments, the refresh control module may determine the refresh rate based on pose information, motion information, and position information. For more explanation of determining a refresh rate based on pose information, motion information, and position information, see fig. 3 and its associated description.

In some embodiments, the refresh control module may identify rectangles and partitions based on the picture information, resulting in at least one sub-region; and determining a refresh sub-rate for each sub-region of the at least one sub-region based on the image characteristics of the at least one sub-region. For more explanation of determining the refresh sub-rate of a sub-region, see fig. 4 and its associated description.

In some embodiments, the refresh control module may also determine the refresh rate by other manners, such as setting a default refresh rate according to historical data, establishing a correspondence between different times and different refresh rates, and the like, which is not limited herein.

Step 220, displaying the frame information based on the display module in combination with the refresh rate.

In some embodiments, the refresh control module may display the picture information based on the display module in conjunction with the refresh rate. The refresh control module may issue a corresponding data command based on the determined refresh rate. The display module can refresh and display the latest picture information at a corresponding refresh rate in the data instruction based on the data instruction. The display module may include an electronic ink screen and a display cache, and further description of the electronic ink screen, the display cache, and the display module may be found in fig. 1 and related description thereof.

According to the method disclosed by some embodiments of the specification, through determining the basic information and the picture information of the tablet personal computer device, the refreshing speed of the electronic ink screen can be intelligently determined from the angle of the external use environment and the angle of the internal display content, so that the user requirements under different use scenes and the display requirements of different picture contents can be met, the use smoothness of the electronic ink screen is improved, the display effect of the electronic ink screen is optimized, and the user experience of the tablet personal computer device based on the ink screen is improved.

FIG. 3 is an exemplary diagram illustrating a determination of refresh rate based on basic information according to some embodiments of the present description.

In some embodiments, the refresh control module may determine a refresh rate of data of the screen information at the display module based on the basic information of the tablet computer device. As shown in fig. 3, the refresh control module may determine the refresh rate 304 based on pose information 301, motion information 302, and position information 303 of the tablet device 100.

The pose information may reflect a pose condition of the tablet computer device, for example, a placement angle (e.g., a screen-up placement, etc.) of the tablet computer device, and so on. In some embodiments, the pose information may be acquired by a pose sensor. For more explanation about the pose sensor, see fig. 1 and its related description.

The motion information may reflect a motion state of the tablet computer device, for example, whether the tablet computer device is moving, a moving speed, and a moving direction. In some embodiments, the motion information may be acquired by a motion sensor. For more description of motion sensors see fig. 1 and its associated description.

The location information may reflect information of a location of the tablet computer device, for example, address information of the location, longitude and latitude information of the location, and the like. In some embodiments, the location information may be obtained based on a positioning module. For more description of the positioning module, see fig. 1 and its associated description.

In some embodiments, the pose information, motion information, and position information may be a sequence of values for which the pose information, motion information, and position information correspond at a plurality of consecutive times. For example, the pose information may be represented as a sequence (x ₁ ，x ₂ ，x ₃ ,..), wherein x ₁ ，x ₂ ，x ₃ ,. it is possible to represent pose information corresponding to each of a plurality of successive moments. The motion information and the position information may be represented based on a sequence of motion information and position information at corresponding times, and the representation is similar.

In some embodiments, the refresh control module may determine a recommended refresh rate corresponding to a usage scenario based on the usage scenario of the tablet device.

The use scene refers to the current use occasion and application of the tablet computer device. Such as daily work, game play, public transportation use, etc. The recommended refresh rate refers to the refresh rate that is most appropriate for the current use scenario of the tablet device.

In some embodiments, the refresh control module may preset the correspondence between different usage scenarios and recommended refresh rates based on historical empirical data, system defaults, and the like. The historical experience data may be summarized and fed back based on data of the user (e.g., a tablet device tester, a tablet device user, etc.) in actual use.

In some embodiments, the refresh control module may build a first vector database based on the base information and the recommended refresh rate of the tablet device. The first vector database refers to a sum recommended refresh rate database for storing, indexing, and querying tablet reference feature vectors of the tablet computer device. Through the first vector database, similarity queries and other vector management can be quickly performed against a large number of flat panel reference feature vectors.

Specifically, the refresh control module may previously establish a corresponding tablet reference feature vector based on historical pose information, historical motion information, and historical position information of the tablet computer device. For example, the tablet reference feature vector may be represented as s= (x, y, z), which may represent pose information, motion information, and position information of the tablet device at one or more consecutive times in the historical time, respectively. When representing pose information, motion information, and position information for a plurality of consecutive moments, x, y, z may all be sequences.

The refresh control module can determine the recommended refresh rate corresponding to the flat-panel reference feature vector according to the actual usage scenario of the flat-panel reference feature vector and the corresponding relation between the different usage scenarios and the recommended refresh rate.

For example, the refresh control module may build a first vector database based on the tablet reference feature vector and the corresponding recommended refresh rate. The first vector database may be exemplarily represented in the form of table 1.

Flat reference feature vector	Recommended refresh rate
		s1	v1
s2	v2
		s3	v3
…	…

TABLE 1 exemplary representation of a first vector database

In some embodiments, the refresh control module may construct a corresponding tablet to be measured feature vector based on pose information, motion information, and position information of the current tablet computer device, and the construction manner may be similar to that of the tablet reference feature vector.

In some embodiments, the refresh control module may calculate a first evaluation value for each panel reference feature vector in the first vector database based on the panel test feature vector. In some embodiments, the first evaluation value may be a similarity of the flat panel reference feature vector and the flat panel feature vector to be measured. The similarity may be determined based on a vector distance (e.g., euclidean distance, chebyshev distance, etc.) of the panel reference feature vector and the panel feature vector to be measured. It can be understood that the smaller the vector distance is, the greater the similarity between the vectors is, and the greater the first evaluation value corresponding to the flat reference feature vector is.

When the first evaluation value of a certain panel reference feature vector meets a preset requirement, the refresh control module can take the corresponding recommended refresh rate of the panel reference feature vector as the current refresh rate. For example, the preset requirement is that the first evaluation value be maximum. At this time, the refresh control module may use the recommended refresh rate corresponding to the panel reference feature vector with the largest first evaluation value as the refresh rate of the current panel feature vector to be tested.

It should be understood that, the larger the first evaluation value of the flat reference feature vector based on the flat reference feature vector to be measured, the closer the usage scene of the flat reference feature vector is to the current usage scene of the flat reference feature vector, so that the refresh rate corresponding to the flat reference feature vector is more suitable for the current usage scene, thereby further meeting the usage requirement of the user and improving the usage experience of the user on the tablet computer device.

According to the method, the current use scene of the tablet computer device is determined through determining the pose information, the motion information and the position information, and the refresh rate is determined according to the use scene, so that the user requirements under different use scenes can be met, and the user experience of the tablet computer device based on the ink screen is improved.

FIG. 4 is an exemplary flow chart for determining refresh sub-rates based on picture information according to some embodiments of the present description. As shown in fig. 4, the process 400 includes the following steps. In some embodiments, the process 400 may be performed by a refresh control module.

Based on the picture information, the rectangle is identified and partitioned to obtain at least one sub-area, step 410.

The sub-region refers to a partial display region in the picture information. For example, the sub-region may be a functional region (e.g., battery power display region, date display region, etc.), an application window (e.g., text editor window), a system information prompt pop-up window (e.g., screen unlock password error prompt), etc. For another example, the sub-region may be a region that does not display any information. For example, a desktop background displayed in a display module. It will be appreciated that in most cases the shape of the sub-regions is at least one of rectangular, rounded rectangular or polygonal consisting of rectangles, etc.

In some embodiments, the refresh control module may identify rectangles and partitions based on the picture information, resulting in at least one sub-region. The rectangle identification method can identify a plurality of straight line sides through continuous consistent pixels and pixel differences based on a pixel comparison method, and then the rectangle is determined through the plurality of straight line sides. The refresh control module may partition the picture information based on the determined rectangle to obtain at least one sub-area. The sub-region may be a region inside the rectangle or a region outside the rectangle.

In some embodiments, the refresh control module may continuously partition the picture information based on different or the same time intervals. The time interval refers to the length of time between two consecutive partition operations of the picture information. It will be appreciated that the smaller the time interval in which the partitioning operation is performed consecutively, the higher the frequency of the partitioning operation.

In some embodiments, the refresh control module may use the proportion of the area of each sub-region to the area of the entire electronic ink screen as the identification weight w of each sub-region. The current refresh sub-rate for each sub-region is f. For more description of refresh sub-rate, see step 420 and its associated description, below. The refresh control module may weight sum the current refresh sub-rate for each sub-region to obtain Σwf. When Σwf is larger than a first preset value, the refresh control module can adopt a first time interval to partition; when Σwf is greater than a second preset value, the refresh control module may partition with a second time interval, where the second threshold is greater than the first threshold and the second time interval is less than the first time interval. The refresh control module may set a first preset value, a second preset value, a first time interval, and a second time interval based on historical empirical data, system defaults, and the like.

In some embodiments, the refresh control may determine different time intervals depending on the usage scenario. For example, where the usage scenario is game play, the refresh control module may use a smaller time interval (e.g., the first time interval described above). The refresh control module may use a larger time interval (e.g., the aforementioned second time interval) when the usage scenario is daily office. In some embodiments, the refresh control module may determine the usage scenario based on the aforementioned first vector database, or may be entered or selected by the user at his/her discretion.

Step 420, determining a refresh sub-rate for each sub-region of the at least one sub-region based on image characteristics of the at least one sub-region.

The image features may reflect relevant features of the displayed picture information within the sub-area. Image features may include color features, text features, and the like. In some embodiments, the image characteristics of the sub-regions may be determined by image recognition of the sub-regions. Image recognition may be implemented by various algorithms such as Convolutional Neural Network (CNN), character recognition (OCR), openCV, and the like. In some embodiments, different sub-regions may have different image features.

The refresh sub-rate refers to a refresh rate of the picture information displayed in the sub-region. In some embodiments, different sub-regions may have different refresh sub-speeds, and the partitions may be refreshed.

In some embodiments, the refresh control module may determine a refresh sub-rate for each sub-region based on image characteristics of at least one sub-region. Specifically, the refresh control module may determine whether each sub-region requires a refresh based on image characteristics of at least one sub-region, thereby determining a refresh sub-rate for each sub-region.

In some embodiments, the refresh control module may determine whether each sub-region needs to be refreshed based on the amount of pixel variation, thereby determining a refresh sub-rate for each sub-region. The pixel variation may reflect the degree of difference between the plurality of pictures, and a larger pixel variation indicates a larger difference between the plurality of pictures. In some embodiments, the amount of pixel variation may be determined by comparing pixels between multiple pictures. The pixels of the individual pictures can be determined by the aforementioned image characteristics.

Specifically, the refresh control module may store the image information data received in real time in the buffer queue, compare at least one sub-area in the latest frame of image in the buffer queue with the static image currently displayed by the corresponding sub-area in real time, and determine the pixel variation amounts of the sub-area and the static image. When the pixel variation exceeds a first preset threshold, it indicates that at least one sub-area in the latest frame of picture in the buffer queue has a larger difference from the current display still picture of the corresponding sub-area, and at this moment, the picture information currently displayed by the corresponding sub-area needs to be refreshed once, and the refresh control module can save the latest frame of picture to the display module (e.g. display buffer) for display. Wherein the first preset threshold may be a human experience value, a system default value, etc., or any combination thereof.

In some embodiments, the refresh control module may determine the total amount of pixel color change and the number of pixels that change by comparing the pixels of at least one sub-region in the picture of the latest frame in the buffer queue with the pixels of the still picture currently displayed by the corresponding sub-region, and perform weighted summation on the total amount of pixel color change and the number of pixels that change to determine the amount of pixel change. Illustratively, the pixel variation amount can be calculated by the following formula (1):

K=m(Σ)+ n （1）

where K represents the pixel variation, represents the color variation of a single pixel, m represents the corresponding weight of the total amount of pixel color variation, represents the number of pixels that are changed, and n represents the corresponding weight of the number of pixels that are changed.

It can be understood that if the pixel variation between at least one sub-region in each frame of picture in the buffer queue and the corresponding sub-region of the previous frame of picture exceeds the first preset threshold, it is indicated that each frame of picture in the buffer queue should be used as the latest displayed picture, and at this time, the refresh sub-speed of the sub-region can be set faster. If a frame of picture in the buffer queue needs to be separated by a plurality of frames (e.g. 20 frames), the pixel variation of at least one sub-region of a frame of picture and the corresponding sub-region of the frame of picture exceeds a first preset threshold, it is indicated that the picture information of the corresponding sub-region needs to be refreshed once by a plurality of frames, and at this time, the refresh sub-speed of the sub-region can be set slower.

In some embodiments, the refresh control module may also determine whether each sub-region needs to be refreshed based on pixel similarity, thereby determining a refresh sub-rate for each sub-region. The pixel similarity may reflect a degree of similarity between the plurality of pictures, and a larger pixel similarity indicates a more similar picture between the plurality of pictures.

In some embodiments, the refresh control module may compare, in real time, pixel similarity between at least one sub-region pixel in the picture of the latest frame and a pixel of the still picture currently displayed by the corresponding sub-region through the sub-region refresh judgment model, and determine the sub-region to be refreshed.

In some embodiments, the sub-region refresh determination model is a machine learning model. The subarea refreshing model at least comprises an OCR similarity algorithm layer, a Logistic regression algorithm parameter layer and the like.

As shown in fig. 5, the input of the sub-region refresh determination model 530 may include the pixel 510 of at least one sub-region after the partitioning in the latest frame of picture in the buffer queue and the pixel 520 of the static picture currently displayed by the corresponding sub-region after the partitioning, and the output may be the sub-region 540 that needs to be refreshed in the at least one sub-region.

The refresh control module may train the initial sub-region refresh determination model based on sets of labeled training samples. Each set of training samples may include pixels of at least one sub-region of the sample after partitioning in any one frame of the sample buffer queue and pixels of a corresponding sub-region of the sample still picture after partitioning. The labels of each group of training samples can be the pixel similarity of the pixels of at least one sample sub-region after partitioning in any frame of picture in the sample buffer queue and the pixels of the corresponding sub-region after partitioning in the sample static picture, and the judgment result after comparing with a second preset threshold value. When the pixel similarity between the corresponding areas is greater than or equal to a second preset threshold, the label may be 1; when the pixel similarity between the corresponding regions is smaller than the second preset threshold, the label may be 0. The second preset threshold may be a human experience value, a system default value, or the like, or any combination thereof.

The refreshing control module can input the training sample into the initial sub-region refreshing judgment model, construct a loss function based on the output of the initial sub-region refreshing judgment model and the label of the training sample, iteratively update the parameters of the initial sub-region refreshing judgment model based on the loss function, and when the trained model meets the preset condition, the training is finished, and the trained sub-region refreshing judgment model is obtained. The preset conditions may include, but are not limited to, the loss function converging, the loss function value being less than a preset value, or the number of training iterations reaching a threshold, etc.

In some embodiments, the refresh control module may also determine the pixel similarity by other manners, such as establishing a relationship of a number of correlations to calculate the pixel similarity, and the like, which is not limited herein.

In some embodiments, the refresh sub-rate for a sub-region may be related to the number of times the sub-region refresh determination model outputs for that sub-region over a certain period of time (e.g., within 1 minute). The more outputs of the sub-region, the faster the refresh sub-speed. It can be understood that if the sub-region refresh determination model outputs the same sub-region multiple times within a certain period of time, it indicates that the sub-region needs to be refreshed frequently, and the refresh sub-speed of the sub-region is faster. If the sub-region refreshing model needs to output a certain sub-region at intervals, the sub-region picture information is refreshed once at intervals, and the refreshing sub-speed of the sub-region is slower.

In some embodiments, the refresh control module may determine the statistical feature based on image features within at least one sub-region; determining a region type of each sub-region based on the statistical features; and determining a refresh sub-rate for each of the sub-regions based on the region type. For more description of determining statistical features and determining refresh sub-rates based on region type, see fig. 6 and its associated description.

According to the method disclosed by some embodiments of the specification, the screen is partitioned by determining the screen information actually displayed by the tablet computer device, and the refresh sub-speed of different sub-areas is further determined, so that the refresh of different speeds can be performed according to different conditions of different sub-areas, and the display requirements of different sub-areas are met.

FIG. 6 is an exemplary flow chart for determining refresh sub-rates based on region type according to some embodiments of the present description. As shown in fig. 6, the process 600 includes the following steps. In some embodiments, the process 300 may be performed by a management module.

At step 610, statistical features are determined based on image features within at least one sub-region.

Statistical features refer to the number and nature of one or more features in an image. In some embodiments, the statistical features may include the number of words, word coverage, object distribution, etc. The word coverage may refer to the ratio of the total number of pixels of the word in a certain region to be counted to the total number of pixels in the region. The distribution of objects may include the number of various objects (e.g., humans, animals, plants, etc.) contained within an area to be counted.

In some embodiments, the refresh control module may determine the corresponding statistical feature based on image features within at least one sub-region. For example, the number of characters may be obtained by counting the image features of the subregion determined after OCR recognition. Text coverage may be obtained by analyzing the displayed visual information of the sub-region by a text recognition model (e.g., STVR model) to determine image characteristics. The object distribution can be obtained by analyzing the displayed image information of the sub-region by an object recognition model (such as RCNN model, fast-RCNN model).

Step 620, determining the region type of each sub-region based on the statistical characteristics.

The region type may refer to a type of picture information within a region. In some embodiments, the region types may include static data types, dynamic data types, and the like. For example, if the picture information in the sub-region is a still picture, a text document, or the like, the region type of the sub-region is a still data type. The picture information in the subarea is video, animation and the like, and the area type of the subarea is dynamic data type.

In some embodiments, the refresh control module may establish a second vector database based on the statistical features and the region types, by which the region type of each sub-region is determined. The second vector database refers to a database for storing, indexing and querying reference statistical feature vectors and region types. Through the second vector database, similarity queries and other vector management can be performed quickly against a large number of reference statistical feature vectors.

Specifically, the refresh control module may build corresponding reference statistical feature vectors in advance based on the number of historical words, the coverage of the historical words, and the distribution of the historical objects in each sub-region. For example, the reference statistical feature vector may be expressed as t= (g, h, j), and g, h, j may respectively represent the number of historical words, the coverage of the historical words, and the distribution of the historical objects at one or more consecutive times in the historical time for a certain sub-region. When the number of characters, the coverage of characters and the distribution of objects at a plurality of continuous moments are expressed, g, h and j can be sequences. The refresh control module may construct a second vector database based on the actual region type of the reference statistical feature vector. The second vector database may be exemplarily represented in the form of table 2.

Reference statistical feature vector	Region type
		t1	p1
t2	p2
		…	…

Table 2-exemplary representation of the second vector database

In some embodiments, the refresh control module may construct a corresponding statistical feature vector to be tested based on the number of words, the coverage of words, and the distribution of objects in the current sub-region. The construction may be similar to the construction of the reference statistical feature vector.

In some embodiments, the refresh control module may calculate a second evaluation value for each reference statistical feature vector in the second vector database based on the statistical feature vector to be tested. In some embodiments, the second evaluation value may be a similarity of the reference statistical feature vector and the statistical feature vector to be measured. The similarity may be determined based on a vector distance (e.g., euclidean distance, chebyshev distance, etc.) of the reference statistical feature vector and the statistical feature vector to be tested. It can be understood that the smaller the vector distance is, the greater the similarity between the vectors is, and the greater the second evaluation value corresponding to the reference statistical feature vector is.

When the second evaluation value of a certain reference statistical feature vector meets the preset requirement, the refresh control module can take the corresponding region type of the reference statistical feature vector as the region type of the current sub-region. For example, the preset requirement is that the second evaluation value be maximum. At this time, the refresh control module may use the region type corresponding to the reference statistical feature vector with the largest second evaluation value as the region type of the current sub-region.

In some embodiments, the refresh control module may determine a region type corresponding to the at least one sub-region based on the picture information data to be displayed of the buffer queue. The region type of a certain sub-region can be determined by the mode of the second vector database based on the statistical characteristics of the sub-region corresponding to the picture information data to be displayed in a single frame or multiple frames. And if the region type of the sub-region is initially determined to be the static data type through the statistical characteristics of the single-frame picture information data, and the second evaluation value of the reference statistical characteristic vector meeting the preset requirement is larger than a third preset threshold value in the determining process, the static data type is used as the final region type of the sub-region. And if the region type of the sub-region is initially determined to be the dynamic data type through the single-frame picture information data, and the second evaluation value of the reference statistical feature vector meeting the preset requirement is smaller than a third preset threshold value in the determining process, further extracting statistical features based on multi-frame picture information, and re-determining the region type. The third preset threshold may be a historical empirical value, a system default value, or the like.

According to the method, as errors may exist in the dynamic data type determined through the single-frame picture information, whether the region type needs to be further judged or not is determined according to the initially determined region type and the second evaluation value, and therefore accuracy of region type judgment is improved.

Step 630, based on the region type, determines a refresh sub-rate for each sub-region.

The refresh control module may determine a refresh sub-rate for each sub-region by various data analysis methods based on the region type. For example, the refresh control module may pre-establish a correspondence between different region types and different refresh sub-speeds. For example, when the region type of the sub-region is a static data type, the corresponding refresh sub-rate may be 60Hz. When the region type of the sub-region is a dynamic data type, the corresponding refresh sub-rate may be 144Hz.

In some embodiments, the refresh control module may determine applications that the sub-region is currently likely to run based on the usage scenario in combination with the region type of the sub-region. The usage scene can be determined by matching the actual usage scene of the obtained flat panel reference feature vector in the first vector database by the flat panel to-be-detected feature vector constructed based on the basic information (such as pose information, motion information and position information). See fig. 3 and its associated description for an illustration of a usage scenario.

The refresh control module may establish a correspondence with the application program in advance based on the usage scenario, the region type of the sub-region. For example, the usage scenario is daily work, the region type of the sub-region is a static data type, and the corresponding possible application programs may include a text editing program, a slide show program, and the like. The usage scenario is game entertainment, the region type of the sub-region is dynamic data type, and the corresponding possible application programs can comprise video programs, game programs and the like. The refresh control module may determine an application program that the sub-region is currently likely to run based on the current usage scenario, the region type of the sub-region, and the correspondence.

The refresh control module may further determine the refresh sub-rate for the sub-region based on the currently possible running application via a pre-established mapping table or other data analysis. For example, the refresh control module may generate a mapping relationship table of the application program and the optimal refresh rate in advance for each application program and the optimal refresh rate corresponding to each program. The optimal refresh rate may be a refresh rate that is optimal for a user experience of a program, and may be a default value or a historical experience value of the system. The refresh control module may use the optimal refresh rate corresponding to the currently running application program in the mapping relation table as the refresh sub-rate of the current sub-region.

According to the method disclosed by some embodiments of the present disclosure, by combining the scene and the region type, the application programs that may run are determined, so that the corresponding refresh rate can be determined more accurately according to the application programs in the sub-region, and each application program has a suitable refresh rate.

According to the method disclosed by some embodiments of the specification, the statistical characteristics of the subareas are determined, so that the area types of all subareas can be determined, the picture information difference of different subareas is fully considered, the more proper refreshing sub-speed corresponding to the different subareas is further determined, and the use smoothness of the electronic ink screen is improved.

One or more embodiments of the specification provide an ink screen-based tablet computer system, including a processor for executing any one of the control methods of the ink screen-based tablet computer device provided in the embodiments of the specification.

The embodiment of the specification also provides a computer readable storage medium, the storage medium stores computer instructions, and when the computer reads the computer instructions in the storage medium, the computer runs any one of the control methods of the tablet computer device based on the ink screen provided by the embodiment of the specification.

While the basic concepts have been described above, it will be apparent to those skilled in the art that the foregoing detailed disclosure is by way of example only and is not intended to be limiting. Although not explicitly described herein, various modifications, improvements, and adaptations to the present disclosure may occur to one skilled in the art. Such modifications, improvements, and modifications are intended to be suggested within this specification, and therefore, such modifications, improvements, and modifications are intended to be included within the spirit and scope of the exemplary embodiments of the present invention.

Meanwhile, the specification uses specific words to describe the embodiments of the specification. Reference to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic is associated with at least one embodiment of the present description. Thus, it should be emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various positions in this specification are not necessarily referring to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of the present description may be combined as suitable.

Furthermore, the order in which the elements and sequences are processed, the use of numerical letters, or other designations in the description are not intended to limit the order in which the processes and methods of the description are performed unless explicitly recited in the claims. While certain presently useful inventive embodiments have been discussed in the foregoing disclosure, by way of various examples, it is to be understood that such details are merely illustrative and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements included within the spirit and scope of the embodiments of the present disclosure. For example, while the system components described above may be implemented by hardware devices, they may also be implemented solely by software solutions, such as installing the described system on an existing server or mobile device.

Likewise, it should be noted that in order to simplify the presentation disclosed in this specification and thereby aid in understanding one or more inventive embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof. This method of disclosure, however, is not intended to imply that more features than are presented in the claims are required for the present description. Indeed, less than all of the features of a single embodiment disclosed above.

In some embodiments, numbers describing the components, number of attributes are used, it being understood that such numbers being used in the description of embodiments are modified in some examples by the modifier "about," approximately, "or" substantially. Unless otherwise indicated, "about," "approximately," or "substantially" indicate that the number allows for a 20% variation. Accordingly, in some embodiments, numerical parameters set forth in the specification and claims are approximations that may vary depending upon the desired properties sought to be obtained by the individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and employ a method for preserving the general number of digits. Although the numerical ranges and parameters set forth herein are approximations that may be employed in some embodiments to confirm the breadth of the range, in particular embodiments, the setting of such numerical values is as precise as possible.

Each patent, patent application publication, and other material, such as articles, books, specifications, publications, documents, etc., referred to in this specification is incorporated herein by reference in its entirety. Except for application history documents that are inconsistent or conflicting with the content of this specification, documents that are currently or later attached to this specification in which the broadest scope of the claims to this specification is limited are also. It is noted that, if the description, definition, and/or use of a term in an attached material in this specification does not conform to or conflict with what is described in this specification, the description, definition, and/or use of the term in this specification controls.

Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments of this specification. Other variations are possible within the scope of this description. Thus, by way of example, and not limitation, alternative configurations of embodiments of the present specification may be considered as consistent with the teachings of the present specification. Accordingly, the embodiments of the present specification are not limited to only the embodiments explicitly described and depicted in the present specification.

Claims

1. Tablet computer device based on ink screen, characterized by, include:

The electronic ink screen is used for displaying picture information;

a display buffer memory for storing the data of the picture information;

the pose sensor is used for acquiring pose information;

the motion sensor is used for acquiring motion information;

the positioning module is used for determining the position information; the refreshing control module is used for controlling the refreshing speed of the data of the picture information on the electronic ink screen, and the refreshing speed is determined at least based on basic information or picture information of the tablet computer device; the basic information includes at least one of the pose information, the motion information, and the position information of the tablet computer device;

the refresh control module determining the refresh rate based on the base information includes:

determining the refresh rate based on the pose information, the motion information, and the location information using a first vector database, the first vector database being a sum recommended refresh rate database for storing, indexing, and querying tablet reference feature vectors of the tablet computer device;

the refresh control module determining the refresh rate based on the picture information includes:

based on the picture information, identifying a rectangle and partitioning by using a pixel comparison method to obtain at least one sub-area;

Determining whether each sub-area needs to be refreshed or not based on the pixel variation of the at least one sub-area, wherein the pixel variation of the at least one sub-area is determined based on the pixel of the at least one sub-area and the pixel of the static picture currently displayed by the corresponding sub-area in the picture of the latest frame in a buffer queue, and the buffer queue refers to the storage form of the data of the picture information in the display buffer; the pixels of each picture sub-region are determined through image features, wherein the image features refer to related features reflecting picture information displayed in the sub-region, and the image features comprise color features and text features; the method comprises the steps of,

determining the refreshing sub-speed of each sub-area in the at least one sub-area through a sub-area refreshing judgment model based on the pixel of the at least one sub-area in the latest frame of picture in the buffer queue and the pixel of the static picture currently displayed by the corresponding sub-area, wherein the sub-area refreshing judgment model is a machine learning model;

the input of the subarea refreshing judging model comprises the pixel of at least one subarea in the picture of the latest frame in the buffer queue and the pixel of the static picture currently displayed by the corresponding subarea, and the output comprises the subarea needing refreshing in the at least one subarea.

2. The tablet computer device of claim 1, wherein the refresh control module is further to:

determining a statistical feature based on image features within the at least one sub-region;

determining a region type of each sub-region based on the statistical features; and

and determining the refreshing sub-speed of each sub-region based on the region type.

3. A control method of a tablet computer based on an ink screen, wherein the control method is performed based on a refresh control module of the tablet computer device based on the ink screen according to any one of claims 1 to 2, the method comprising:

determining a refresh rate of data of the picture information on a display module based at least on basic information or picture information of the tablet computer device; the basic information comprises at least one of pose information, motion information and position information of the tablet computer device;

determining the refresh rate based on the base information includes:

Determining the refresh rate based on the picture information includes:

determining whether each sub-area needs to be refreshed or not based on the pixel variation of the at least one sub-area, wherein the pixel variation of the at least one sub-area is determined based on the pixel of the at least one sub-area and the pixel of the static picture currently displayed by the corresponding sub-area in the picture of the latest frame in a buffer queue, and the buffer queue refers to the storage form of the data of the picture information in a display buffer; the pixels of each picture sub-region are determined through image features, wherein the image features refer to related features reflecting picture information displayed in the sub-region, and the image features comprise color features and text features; the method comprises the steps of,

The input of the subarea refreshing judgment model comprises the pixel of at least one subarea in the picture of the latest frame in the buffer queue and the pixel of the static picture currently displayed by the corresponding subarea, and the output comprises the subarea needing refreshing in the at least one subarea;

and displaying the picture information based on the display module and the refresh rate.

4. The control method of claim 3, wherein said determining a refresh sub-rate for each of said at least one sub-region based on image characteristics of said at least one sub-region comprises:

5. An ink screen based tablet computer system, characterized in that the system comprises a processor for executing the control method of the ink screen based tablet computer device of any one of claims 3-4.

6. A computer-readable storage medium storing computer instructions that, when read by a computer in the storage medium, the computer performs the control method of the ink screen-based tablet computer device according to any one of claims 3 to 4.