CN108319484A

CN108319484A - A kind of processing method of five application page, device and storage medium

Info

Publication number: CN108319484A
Application number: CN201710349352.1A
Authority: CN
Inventors: 熊唯
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2017-05-17
Filing date: 2017-05-17
Publication date: 2018-07-24
Anticipated expiration: 2037-05-17
Also published as: CN108319484B; WO2018210179A1

Abstract

The embodiment of the present invention provides a kind of processing method of five application page, device and storage medium, wherein the method includes：In the figure layer of the display area of application, the page figure layer residing for positioning webpage display area；When the page of page display area load updates, Image Acquisition is carried out to the page figure layer in the display area；From institute's the image collected, extraction obtains page-images corresponding with the page display area in the page figure layer；When the position data according to institute's loading page in the page display area, detect that there are when overlapping region, duplicate removal processing is carried out to the page-images acquired according to the overlapping region for the adjacent page-images acquired twice；Splicing is carried out to the page-images acquired.

Description

Application page processing method and device and storage medium

Technical Field

The invention relates to a screen capture processing technology, in particular to a method and a device for processing an application page and a storage medium.

Background

At present, as the application types supported by the terminal are more and more, the terminal functions are also more and more powerful. In the process of using an instant messaging application, a social contact application, a reading application and other applications, a user often needs to forward information such as news and novels recorded or browsed by chatting to others. At present, the forwarding is mainly carried out through three ways, the first way is to select a plurality of messages for forwarding, but the way can filter some information, for example, a red packet message can not be forwarded; the second approach is screenshot sending, most of screenshots of android (android) models are only current pages, so that multiple screenshots are needed if a plurality of messages are intercepted, the multiple screenshot pictures are forwarded, not only is frequent manual operation needed, but also system memory resources are wasted; the third approach is to send the picture captured by the long screen capture technology, and at present, some manufacturers support the long screen capture function, but the captured picture effect has defects, for example, the spliced part often has errors or even repeatedly captures.

Disclosure of Invention

In view of this, the present invention is intended to provide a method, an apparatus, and a storage medium for processing an application page, which can at least solve the problem that a splice often occurs an error or even a duplicate screenshot when a screenshot is captured through a long screenshot function.

The technical scheme of the invention is realized as follows:

a first aspect of an embodiment of the present invention provides a method for processing an application page, where the method includes:

positioning a page layer where a page display area is located in a layer of the applied display area; when the page loaded in the page display area is updated, carrying out image acquisition on the page layer in the display area; extracting a page image corresponding to the page display area in the page layer from the acquired image; when detecting that the page images acquired twice are overlapped according to the position data of the loaded page in the page display area, carrying out duplicate removal processing on the acquired page images according to the overlapped area; and splicing the acquired page images.

A second aspect of the present invention provides an apparatus for processing an application page, where the apparatus includes: the positioning unit is used for positioning a page layer where the page display area is located in the layer of the applied display area; the acquisition unit is used for acquiring images of the page layers in the display area when the pages loaded in the page display area are updated; the extraction unit is used for extracting and obtaining a page image corresponding to the page display area in the page layer from the acquired image; the duplicate removal processing unit is used for carrying out duplicate removal processing on the acquired page images according to the superposed region when detecting that the page images acquired twice adjacently have the superposed region according to the position data of the loaded page in the page display region; and the splicing unit is used for splicing the acquired page images.

In the foregoing solution, the positioning unit is further configured to: searching a view control for controlling a page to be displayed in the page display area according to the identifier of the view control included in the display area of the application; and taking the distributed area of the searched view control in the display area of the application as the page display area.

In the foregoing solution, the duplicate removal processing unit is specifically configured to: when all contents of a currently displayed page are updated according to the operation received in the page display area every time, and a first image and a second image are acquired after each operation of two adjacent operations, whether the contents of the tail part of the page are displayed in the page display area according to the operation is judged; and when judging that the content of the tail part of the page is displayed in the page display area according to the operation, comparing the height interval data of the page in the first image with the height interval data of the page in the second image, and judging that the overlapping area exists between the two adjacent acquired page images when the overlapping area data exists.

In the foregoing solution, the extracting unit is further configured to: before extracting and obtaining a page image corresponding to the page display area in the page layer, detecting whether a first operation is received; if a first operation is received, determining a target sub-region in the page display region based on the first operation, and extracting an image corresponding to the target sub-region from the acquired image to be used as a page image; and if the first operation is not received, extracting a page image from the acquired image according to the page display area.

A third aspect of the present invention provides an apparatus for processing an application page, where the apparatus includes: a memory for storing a computer program; and the processor is connected with the memory and used for realizing the processing method of the application page in any one of the technical schemes by executing the computer program.

A fourth aspect of the embodiments of the present invention provides a storage medium, where the storage medium stores a computer program, and after the computer program is executed by a processor, the method for processing an application page according to any one of the foregoing technical solutions can be implemented.

By adopting the technical scheme of the embodiment of the invention, firstly, in the layer of the applied display area, the page layer where the page display area is located is positioned; therefore, when image acquisition is carried out, the page layer in the display area is subjected to image acquisition, and the problem that the finally acquired image is not clear due to the fact that the page layer and other layers except the page layer are acquired simultaneously in the existing screen capturing technology can be solved; extracting a page image corresponding to the page display area in the page layer from the acquired image; when detecting that the page images acquired twice are overlapped according to the position data of the loaded page in the page display area, carrying out duplicate removal processing on the acquired page images according to the overlapped area; and finally, splicing the acquired page images, so that the problem that the spliced part frequently has errors or even repeated screenshots when screenshot is performed through a long screenshot function can be solved due to the fact that duplication removal processing is performed before splicing. In addition, because the form of obtaining the picture through the screenshot is adopted, and some messages are not manually selected for forwarding, the problem of message missing is avoided; moreover, the long spliced picture is formed finally, the spliced picture is only needed to be forwarded, and a plurality of independent pictures obtained by screenshot are not needed to be forwarded respectively, so that the operation times of manual forwarding of a user are reduced, and the use experience of the user is improved.

Drawings

FIG. 1 is a schematic diagram of a long screenshot obtained by a first long screenshot technique according to the present invention;

FIG. 2 is a schematic diagram of a long screenshot obtained by a second long screenshot technique according to the present invention;

fig. 3 is a schematic flow chart illustrating an implementation of a processing method for an application page according to an embodiment of the present invention;

fig. 4 is a first schematic page layout diagram of an application according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a page layout of an application according to an embodiment of the present invention;

fig. 6 is a schematic diagram of updating the entire content of the currently displayed page according to the operation received by the page display area according to the embodiment of the present invention;

fig. 7 is a schematic diagram of updating a part of content of a currently displayed page according to an operation received by the page display area according to the embodiment of the present invention;

fig. 8 is a first schematic diagram illustrating a text message displayed after a voice message is translated into the text message according to an embodiment of the present invention;

fig. 9 is a second schematic diagram illustrating a text message displayed after a voice message is translated into the text message according to an embodiment of the present invention;

fig. 10 is a schematic diagram of a picture obtained by stitching page images according to an embodiment of the present invention;

fig. 11 is a schematic diagram obtained by stitching an additional information image and a page image according to an embodiment of the present invention;

FIG. 12 is a flowchart illustrating a screen capture process according to an embodiment of the present invention;

fig. 13 is a schematic diagram of performing region division on an intercepted picture according to an embodiment of the present invention;

fig. 14 is a first schematic structural diagram illustrating a composition structure of a page processing apparatus for an application according to an embodiment of the present invention;

fig. 15 is a schematic structural diagram of a second composition of a processing apparatus for an application page according to an embodiment of the present invention.

Detailed Description

In order to better explain the present invention, two long screen shots are introduced below.

The first long screen capture technical scheme is as follows: a manufacturer adds a system interface to call an application, judges that a scrollable area exists in an application page, records the scrolling position of each view (view), performs screen capture operation if the scrolling position exceeds the height of the scrollable area, stores pictures and records scrolling information, and finally performs splicing according to all screenshots and position information after scrolling is finished. The drawbacks of this solution are: the view is continuously rolled, the screenshot judgment is continuously carried out, the efficiency is not high, and if the content which does not want to be screenshot exists in the scrollable area (such as the content of the message in the occlusion message list), the content can also be intercepted. Generally, the content of the unwanted screenshot is located in a different viewing layer from the messages in the message list. The content of the unwanted screenshot refers to pictures, characters and the like which block messages in the message list of the application.

Fig. 1 is a schematic diagram of a long screenshot obtained through a first long screenshot technique according to an embodiment of the present invention, and as can be seen from fig. 1, a chat record of a QQ application related to Mr Chen is captured, and in the obtained long screenshot picture, a centimeter portrait exists, which blocks a part of message content in the chat record of the QQ application, and if the long screenshot picture is forwarded to a third person, the existence of the centimeter portrait will undoubtedly affect the third party to understand the chat record between the sender and the Mr Chen.

The second long screen capture technical scheme is as follows: and adding a system interface by a manufacturer to call the application, turning a page, scrolling the screen one page at a time, then performing screenshot on the current page, and finally splicing all the screenshots. The method is more efficient than the first method, but has the problems that the dependency on the bottom of the view in the application is larger, and if the judgment on whether the view rolls to the bottom is wrong, errors occur at the splicing part of the last page or even the screenshot is repeated.

Fig. 2 is a schematic diagram of a long screenshot obtained by a second long screenshot technique according to an embodiment of the present invention, and as can be seen from fig. 2, a chat record of a QQ application related to Mr Chen is intercepted, and as can be seen from the obtained long screenshot picture, the screenshot of the last page of message shows an exception, and there are two repeated messages (marked by dashed boxes in fig. 2). This affects the analysis of the third person's chat history between the sender and Mr Chen. In addition, a centimeter-show head portrait also exists in the obtained long screenshot picture, and the centimeter-show head portrait blocks part of message content in the chat record of the QQ application, and if the long screenshot picture is forwarded to a third person, the existence of the centimeter-show head portrait undoubtedly affects understanding of the chat record between the sender and the Mr Chen by the third party.

In addition, at present, a manufacturer cannot process screenshot contents in a screenshot process, voice messages are important information, and information cannot be acquired in the conventional screenshot.

The technical solution of the present invention is further elaborated below with reference to the drawings and the specific embodiments.

An embodiment of the present invention provides a method for processing an application page, where the method is applied to a terminal side, and as shown in fig. 3, the method mainly includes:

step 301: and positioning a page layer where the page display area is located in the layer of the display area of the application.

Here, the application may be an application installed on the terminal device. Illustratively, a social application is installed on the terminal, and the social application has the functions of pushing and receiving messages; the social application also has a screen capture function.

Here, the applications include communication applications, such as instant communication applications, social applications, and the like, and the applications may also include reading applications, such as news applications. Of course, the application may also be other types of applications, which are not listed here.

Illustratively, the instant messaging application may comprise a WeChat application or the like. Here, the social applications may include Tencent QQ, Tencent microblog, and the like. Here, the news-like application may include a news information reading application such as Tencent news.

Wherein, in the display area, an additional information area is included in addition to the page display area; the additional information area is used for displaying additional information except the page. Here, the additional information includes at least menu bar information, tool bar information, title bar information, and the like. Illustratively, the instant messaging application or the social application is a QQ application, and the additional information area is used for displaying a title bar and menu bar information of the QQ. Illustratively, the reading-class application is a novel application, and the additional information area is used for displaying a title bar and toolbar information of a novel.

Here, the page layer may correspond to a plurality of areas, such as a page display area and an additional information area.

Here, the page display area is a type of information for displaying an application, and the type of information is information permitted to be displayed on the layer by default for the application.

Illustratively, when the application is an instant messaging application or a social contact application, the corresponding page layer allows the received or sent first type of information to be displayed on the page layer, where the first type of information includes text messages, voice messages, picture messages, and the like. It should be noted that the first type of information does not include second type of information that would obscure the first type of information in the page display area, for example, the second type of information includes a centimeter show message.

Illustratively, when the application is a reading application, the corresponding page layer allows a third type of information to be displayed on the layer, where the third type of information includes characters, symbols, pictures, and the like. It should be noted that the third type of information does not include fourth type of information that may block the third type of information displayed in the page display area, for example, the fourth type of information includes a head portrait floating above the third type of information.

Optionally, before step 301, the method may further comprise:

step 300: and determining a page display area used for updating the display page according to operation in the display area according to the layout of the display area of the application.

As one mode, the determining, according to the layout of the display area of the application, a page display area in the display area for updating the display page according to the operation includes:

analyzing layout information of a display area of an application;

and determining a page display area in the display area according to the layout information of the display area.

Here, as for the display area of the application, it is possible to divide into a plurality of display areas, but at least one display area is used as a page display area on the terminal screen.

Supposing that the display area of the application is divided into three areas, namely an area A, an area B and an area C, and the area A, the area B and the area C are displayed on a terminal screen; the area a is a title bar area, the area B is a message bar area, and the area C is a menu bar area, so the area B will be a page display area of the application, and the area a and the area C will be additional information areas of the application. Fig. 4 is a first schematic page layout diagram of an application according to an embodiment of the present invention, and as can be seen from fig. 4, a display area of the application displays all display areas of the application, that is, a terminal displays three areas, namely an area a, an area B, and an area C, in a full screen. Of course, the terminal may display the B area in full screen in order to display the B area in a wider range. Fig. 5 is a schematic diagram of a page layout of an application according to an embodiment of the present invention, and as can be seen from fig. 5, a display area of the application displays a part of the display area of the application, that is, only an area of a B area is displayed on a full screen of the terminal. Thus, the page image P1 extracted under the layout shown in fig. 5 may contain less content in P1 than in P2 with respect to the page image P2 extracted under the layout shown in fig. 4, and of course, the content contained in P1 may be equal to the content contained in P2, but the font in P2 is larger than the font in P1.

The page display area can be a message display area of an instant messaging application or a social application, and the page display area can update a display page according to operation. Illustratively, the instant messaging application or the social application is a QQ application, and the page display area is capable of updating a display page for displaying a QQ message when a sliding operation of a user on the message display area is received.

The page display area can also be an information display area for reading applications, and the page display area can update the display page according to operation. Illustratively, the reading application is a novel application, and the page display area can update a display page for displaying the content of a novel chapter when a sliding operation of a user is received.

As an optional implementation manner, the determining, according to the layout of the display area of the application, a page display area in the display area for updating the display page according to the operation includes:

searching a view control for controlling a page to be displayed in the page display area according to the identifier of the view control included in the display area of the application;

and taking the distributed area of the searched view control in the display area of the application as the page display area.

Still taking the example that the display area of the application includes A, B, C, three areas, correspondingly, the application includes three view controls, which are respectively marked as a, b, and c; then, according to the mapping relationship between the found view control identifier and the corresponding area thereof, the view control a represents the title bar area, the view control B represents the message bar area, and the view control c represents the menu bar area, so that it can be determined that the B area is the page display area of the application.

Step 302: and when the page loaded in the page display area is updated, carrying out image acquisition on the page layer in the display area.

As an optional implementation manner, before performing image acquisition on the page layer in the display area, the method further includes: positioning the layer positioned at the top of the page layer; and setting a hidden attribute for the layer positioned at the top of the page layer.

Here, the setting of the hidden attribute to the layer located at the top of the page layer includes:

and adjusting the layer level at the top of the page layer to enable the layer level at the top of the page layer to be lower than the page layer level.

Here, the relative positions between layers are described using top and bottom, and the top layer refers to a layer that is not covered by another layer in the display area when the direction of the user's line of sight is used as a reference. Taking the first layer and the second layer as an example, when the first layer is located on the top of the second layer, that is, from the user's perspective, the second layer is blocked by the first layer.

Taking the layer a and the layer B as an example, from the perspective of a user, if the content in the layer a is not completely blocked by the layer B in the display area, the layer a is marked as a top layer, that is, a layer located at the top of the layer B; then, for other layers than layer a, for example, layer B, is the layer located at the bottom of layer a.

Taking the image layer a and the image layer B as an example, the area a1 is the upper left corner area of the screen, the content of the image layer a corresponding to the area a1 is a picture, and the content of the image layer B corresponding to the area a1 is a segment of text, so that in this case, the segment of text corresponding to the area a1 of the image layer B is blocked by the picture corresponding to the area a1 of the image layer a, and for the user, the user can only see the picture; it can be understood that when the layer B is placed on top of the layer a, the user can only see a segment of text corresponding to the layer B in the area a1, and at this time, the picture corresponding to the layer a in the area a1 is set not to be displayed.

Specifically, the application layer may include multiple layers, for example, a first layer exists on the top of the page layer, where the first layer is used to assist, when the application displays the information corresponding to the page layer, the information corresponding to the first layer is displayed on the upper layer of the information of the page layer through the first layer. In this case, if the layer located at the top of the page layer is not included, that is, if the first layer is not hidden, when the image is acquired on the current display interface of the applied display area, the display information corresponding to the first layer will block the display information corresponding to the page layer, so that the acquired image is unclear.

For example, in the QQ application, the layer corresponding to the cm show message is located at the upper layer of the layer corresponding to the QQ message, so in the message record of the QQ application, the cm show message sometimes causes an occlusion to the QQ message.

That is, prior to image capturing the display area of the application, the method further comprises: judging whether contents which need to be hidden exist during image acquisition, and if so, hiding the contents which need to be hidden; and if the application does not exist, executing the operation of image acquisition on the display area of the application. Here, the hiding the content to be hidden includes: and adjusting the hierarchy of the view layer where the content to be hidden is located, so that the hierarchy of the view layer where the content to be hidden is located is lower than the hierarchy of the view layer where the message list is located.

Step 303: and extracting a page image corresponding to the page display area in the page layer from the acquired image.

As an embodiment, the extracting, from the acquired image, a page image in the page layer corresponding to the page display area includes:

determining a page display area based on the page layer;

and extracting a page image from the acquired image according to the page display area.

Exemplarily, if the display interface of the application displayed on the terminal screen only includes information corresponding to the page display area, the page image corresponding to the page display area in the page layer may be directly extracted and obtained from the acquired image. Referring to fig. 5, the acquired image only includes a page display area of the application, that is, a B area, and the acquired image may be used as a page image corresponding to the page display area.

Exemplarily, if a display interface of an application displayed on a terminal screen includes a page display area and information corresponding to an additional information area, the page display area and the additional information area need to be determined first, and then a page image corresponding to the page display area in the page layer is extracted from the acquired image. In this case, of course, the additional information image corresponding to the additional information area in the page layer may also be extracted from the acquired image. Referring to fig. 4, the acquired image includes a page display area (i.e., a B area) of the application and additional information areas (i.e., an a area and a C area), and then a page image corresponding to the page display area, i.e., a page image corresponding to the B area, needs to be extracted from the acquired image.

Step 304: and when detecting that the page images acquired twice adjacently have an overlapping area according to the position data of the loaded page in the page display area, carrying out deduplication processing on the acquired page images according to the overlapping area.

That is to say, if it is detected that the two adjacent acquired page images have an overlapping region, the acquired page images are subjected to deduplication processing according to the overlapping region, so that good images without overlapping regions can be provided for subsequent page image stitching.

In a first optional implementation manner, the detecting that there is an overlapping area between two adjacent acquired page images according to the position data of the page loaded in the page display area includes:

when the whole content of the currently displayed page is updated according to the operation received in the page display area each time, and the first image and the second image are acquired after each operation of two adjacent operations,

judging whether the content of the tail part of the page is displayed in the page display area according to the operation;

and when judging that the content of the tail part of the page is displayed in the page display area according to the operation, comparing the height interval data of the page in the first image with the height interval data of the page in the second image, and judging that the overlapping area exists between the two adjacent acquired page images when the overlapping area data exists.

For example, if the terminal displays a page display area of an application in a full screen mode, the first image and the second image are screen capture images of two adjacent times;

and if the terminal displays the applied page display area and the additional information area in a full screen mode, the first image and the second image are images which are obtained by respectively cutting two adjacent screen capturing images according to the layout of the display area and correspond to the page display area.

That is, every time the update is performed, all the display contents of the current page display area are updated, that is, the page is turned in units of also.

Fig. 6 is a schematic diagram of updating the entire content of the currently displayed page according to the operation received by the page display area according to the embodiment of the present invention, as shown in fig. 6, the content displayed by the current page display area is denoted as a first page, the topmost of the first page has a message S1, and the bottommost of the first page has a message S10, as shown in the leftmost drawing in fig. 6; upon receiving the operation, updating the first page to a second page, with a message S11 at the top and a message S20 at the bottom, as shown in the middle drawing in FIG. 6; upon receiving the operation, update the second page to a third page, with message S21 at the top and message S30 at the bottom, as shown in the rightmost drawing in FIG. 6; and by parity of reasoning, updating is carried out. As can be seen, each time an update is made, the entire contents of the current page are updated.

Here, the position data refers to height data of the page with respect to a preset reference coordinate system. For example, the value on the y-axis represents the position data with the lowermost part of the terminal screen as the x-axis. The position data corresponding to the first page is [0, y1 ], the position data corresponding to the second page is [ y1, 2y1 ], the position data corresponding to the third page is [2y1, 3y1), and so on.

Corresponding to the first optional implementation manner, the performing the deduplication processing on the acquired page image according to the overlapping area includes:

determining a first area corresponding to the overlapping section data in the first image, and removing the first area in the first image; or

And determining a second area corresponding to the overlapped section data in the second image, and removing the second area in the second image.

Here, whether the overlapped content is removed from the first image or the second image, the effect of subsequent stitching is not affected.

That is, each time the update is performed, the updated content of the current page display area is all the display content, that is, the updated content of the page is determined by the height corresponding to the current page display area, and the update is performed by taking the page as a unit, so that only the duplicate removal determination and the duplicate removal processing need to be performed on the image corresponding to the last page and the image corresponding to the second last page until the last page is determined to have been subjected to the screenshot.

For example, if the position data corresponding to the first image is [ y1, 2y1 ] and the position data corresponding to the second image is [2y1-1, 3y1-1 ], it is determined that there is a coincidence region [2y1-1, 2y1) between the first image and the second image, and the first region [2y1-1, 2y1) in the first image needs to be removed; or [2y1-1, 2y1) in the second image.

In a second optional implementation manner, the detecting that there is an overlapping area between two adjacent acquired images according to the position data of the page loaded in the information page display area includes:

when updating part of the content of the currently displayed page according to the operation received in the information page display area each time and acquiring a first image and a second image after each operation of two adjacent operations,

comparing the height interval data of the page in the first image with the height interval data of the page in the second image;

and when the overlapping interval data exists, judging that the overlapping area exists in the page images acquired twice in the adjacent mode.

That is, each time an update is made, it is part of the current page content, not all.

Fig. 7 is a schematic diagram of updating a part of content of a currently displayed page according to an operation received by the page display area according to an embodiment of the present invention, and as shown in fig. 7, the content displayed by the current page display area is denoted as a first page, where the first page has a message S1 at the top and a message S10 at the bottom; when receiving the operation, updating the first page to a second page, wherein the message S6 is arranged at the top and the message S15 is arranged at the bottom; upon receiving the operation, the second page is updated to a third page, with a message S12 at the top, a message S21 at the bottom, and so on. As can be seen, each time an update is made, it is the partial content of the current page that is updated. That is, when the first page is captured, the first page image is obtained; from the second page, the overlapped parts exist in the images obtained by two adjacent screenshots, and the deduplication processing operation is required.

Correspondingly to the second optional implementation manner, the performing, according to the overlapping region, the deduplication processing on the acquired page image includes:

determining a first area corresponding to the overlapping section data in the first image, and removing the first area in the first image; or,

That is, each time the update is performed, the partial display content of the current page display area is updated, that is, the content of the page update is determined by the amplitude size corresponding to the operation also currently received, and the page is turned in units of the operation currently received, that is, from the 2 nd screen capture, the deduplication processing needs to be performed until the deduplication detection and processing are performed on the image captured by the last screen capture.

For example, if the position data corresponding to the first image is [ S1, S10] and the position data corresponding to the second image is [ S6, S15], then it is determined that there is an overlapping region between the first image and the second image [ S6, S10], and the first region in the first image [ S6, S10] needs to be removed; or removing [ S6, S10] in the second image.

In a third optional implementation manner, the detecting that there is an overlapping area between two adjacent acquired page images according to the position data of the page loaded in the page display area includes:

comparing the identifier of the page content in the first image with the identifier of the page content in the second image;

and when the same mark exists, judging that the overlapped area exists in the two adjacent acquired page images.

Wherein, in the page display area, different contents correspond to different identifications. Taking the content as an instant messaging message as an example, when the content displayed in the page display area is an instant messaging message, each instant messaging message is correspondingly provided with different identifiers at the background, and the background arranges the instant messaging messages according to a specific arrangement sequence, such as a time sequence.

That is, each time the update is performed, whether the entire display content of the current page display area or the partial display content of the current page display area is updated, whether the two overlap areas exist can be judged through the marks of the page contents in the two images.

Correspondingly to the third optional implementation manner, the performing, according to the overlapping region, the deduplication processing on the acquired page image includes:

reading the identification contained in the overlapping area and the height corresponding to the identification from the background;

determining a corresponding second area in the second image based on the height corresponding to the identification, and removing the second area in the second image;

and determining a corresponding first area in the first image based on the height corresponding to the identification, and removing the first area in the first image.

Of course, the method for detecting whether there is an overlapping area in the two adjacent acquired page images is not limited to the three methods given above, and may also be detected by other methods, which is not described herein again.

In an embodiment, the acquiring the image of the display area of the application and extracting the page image from the acquired image according to the page display area includes:

when detecting that a page display area comprises a voice message, recognizing the voice message as a text message and forming a text image;

and forming a text image area for loading the text image in the page display area according to the display area required to be occupied by the text image, and loading the text image in the text image area.

As a specific implementation manner, the forming, in the page display area, a text image area for loading the text image according to a display area that the text image needs to occupy, and loading the text image in the text image area includes:

when the height of a display area which needs to be occupied by the text image is smaller than a preset height value, determining an area between the voice message and the next piece of information adjacent to the voice message as a text image area; inserting the text image into the text image area;

when the height of a display area required to be occupied by the text image is larger than or equal to a preset height value, the page image is divided into two parts, so that the first part of the image contains the voice message, and the second part of the image does not contain the voice message; and splicing the first partial image, the text image and the second partial image into a new page image.

Fig. 8 is a schematic diagram showing a text message after a voice message is translated into the text message according to an embodiment of the present invention, as shown in fig. 8, when the length of the corresponding text message is smaller than a preset length value due to a short duration of the voice message, the text message is inserted into a middle area between the voice message and a message adjacent to the voice message, so that the content of the voice message can be shown as the text message during screen capture, and a third party receiving a spliced picture can know the content of the voice message.

Fig. 9 is a schematic diagram of displaying a text message after a voice message is translated into the text message according to an embodiment of the present invention, as shown in fig. 9, when the length of the voice message is longer and the length of the corresponding text message is greater than a preset length value, a current page image is first divided into two parts, so that a first part of the image includes the voice message, and a second part of the image does not include the voice message; and the first partial image, the text image corresponding to the text message and the second partial image are spliced into a new page image, so that the content of the voice message can be displayed as the text message, and a third party receiving the spliced image can know the content of the voice message.

It should be noted that, if it is detected that the page display area includes a plurality of voice messages, the plurality of voice messages may be processed at the same time. As an optional implementation manner, the text images corresponding to each voice message need to occupy the same size of the display area, for example, occupy the same height; the height here may be a height occupied by the voice message in the image, the plurality of voice messages are recognized as text messages, and the text image corresponding to each determined voice message is loaded to an area occupied by the corresponding voice message. Because the heights are the same, the voice messages are processed in parallel, and the processing efficiency is improved.

It will be appreciated that each voice message corresponds to a text message of different length. When the length of the text message is smaller than or equal to the preset length value, all the contents of the text message form a text image; and when the length of the text message is greater than the preset length value, forming a text image by partial content of the text message. Here, the partial content of the text message may be a digest of the text message, or may be a partial message that is intercepted from the text message and satisfies a preset length value, and the interception start position is not limited.

It should be noted that, if it is detected that the page display area includes a plurality of voice messages, the plurality of voice messages may be processed in sequence. Here, the description is given only by taking an example of how the first voice message is completely displayed. And after the first voice message is processed, processing a second voice message in the page display area according to the mode of processing the first voice message, and so on.

Specifically, when a page display area includes a plurality of voice messages and text messages corresponding to the voice messages are long, a first voice message is determined in the page display area, the first voice message is recognized as a text message, and a text image is formed; and removing the area occupied by the first voice message in the image, inserting the area between the first voice message and the next piece of information of the first voice message into the text image, and splicing the text image into a new image.

Due to the fact that the voice messages are processed in sequence, all contents corresponding to the voice messages can be displayed, and the identifiability of a user to the voice messages is improved.

Step 305: and splicing the acquired page images.

As an embodiment, the stitching processing on the acquired page images includes:

and splicing the collected page images in sequence to form a spliced picture, storing the spliced picture, and deleting all the collected page images.

Therefore, the spliced long picture can be obtained, so that the picture can be conveniently forwarded in a forwarding mode of forwarding a plurality of independent pictures, and the manual forwarding times of a user are saved. Due to the fact that the collected page images are deleted, internal memory resources are released in time, and the internal memory resources are saved.

In an embodiment, the method further comprises:

determining an additional information area for displaying additional information except the page in the display area according to the layout of the display area of the application;

extracting an additional information image corresponding to the additional information area in the page layer from the acquired image;

the splicing processing of the acquired page images comprises the following steps:

and splicing the additional information image and the page image according to the relative position relationship of the additional information area and the page display area.

In this way, the interface of the application can be completely displayed.

Fig. 10 is a schematic diagram of a picture obtained by splicing the page images, and as can be seen from fig. 10, the obtained long-shot picture only contains information corresponding to a page display area; in the obtained long screenshot picture, there is no centimeter show avatar relative to fig. 1 and 2, and the user can take a voice message from the long screenshot picture.

Fig. 11 is a schematic diagram showing the additional information image and the page image being spliced together. As can be seen from fig. 11, the obtained long screenshot picture only includes information corresponding to the page display area, and also includes information corresponding to the additional information area; in the obtained long screenshot picture, there is no centimeter show avatar relative to fig. 1 and 2, and the user can take a voice message from the long screenshot picture.

In the technical scheme of this embodiment, first, in a layer of an applied display area, a page layer where a page display area is located; therefore, when image acquisition is carried out, the page layer in the display area is subjected to image acquisition, and the problem that the finally acquired image is not clear due to the fact that the page layer and other layers except the page layer are acquired simultaneously in the existing screen capturing technology can be solved; extracting a page image corresponding to the page display area in the page layer from the acquired image; when detecting that the page images acquired twice are overlapped according to the position data of the loaded page in the page display area, carrying out duplicate removal processing on the acquired page images according to the overlapped area; and finally, splicing the acquired page images, so that the problem that the spliced part frequently has errors or even repeated screenshots when screenshot is performed through a long screenshot function can be solved due to the fact that duplication removal processing is performed before splicing. In addition, because the form of obtaining the picture through the screenshot is adopted, and some messages are not manually selected for forwarding, the problem of message missing is avoided; moreover, the long spliced picture is formed finally, the spliced picture is only needed to be forwarded, and a plurality of independent pictures obtained by screenshot are not needed to be forwarded respectively, so that the operation times of manual forwarding of a user are reduced, and the use experience of the user is improved.

Fig. 12 is a schematic flow chart of screen capture processing according to an embodiment of the present invention, and as shown in fig. 12, the processing flow mainly includes:

step 1201: and informing the application to start a screen capture function, before capturing the screen, judging whether second content which needs to be hidden during screen capture exists, and hiding the second content when the second content exists.

When the second operation for indicating the application to start the screen capture function is detected, the application is informed to start the screen capture function. Here, the second operation may be a trigger operation of a preset button issued by a user, where the preset button instructs an application to start a screen capture function when receiving the trigger operation.

As an embodiment, the determining whether there is the second content to be hidden when the screen capture exists includes:

the application looks up the view overlaid on top of the message list through a view (view) level and hides the view overlaid on top of the message list.

In this way, it is possible to prevent the second content of the message from appearing many times during the screenshot and being occluded.

In a specific embodiment, the determining whether there is a second content that needs to be hidden when the screen capture is performed includes:

looking up whether a view is covered on the message list of the application through a view hierarchy;

judging the view covered above the message list as second content to be hidden during screen capture;

accordingly, the hiding the second content includes:

and adjusting the hierarchy of the view layer of the second content to enable the hierarchy of the view layer of the second content to be lower than the hierarchy of the view layer of the message list.

Step 1202: before the screen is captured, judging whether third content needing to be converted during screen capture exists or not, and converting and displaying the third content when the third content exists.

Here, the third content includes a voice message.

As an embodiment, the determining whether there is third content to be converted when the screen capture exists includes:

and inquiring whether the current intercepted message content has the voice message or not, if so, translating the voice message into a text message through a voice recognition system and displaying the text message.

Here, the speech recognition system is a speech recognition system of the application or a speech recognition system of another application that the application can call.

Step 1203: and capturing a screen of the current interface of the application to obtain a first picture, identifying the first picture, and identifying an additional information area and a page display area of the application.

As shown in fig. 13, the first captured picture is divided into three parts, a title bar module at the top, a menu module at the bottom, and a message module in the middle; the area corresponding to the message module is regarded as the page display area of the application, and the areas corresponding to the title bar module and the menu module are regarded as the additional information area of the application. The title bar module is used for displaying at least one object contained in a title bar related to the application; the menu module is used for displaying at least one object contained in a menu bar related to the application.

Step 1204: and in the process of scrolling the message list of the application, screenshot is carried out on the message record of the page display area by taking a page as a unit.

Here, the operation for scrolling the message list of the application may be a manual operation by the user or an automatic operation by a program.

As an embodiment, the screenshot of the message record of the page display area in page units includes:

after the first picture is obtained, recording the position of each scroll;

and when the rolling amplitude is the view height of the page display area, judging to roll one page, carrying out screenshot on the current content of the page display area, storing the screenshot of each page, and so on until the screenshot of the last page is stored.

Here, sliding one page at a time can reduce the number of times of position determination and content saving, and can improve the efficiency of splicing pictures.

Step 1205: when the list slides without content, an interface used for providing information that the application slides to the bottom of a page display area informs that the application slides to the last page, whether the picture corresponding to the last page needs to be cut or not is judged, and if the picture needs to be cut, the picture obtained after cutting replaces the picture corresponding to the last page.

As an embodiment, the determining whether the picture corresponding to the last page needs to be cropped, and if so, replacing the picture corresponding to the last page with the cropped picture includes:

acquiring a picture corresponding to the last page and a picture corresponding to the last page;

judging whether the picture corresponding to the penultimate page and the picture corresponding to the last page have overlapped contents or not;

if the overlapped content exists, cutting off the overlapped content in the picture corresponding to the last page, deleting the picture corresponding to the last page, and storing the picture corresponding to the last page after cutting off the overlapped content.

Step 1206: and splicing all the pictures to generate a long screen shot picture containing the content of the additional information area and the content of the page display area.

As an embodiment, the stitching all the pictures includes:

splicing the contents of the page display areas in all the pictures according to the sequence to obtain the total content of the contents of the page display areas;

and splicing the content of the additional information area and the total content of the page display area according to the corresponding relation or the distribution principle of the additional information area and the page display area in the first picture.

That is, the final spliced long screenshot picture includes:

content of the additional information area + content of the page display area.

Still taking the division standard as shown in fig. 13 as an example, the final spliced long screenshot picture includes:

the content of the title bar module, the content of the message module in the first picture, the content of the message module intercepted circularly, the content of the message module subjected to the deduplication processing on the last page and the content of the menu module.

Step 1207: and saving the spliced long screen capture picture.

In this way, a long screenshot of the message record about the application is obtained.

Optionally, before screenshot the current interface of the application, the method further includes:

detecting whether a third operation is received;

if a third operation is received, determining third content which needs to be processed before screen capture and is located in an application message list based on the third operation;

and performing hiding processing or deleting processing on the third content.

Here, the third content refers to content that the user wants not to appear at the time of screen capture. The third operation is an operation sent by a user, for example, if an area is drawn in the page display area, the selected area needs to be subjected to hiding processing.

Therefore, the problem that the content which is not required to be subjected to screenshot can be intercepted during screenshot in the prior art can be solved, the content which is not required to be subjected to screenshot is determined by the user according to the initiative of the user, and the privacy of the user is well protected.

The technical scheme of the embodiment of the invention can solve the problem that the last screen is frequently connected when the screen is captured, for example, the display area of the last page and the page of the last but one page are overlapped, can also solve the problem that the finally obtained image is not clear due to the fact that the second content is not processed in the existing screen capturing technology, and can also solve the problem that the second content such as the specific content of the voice message cannot be obtained.

Fig. 14 is a schematic structural diagram of a first composition of a processing apparatus for an application page according to an embodiment of the present invention, which is applied to a terminal, and as shown in fig. 14, the apparatus includes: the positioning unit 11 is configured to position a page layer where a page display area is located in a layer of an applied display area; the acquisition unit 12 is configured to perform image acquisition on the page layer in the display area when the page loaded in the page display area is updated; the extracting unit 13 is configured to extract a page image corresponding to the page display area in the page layer from the acquired image; the duplicate removal processing unit 14 is configured to, when it is detected that the page images acquired twice adjacently have an overlapping region according to the position data of the page loaded in the page display region, perform duplicate removal processing on the acquired page images according to the overlapping region; and the splicing unit 15 is used for splicing the acquired page images.

Optionally, the apparatus further comprises: the first preprocessing unit 16 is configured to position a layer located at the top of the page layer before the acquisition unit 12 acquires an image of the page layer in the display area; and setting a hidden attribute for the layer positioned at the top of the page layer.

In an embodiment, the positioning unit 11 is further configured to: and determining a page display area used for updating the display page according to operation in the display area according to the layout of the display area of the application.

As a specific embodiment, the positioning unit 11 is specifically configured to: searching a view control for controlling a page to be displayed in the page display area according to the identifier of the view control included in the display area of the application; and taking the distributed area of the searched view control in the display area of the application as the page display area.

As an optional implementation manner, the deduplication processing unit 14 is specifically configured to: when all contents of a currently displayed page are updated according to the operation received in the page display area every time, and a first image and a second image are acquired after each operation of two adjacent operations, whether the contents of the tail part of the page are displayed in the page display area according to the operation is judged; and when judging that the content of the tail part of the page is displayed in the page display area according to the operation, comparing the height interval data of the page in the first image with the height interval data of the page in the second image, and judging that the overlapping area exists between the two adjacent acquired page images when the overlapping area data exists.

As another optional implementation, the deduplication processing unit 14 is specifically configured to: when partial content of a currently displayed page is updated according to the operation received in the information page display area every time, and a first image and a second image are acquired after each operation of two adjacent operations, comparing height interval data of the page in the first image with height interval data of the page in the second image; and when the overlapping interval data exists, judging that the overlapping area exists in the page images acquired twice in the adjacent mode.

As a specific implementation manner, the deduplication processing unit 14 is specifically configured to: determining a first area corresponding to the overlapping section data in the first image, and removing the first area in the first image; or determining a second area corresponding to the overlapped section data in the second image, and removing the second area in the second image.

Optionally, the apparatus further comprises: a second pre-processing unit 17 for: when detecting that a page display area comprises a voice message, recognizing the voice message as a text message and forming a text image; and forming a text image area for loading the text image in the page display area according to the display area required to be occupied by the text image, and loading the text image in the text image area.

As a specific embodiment, the second preprocessing unit 17 is specifically configured to: when the height of a display area which needs to be occupied by the text image is smaller than a preset height value, determining an area between the voice message and the next piece of information adjacent to the voice message as a text image area; inserting the text image into the text image area; when the height of a display area required to be occupied by the text image is larger than or equal to a preset height value, the page image is divided into two parts, so that the first part of the image contains the voice message, and the second part of the image does not contain the voice message; and splicing the first partial image, the text image and the second partial image into a new page image.

In an embodiment, the positioning unit 11 is further configured to: determining an additional information area for displaying additional information except the page in the display area according to the layout of the display area of the application; the extracting unit 13 is further configured to: extracting an additional information image from the acquired image according to the additional information area; the splicing unit 15 is further configured to: and splicing the additional information image and the page image according to the relative position relationship of the additional information area and the page display area.

In an embodiment, the extracting unit 13 is further configured to: before extracting and obtaining a page image corresponding to the page display area in the page layer, detecting whether a first operation is received; if a first operation is received, determining a target sub-region in the page display region based on the first operation, and extracting an image corresponding to the target sub-region from the acquired image to be used as a page image; and if the first operation is not received, extracting a page image from the acquired image according to the page display area.

Those skilled in the art should understand that the functions of each unit in the processing device of the application page of the present embodiment can be understood by referring to the related description of the processing method of the application page.

In practical applications, the specific structures of the positioning Unit 11, the acquisition Unit 12, the extraction Unit 13, the deduplication processing Unit 14, the splicing Unit 15, the first preprocessing Unit 16, and the second preprocessing Unit 17 can be implemented by a Central Processing Unit (CPU), a Microprocessor (MCU), a Digital Signal Processor (DSP), or a programmable logic device (PLC) in the processing device of the application page or the device to which the processing device of the application page belongs.

The processing device of the application page in this embodiment may be disposed at the terminal side.

It should be understood by those skilled in the art that the functions of each processing unit in the processing apparatus for an application page according to the embodiment of the present invention may be realized by an analog circuit that implements the functions described in the embodiment of the present invention, or by running software that executes the functions described in the embodiment of the present invention on an intelligent terminal, as will be understood with reference to the foregoing description of the processing method for an application page.

The processing device for the application page can solve the connection problem which often occurs when the last screen is captured by the screen capture, for example, the page display area of the last page and the page display area of the last but one page overlap, can also solve the problem that the finally obtained image is not clear due to the fact that the second content is not processed in the existing screen capture technology, and can also solve the problem that the second content such as the specific content of the voice message cannot be obtained.

Fig. 15 is a schematic structural diagram illustrating a second composition structure of a processing apparatus for an application page according to an embodiment of the present invention, as shown in fig. 15, the processing apparatus for an application page includes a memory 10 and a processor 20; wherein, the memory 10 is used for storing computer programs; the processor 20 is connected to the memory 10, and is configured to implement the steps of the method for processing the application page provided in any one of the foregoing technical solutions by executing the computer program.

The memory 10 of this embodiment may be a storage structure including various storage media, for example, a storage medium such as a random access storage medium, a system storage medium, and a flash memory, and may be used to store the computer program non-instantaneously.

The processor 20 may be one of the aforementioned CPUs, MCUs, DSPs or PLCs, and may also be a processing circuit, such as an Application Specific Integrated Circuits (ASICs), which may implement the above operations by executing a computer program stored in the memory 10.

In this embodiment, the processor 20 and the memory 10 may be connected by a bus interface 30, and in this embodiment, the bus interface 30 may include: integrated circuit IIC bus, etc., may be used for internal connections of the device.

As shown in fig. 15, the processing device of the application page may further include: the communication interface 40 may be configured to communicate with other electronic devices, for example, after the processing device of the application page completes the splicing processing on the acquired page image and/or the additional information image, the processing device of the application page may send the spliced long screenshot picture to the other electronic devices through the communication interface 40 for communication.

Here, it should be noted that: the above description related to the hardware composition of the processing apparatus for application pages is similar to the above description of the method, and the description of the beneficial effects of the method is omitted for brevity. For technical details not disclosed in the embodiments of the present invention, refer to the description of the embodiments of the method of the present invention.

The present embodiment also provides a storage medium, where a computer program is stored, and the computer program is executed by a processor, and is capable of implementing any one or more of the foregoing processing methods for an application page.

The computer storage medium may be of various types, and in this embodiment may preferably be a non-transitory storage medium.

Those skilled in the art will understand that the functions of the programs in the storage medium of the present embodiment can be understood by referring to the related description of the processing method of the application page described in the embodiment.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable Memory device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, and an optical disk.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A method for processing an application page, the method comprising:

positioning a page layer where a page display area is located in a layer of the applied display area;

when the page loaded in the page display area is updated, carrying out image acquisition on the page layer in the display area;

extracting a page image corresponding to the page display area in the page layer from the acquired image;

when detecting that the page images acquired twice are overlapped according to the position data of the loaded page in the page display area, carrying out duplicate removal processing on the acquired page images according to the overlapped area;

and splicing the acquired page images.

2. The method of claim 1, further comprising:

before image acquisition is carried out on the page layer in the display area, positioning the layer positioned at the top of the page layer;

and setting a hidden attribute for the layer positioned at the top of the page layer.

3. The method of claim 1, further comprising:

4. The method according to claim 1, wherein the detecting that there is an overlapping area between two adjacent acquired page images according to the position data of the loaded page in the page display area comprises:

5. The method according to claim 1, wherein the detecting that there is an overlapping area between two adjacent acquired images according to the position data of the loaded page in the information page display area comprises:

6. The method according to claim 4 or 5, wherein the performing the de-duplication process on the acquired page image according to the overlapping area comprises:

7. The method of claim 1, further comprising:

8. The method according to claim 7, wherein the forming a text image area for loading the text image in the page display area according to the display area required to be occupied by the text image and loading the text image in the text image area comprises:

9. The method of claim 1, further comprising:

10. The method according to claim 1, wherein the extracting, from the acquired image, a page image in the page layer corresponding to the page display area comprises:

detecting whether a first operation is received;

when a first operation is received, determining a target sub-area in the page display area based on the first operation;

and extracting an image corresponding to the target subregion from the acquired image, and taking the image corresponding to the target subregion as a page image.

11. An apparatus for processing an application page, the apparatus comprising:

the positioning unit is used for positioning a page layer where the page display area is located in the layer of the applied display area;

the acquisition unit is used for acquiring images of the page layers in the display area when the pages loaded in the page display area are updated;

the extraction unit is used for extracting and obtaining a page image corresponding to the page display area in the page layer from the acquired image;

the duplicate removal processing unit is used for carrying out duplicate removal processing on the acquired page images according to the superposed region when detecting that the page images acquired twice adjacently have the superposed region according to the position data of the loaded page in the page display region;

and the splicing unit is used for splicing the acquired page images.

12. The apparatus of claim 11, further comprising:

the first preprocessing unit is used for positioning the layer positioned at the top of the page layer before the acquisition unit acquires the image of the page layer in the display area; and setting a hidden attribute for the layer positioned at the top of the page layer.

13. The apparatus of claim 11,

the positioning unit is further configured to: determining an additional information area for displaying additional information except the page in the display area according to the layout of the display area of the application;

the extraction unit is further configured to: extracting an additional information image corresponding to the additional information area in the page layer from the acquired image;

the splicing unit is further configured to: and splicing the additional information image and the page image according to the relative position relationship of the additional information area and the page display area.

14. An apparatus for processing an application page, the apparatus comprising:

a memory for storing a computer program;

a processor, connected to the memory, for implementing the processing method of the application page according to any one of claims 1 to 10 by executing the computer program.

15. A storage medium storing a computer program capable of implementing the method of processing an application page of any one of claims 1 to 10 when executed by a processor.