CN113852756B

CN113852756B - Image acquisition method, device, equipment and storage medium

Info

Publication number: CN113852756B
Application number: CN202111032055.7A
Authority: CN
Inventors: 李海波; 李涛
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2021-09-03
Filing date: 2021-09-03
Publication date: 2023-07-28
Anticipated expiration: 2041-09-03
Also published as: CN113852756A

Abstract

The application discloses an image acquisition method, an image acquisition device, image acquisition equipment and a storage medium, and belongs to the technical field of image processing. The image acquisition method comprises the following steps: receiving a first input of a user to a video playing interface; in response to the first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image determined from the first input; and obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first area in the target image is greater than that of an image of a second area in the first preview video image, and the second area is an image area corresponding to the first area.

Description

Image acquisition method, device, equipment and storage medium

Technical Field

The application belongs to the technical field of image processing, and particularly relates to an image acquisition method, an image acquisition device, image acquisition equipment and a storage medium.

Background

With the rapid development of electronic technology and information technology, more and more electronic devices are capable of recording and playing video. In the process of recording video, the electronic equipment can cause the recorded video to have poor image quality due to the factors such as environment or manual operation (for example, equipment shake), and in the process of playing video, if a user intercepts video frames, the obtained image has poor image quality, and the requirements of the user can not be met.

Disclosure of Invention

The embodiment of the application aims to provide an image acquisition method, an image acquisition device and a storage medium, which can solve the problem that an image intercepted by a user in a video playing process is poor in image quality.

In a first aspect, an embodiment of the present application provides an image acquisition method, including:

receiving a first input of a user to a video playing interface;

in response to the first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image determined from the first input;

and obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first area in the target image is greater than that of an image of a second area in the first preview video image, and the second area is an image area corresponding to the first area.

In a second aspect, an embodiment of the present application provides an image acquisition apparatus, including:

the receiving module is used for receiving a first input of a user to the video playing interface;

an acquisition module for acquiring, in response to the first input, a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined from the first input;

And the processing module is used for obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first area in the target image is larger than that of an image of a second area in the first preview video image, and the second area is an image area corresponding to the first area.

In a third aspect, embodiments of the present application provide an electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, the program or instruction implementing the steps of the method according to the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product comprising a computer program which, when executed by a processor, implements the steps of the image acquisition method according to the first aspect.

In the embodiment of the application, in response to a first input of a user to a video playing interface, a video frame sequence including a first original video image is acquired, wherein the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from videos of the video playing interface, and a target image is acquired according to the video frame sequence. The image of the user region of interest (the second region) is optimized through the original video image, so that the resolution of the image of the first region in the target image is larger than that of the image of the second region in the first preview video image, and the obtained target image has better image quality of the user region of interest.

Drawings

Fig. 1 is a schematic flow chart of an image acquisition method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a first preview video image provided by an embodiment of the present application;

FIG. 3 is one of the schematic diagrams of a target image provided by an embodiment of the present application;

FIG. 4a is a schematic diagram of a video playing interface according to an embodiment of the present application;

FIG. 4b is a schematic diagram of the video playback interface shown in FIG. 4a after user operation;

FIG. 5a is a second schematic diagram of a video playing interface according to the embodiment of the present application;

FIG. 5b is a schematic diagram of the video playback interface shown in FIG. 5a after user operation;

FIG. 5c is a schematic view of the video playback interface shown in FIG. 5b after user operation;

FIG. 6 is a second schematic diagram of a target image provided in an embodiment of the present application;

FIG. 7 is a third schematic illustration of a target image provided in an embodiment of the present application;

FIG. 8 is a schematic diagram of a video recording interface according to an embodiment of the present disclosure;

FIG. 9 is a second schematic diagram of a video recording interface according to an embodiment of the present disclosure;

FIG. 10a is a third exemplary diagram of a video playback interface according to an embodiment of the present disclosure;

FIG. 10b is a schematic diagram of a video playback interface according to an embodiment of the present disclosure;

fig. 11 is a schematic structural view of an image acquisition apparatus provided in an embodiment of the present application;

fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 13 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The image acquisition method provided by the embodiment of the application is described in detail below by means of specific embodiments and application scenes thereof with reference to the accompanying drawings.

First, an application scenario according to an embodiment of the present application will be described.

The method of the embodiment of the application can be applied to an electronic device, and in one embodiment, the electronic device includes: a mobile phone, a tablet computer, a smart watch, a camera and other devices. Optionally, the electronic device has a display screen.

According to the image acquisition method, under the condition of playing video, a user wants to intercept an image in the playing video, in order to obtain an image with better image quality, a target image wanted by the user is obtained based on an original image associated with the image to be intercepted in recorded original video data, and because the playing video is obtained by processing according to the original video data, some image information can be lost in the processing process, the target image wanted by the user can be obtained based on the original image associated with the image to be intercepted in the recorded original video data, and the lost image information in the playing image can be recovered, so that the image with better image quality is obtained.

Fig. 1 is a flowchart of an image acquisition method according to an embodiment of the present application. As shown in fig. 1, the image acquisition method provided in this embodiment includes:

step 101, receiving a first input of a user to a video playing interface.

Specifically, pre-recorded video is played in a video playing interface. Optionally, recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data and the video playing data are in one-to-one correspondence according to a time stamp and are stored in an associated mode. The video played in the video playing interface is obtained based on the video playing data. The original frame rate of the obtained original video data and the original frame rate of the video playing data are both the preset frame rate, the resolution of the video playing data is the preset resolution, the resolution of the original video data is determined by hardware of the recording device, and the resolution of an original image in the original video data is generally larger than the resolution of an image in the video playing data.

Optionally, the video playing data is obtained by performing format conversion based on the original video data, and some image information may be lost in the process of performing format conversion to obtain the video playing data, so that the original image in the original video data has more image information than the image in the played video, for example, the resolution of the original image in the original video data is generally greater than the resolution of the image in the video playing data.

The preset frame rate and the preset resolution may be set by a user or by default by the device.

The first input may be implemented through an input device (such as a mouse, a keyboard, a microphone, etc.) connected to the device, or an operation performed by a user on a display screen of the electronic device, which is not limited in the embodiment of the present application.

In one embodiment, the first input may be: the click input of the user on the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user, may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

The specific gesture in the embodiment of the application may be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture and a double-click gesture; the click input in the embodiment of the application may be single click input, double click input, or any number of click inputs, and may also be long press input or short press input.

For example, the user double clicks on a video image frame being played in the video playback interface, indicating that the user needs to intercept the video image frame.

Step 102, in response to a first input, a sequence of video frames is acquired that includes a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined from the first input.

Specifically, the first preview video image is an image determined based on a first input of a user in a video played in a video playing interface, for example, the first preview video image is an image being played at a time when the first input is received. The first original video image associated with the first preview video image is an original image in the original video data corresponding to a timestamp of the first preview video image, and the video frame sequence includes, for example, only the first original video image or a plurality of original images including the first original video image derived from the original video data. For example, a frame of original image corresponding to the time stamp is acquired in the original video data, or a plurality of frames of original images are acquired from the frame of original image. For example, if the timestamp of the current first preview video image is 10 seconds, the original image of 10 seconds is searched in the original video data, and the first original video image is acquired. For example, the resolution of the first original video image is 4608×3456, and the resolution of the first preview video image is 1440×1080.

And 103, obtaining a target image according to the video frame sequence, wherein the resolution of an image of a first area in the target image is greater than that of an image of a second area in the first preview video image, and the second area is an image area corresponding to the first area.

Specifically, the target image is obtained based on the video frame sequence, for example, after the original video image in the video frame sequence is subjected to image synthesis, the target image is obtained, the resolution of the image of the first area in the target image is larger than the resolution of the image of the second area in the first preview video image, and therefore the obtained image of the target image has better image quality.

The first area may be a whole area in the image or a partial area in the image, which is not limited in the embodiment of the present application.

As shown in fig. 2, the user double-clicks the video playing interface to select a first preview video image currently playing, for example, an image of 6 th second in the video currently playing, and the electronic device obtains, based on the moment, one or more frames of original images in the original video data to obtain a video frame sequence, where the video frame sequence includes the first original video image, for example, obtains a frame of the first original video image corresponding to the moment, obtains, based on the first original video image, at least one frame of the original image to obtain a video frame sequence, and obtains, based on the video frame sequence, a target image, for example, an image shown in fig. 3. As is apparent from fig. 2 and 3, the image quality of the image is improved, and the figure and the butterfly in fig. 3 have clearer outlines than those of the figure and the butterfly in fig. 2, so that the display effect of capturing the image from the video to obtain the target image is enhanced.

According to the method, a first input of a user to a video playing interface is responded, a video frame sequence comprising a first original video image is obtained, wherein the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from videos of the video playing interface, a target image is obtained according to the video frame sequence, and as the resolution of an image of a first area in the target image is greater than the resolution of an image of a second area in the first preview video image, the image quality of the first area of interest of the user in the obtained target image is good.

In one embodiment, step 102 may be implemented in several ways:

one implementation:

displaying at least one video frame acquisition option;

receiving a second input of a user to a first video frame acquisition option in the at least one video frame acquisition option, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

in response to the second input, a sequence of video frames including the first original video image is acquired in accordance with the first video frame acquisition mode.

Specifically, as shown in fig. 4a and 4b, after receiving the first input of the user to the video playing interface, at least one video frame acquisition option is displayed, where, as shown in fig. 4b, the video frame acquisition option includes: the device receives a second input of the user for one of the video frame acquisition options, and acquires a video frame sequence comprising a first original video image for a first video frame acquisition mode indicated by the second input.

The second input may be input through an input device (such as a mouse, a keyboard, or a microphone) connected to the device, or the second input may be an operation performed by a user on a touch display screen of the electronic device, which is not limited in the embodiment of the present application.

In one embodiment, the second input may be: the click input of the user on the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user, may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, the user clicks on a setup window on the video playback interface, or the user outputs a voice prompt for "set as an automatic option".

The first video frame acquiring manner may be, for example, a manner of acquiring, according to a default manner of the device, a plurality of frames of an original video image including the first original video image, where the default manner may be a predetermined manner, for example, a frame number of the video frame sequence is set, a selection manner (for example, continuous selection or interval selection) of each frame in the video frame sequence, and the like.

In the above embodiment, the user input is received through the displayed video frame acquisition options, and the video frame sequence is acquired based on the user input, so that the user can flexibly select the video frame to improve the image quality of the region of interest.

Alternatively, the step of "acquiring a video frame sequence including a first original video image according to the first video frame acquisition manner" may be implemented as follows:

acquiring N frames of original video images comprising a first original video image;

according to preset image parameters, acquiring an X-frame target original video image from N-frame original video images to obtain a video frame sequence, wherein the X-frame target original video image comprises a first original video image;

obtaining a target image according to the video frame sequence, wherein the method comprises the following steps:

image synthesis is carried out on the X-frame target original video image, and a target image is obtained;

wherein, N and X are positive integers, and X is less than or equal to N.

Alternatively, the manner of acquiring N frames of original video images may be implemented, for example, by at least one of the following manners:

and acquiring a frame of first original video image corresponding to the time stamp of the first preview video image and the original video image with the target frame number before the time stamp in the original video data, wherein the target frame number is greater than or equal to 1.

And acquiring a frame of first original video image corresponding to the time stamp of the first preview video image and the original video image with the target frame number after the time stamp in the original video data, wherein the target frame number is greater than or equal to 1.

Specifically, N frames may be taken forward, N frames may be taken backward, or a plurality of frames may be taken forward, and N frames may be taken backward, for example, a plurality of frames may be sequentially and continuously acquired in a time stamp order, or acquired at intervals, which is not limited in the embodiment of the present application.

The preset image parameter refers to a parameter value of the image parameter that meets a preset condition, for example, a weighted average of parameter values is maximum, which is not limited in the embodiment of the present application; or, the preset image parameter refers to a preset value of the image parameter. The preset image parameters may be default to the device or preset by the user.

Wherein the image parameters comprise, for example, at least one of: an Automatic exposure (Automatic Exposure, AE) value, an Automatic white balance (Automatic White Balance, AWB) value, an Automatic Focus (AF) value, a beauty parameter, or the like, and further, an X-frame target original video image with a better parameter value of an image parameter is selected from N-frame original video images, so as to obtain a video frame sequence, wherein the X-frame target original video image comprises a first original video image. For example, a previous X-frame original image having the greatest weighted average of parameter values of image parameters is selected from N-frame original video images, and image synthesis is performed on the X-frame original image. For example, an X-frame original image having a parameter value greater than a preset value may be selected from N frames.

As shown in fig. 4a, the user double-clicks to select a first preview video image (corresponding to the first input of the user), at this time, play is paused, a dialog box of a video frame acquisition option (such as the dialog box shown in fig. 4 b) is displayed on the video play interface, further, a second input of the user to select the first video frame acquisition option (such as an automatic option) is received, when the user selects the automatic option, N frames of original video images corresponding to the timestamp of the first preview video image are acquired, based on the parameter values corresponding to the image parameters of the N frames of original video images, X frames of original video images are extracted from the N frames of original video images, and in the case that the user focuses on the whole image, image synthesis is directly performed on the X frames of original video images.

In the above embodiment, the image synthesis is performed on the X-frame original video image to obtain the target image, and because the first preview video image is obtained by processing based on the original video data, some image information is lost, and based on the X-frame original video image of the video frame sequence in the original video data, the obtained target image has a first area higher resolution than a second area corresponding to the first area in the first preview video image, so that the image quality of the target image is better, and the image quality of the image area concerned by the user is improved.

Another implementation:

displaying at least one video frame acquisition option;

receiving a third input of a second video frame acquisition option from the at least one video frame acquisition option by a user;

displaying at least one video frame acquisition sub-option in response to the third input;

receiving a fourth input of a user to the at least one video frame acquisition sub-option;

in response to the fourth input, a sequence of video frames comprising the first original video image is acquired in accordance with a second video frame acquisition mode, the second video frame acquisition mode being determined in accordance with the fourth input.

Specifically, as shown in fig. 5a to 5c, after receiving a first input of a user to the video playing interface, at least one video frame acquisition option is displayed, as shown in fig. 5b, including, for example: an automatic option, a manual option, a user selecting one of the video frame acquisition options, e.g. selecting the manual option, the device receiving a third input by the user for one of the video frame acquisition options, in response to which at least one video frame acquisition sub-option (forward or backward) may be displayed as shown in fig. 5c, receiving a fourth input by the user for the at least one video frame acquisition sub-option, and acquiring a sequence of video frames comprising the first original video image for a second video frame acquisition mode indicated by the fourth input.

The third input may be implemented through an input device (such as a mouse, a keyboard, or a microphone) connected to the device, or an operation performed by a user on a touch display screen of the electronic device, which is not limited in the embodiment of the present application.

In one embodiment, the third input may be: the click input of the user on the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user, may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

The fourth input is similar to the third input, and will not be described herein.

The second video frame acquisition mode may be a mode of acquiring a video frame sequence through a user setting, for example, a mode of setting a frame number of the video frame sequence, a frame taking mode, and the like by the user.

As shown in fig. 5b and 5c, in the case that the user selects the manual option, at least one video frame acquisition sub-option is displayed, parameters set by the user, such as forward frame acquisition or backward frame acquisition, are acquired, and a video frame sequence is acquired based on the user's settings.

In an embodiment, the number of frames may be preset, or a default value may be adopted, or may be set by a user, for example, the number of frames taken in fig. 5c may also be displayed in the video frame acquisition sub-option, which is not limited in this embodiment of the present application.

Optionally, the second video frame acquisition mode may be implemented, for example, by at least one of the following modes:

forward frame fetching mode: acquiring a frame of first original video image corresponding to a time stamp of a first preview video image and an original video image with a target frame number before the time stamp from original video data, wherein the target frame number is greater than or equal to 1;

a backward frame fetching mode: and acquiring a frame of first original video image corresponding to the time stamp of the first preview video image and the original video image with the target frame number after the time stamp in the original video data, wherein the target frame number is greater than or equal to 1.

Assuming that the number of the second video frames is m, m frames may be taken forward, m frames may be taken backward, or several frames may be taken forward, and m frames may be taken backward, for example, sequentially and continuously in a time stamp order, or multiple frames may be taken at intervals, which is not limited in the embodiment of the present application.

Optionally, the image acquisition method further includes:

in response to the third input, displaying at least one image parameter adjustment control;

receiving a fifth input of the user to the at least one image parameter adjustment control;

step 103 may be specifically implemented as follows:

responding to the fifth input, and performing image synthesis on an original video image in the video frame sequence according to the first image parameter to obtain a target image; the first image parameter is determined from the fifth input.

The implementation of the fifth input is similar to that of the fourth input, and will not be described again.

Specifically, after receiving the third input, at least one image parameter adjustment control is displayed, as shown in fig. 5c, the image parameter adjustment control comprising: and adjusting the parameters such as the AE value, the AWB value or the AF value by a user, and performing image synthesis on an original video image in the video frame sequence according to the parameter values set by the user to obtain a target image.

As shown in fig. 4a, the user double-clicks to select a first preview video image of a certain frame (corresponding to the first input of the user), at this time, pauses playing, and displays a dialog box (dialog box shown in fig. 4 b) for selecting a video frame acquisition option on the video playing interface, when the user selects an automatic option, the electronic device selects N original images (for example, N is 10) nearest to the moment, calculates image parameter values of each original image, including AE value, AWB value or AF value, and finally selects X original images (for example, 6) with optimal AE value, AWB value and AF value from the N original images to perform image synthesis, and generates a target image with higher quality corresponding to the first preview video image at the moment; when the manual option is selected, the user needs to select to take frames forwards or backwards, for example, take 6 frames of original video images including the first original video image to perform image synthesis, manually set parameter values corresponding to image parameters, including AE values, AWB values or AF values, and the like, and perform image synthesis on 6 original video images based on the parameter values corresponding to the set image parameters to obtain a target image, where the target image is shown in fig. 3.

In the above embodiment, the original video images in the video frame sequence are synthesized according to the first image parameters to obtain the target image, and because the first preview video image is obtained by processing based on the original video data, some image information is lost, and based on the original video image of the video frame sequence in the original video data, the obtained target image has a first area higher resolution than a second area corresponding to the first area in the first preview video image, so that the image quality of the target image is better, and the image quality of the image area concerned by the user is improved.

In an embodiment, the user may only be interested in certain objects in the image, so step 101 may be implemented as follows:

receiving a first input of a user to a target object in a video playing interface;

acquiring a sequence of video frames comprising a first original video image, comprising:

acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

Obtaining an intermediate image of the target object according to the target video frame sequence;

image synthesis is carried out on the target object intermediate image and the first preview video image to obtain a target image;

the resolution of the image of the area where the target object is located in the target image is larger than the resolution of the image of the area where the target object is located in the first preview video image.

Alternatively, the user may focus on the entire image, for example, the user clicks on a blank area of the image in the play video interface shown in fig. 2, which indicates that the user focuses on the entire image, and the image quality of the entire first preview video image needs to be improved.

Optionally, when the user clicks on the video playing interface, a selection dialog box may also be displayed on the video playing interface, for example, selecting an image of the entire image or a partial region.

Alternatively, the user may only focus on certain target objects in the first preview video image, e.g. the user double clicks on a target object in the first preview video image, such as the avatar of the person in fig. 4 a. I.e. by means of the indication of the first input, a target object of interest to the user in the first preview video image can be determined. Optionally, the first input is used for indicating the position information input by the user, and the corresponding target object is found through the position information, that is, the target object corresponding to the image area to which the position information belongs is determined, for example, the user performs a double click on a certain position of the image area where the target object is located, for example, the user performs a double click on the head portrait of the character area in fig. 4 a. Alternatively, the first input may be used to input identification information of the target object, and the identification information may be a name, for example, the user inputs "the name of the target object" by voice to indicate that the image quality of the person in fig. 4a is improved, so as to acquire the target image.

Responding to a first input of a user aiming at a target object, acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located; the target video frame sequence is obtained in a similar manner to the video frame sequence in the previous embodiment, alternatively, the target video frame sequence is identical to the video frame sequence in the previous embodiment.

Further, according to the target video frame sequence, obtaining a target object intermediate image; for example, image synthesis is performed on each original video image in the target video frame sequence, an image of an area where the target object is located is cut from the synthesized image, so as to obtain a target object intermediate image, or image synthesis is performed on an image of a third area where the target object is located in each original video image in the target video frame sequence, so as to obtain a target object intermediate image. And performing image synthesis on the target object intermediate image and the first preview video image to obtain a target image.

In other embodiments, the image of the third region where the target object is located in each original video image in the video frame sequence obtained in the foregoing embodiments may also be used to form the target video frame sequence. At this time, without obtaining an intermediate image of the target object, image synthesis is directly performed on all images in the target video frame sequence and the first preview video image, so as to obtain the target image.

For example, in fig. 4a, an image of a third region where a person is located is obtained from an original video image, and the image of the third region where the person is located and the first preview video image are image-synthesized to obtain a target image, as shown in fig. 6.

In one embodiment, the intermediate image of the target object, such as an image of the area in which the person is located, may also be saved.

As shown in fig. 6, the user can view the obtained target image, fig. 6 is the target image obtained in 10 seconds of video playing, and the image quality of the character area focused by the user in fig. 6 is improved, so that the display effect of the target image obtained from screenshot in the video is enhanced.

The butterfly effect focused by the user in fig. 7 is improved, and the display effect of the image area focused by the user is optimized.

As shown in fig. 4a and fig. 4b, in the 10 th second of video playing, the object a (character) in the video playing interface is double-clicked, the video pauses playing, a video frame acquisition option selection dialog box is displayed in the video playing interface, the user selects an automatic option, according to the first preview video image of the frame selected by the user as a reference frame, the user clicks the selected object a as a target object, the image parameter values of the image in the area where the object a is located in the 10 frames of original video images closest to the reference frame time are respectively calculated, including AE value, AWB value, AF value and the like, finally 6 original video images with the optimal weighted average of AE value, AWB value and AF value are selected from the 10 original video images to perform image synthesis, a target image with better focus image quality of the user is obtained, the target image is stored in the album, and after the user selects the automatic option, the video is automatically continued to play.

For example, as shown in fig. 5a, when the video is played for 16 seconds, the playing frame rate of the video is adjusted to 1 frame/second, the object B (butterfly) in the video playing interface is double-clicked, the video pauses to play and displays a video frame acquisition option selection dialog box, the user selects a manual option, in the manual option setting dialog box, a frame capturing mode, an image parameter value and the like are respectively set, after the completion, the confirmation key is clicked, and after the confirmation key is clicked, the video automatically continues to play. As shown in fig. 5B and 5c, the user selects a manual option, selects a backward frame, sets an AE value, an AWB value, and the like, the electronic device backward selects 6 frames of original video images closest to the moment, performs image synthesis on the image of the region where the object B concerned by the user is located according to the image parameter value set by the user, further obtains a target image based on the synthesized image and the first preview video image, and automatically saves the generated target image in the album. The resolution of the image of the region of the target object in the target image is greater than the resolution of the image of the region of the target object in the first preview video image shown in fig. 2, as shown in fig. 7.

In the above embodiment, since the first preview video image is obtained by processing the original video image in the original video data, some image information is lost, and the image quality of the target object intermediate image obtained in the target video frame sequence is better than that of the region image in which the target object is located in the first preview video image, so that the image quality of the obtained target image is better based on the image composition of the target object intermediate image and the first preview video image, and the image quality of the image region of the target object concerned by the user is improved.

In an embodiment, the image acquisition method further includes:

receiving a fifth input of a user to the video recording interface;

responding to a fifth input, recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises a video frame sequence, and the video playing data comprises a first preview video image;

and storing the original video data and the video playing data in an associated mode.

The fifth input may be implemented through an input device (such as a mouse, a keyboard, or a microphone) connected to the device, or an operation performed by a user on a display screen of the electronic device, which is not limited in the embodiment of the present application.

In one embodiment, the fifth input may be: the click input of the user on the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user, may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, an image acquisition component (such as an image sensor) acquires original video data, performs image processing such as format conversion on the original video data, and acquires video playing data; the time stamp of each original video image in the original video data corresponds to the time stamp of each video image in the video playing data one by one, and the time stamps are associated and stored.

In an embodiment, in the case of a video recording interface of an electronic device, for example, by clicking a video recording control on a preview interface of a camera APP, entering the video recording interface, clicking the video recording control of the video recording interface, and starting video recording, optionally, as shown in fig. 8, a setting control (an icon displayed in the upper right corner in fig. 8) may be displayed on the video recording interface, clicking the setting control, and then displaying a video recording mode selection dialog box, where it is assumed that a user selects a high definition video recording mode, and selects a frame rate of 60 frames/second and a resolution of 1080P, that is, setting a preset frame rate and a preset resolution.

Alternatively, in the case of recording in the high-definition recording mode, a high-definition mark may be displayed on the display screen, for example, an "H" letter is displayed in the upper left corner of the display screen in fig. 9.

Under the condition of video recording, the original video data output by the image sensor, for example, the video playing data in the RAW format and the YUV format are respectively generated into video files, and each original video image in the original video data corresponds to the time stamp of each video image in the video playing data one by one, so that the video files of the original video data and the video files of the video playing data can be stored, for example, uploaded to an album database for storage.

In the above embodiment, the original video data and the video playing data are obtained through video recording, the original video data and the video playing data are stored in an associated manner, when the video is played, a certain frame image displayed in the played video can be selected as a reference, a corresponding original video image and a video frame sequence comprising the original video image are selected, and the video frame sequence is processed to obtain the target image, so that the purpose of converting the image at a certain moment in the video into the high-image-quality target image is achieved.

In an embodiment, before receiving the first input to the video playing interface user, the method further includes:

receiving a sixth input of a user to the video playing interface;

in response to the sixth input, a playback frame rate of the video in the video playback interface is reduced.

The sixth input may be implemented through an input device (such as a mouse, a keyboard, or a microphone) connected to the device, or an operation performed by a user on a display screen of the electronic device, which is not limited in the embodiment of the present application.

In one embodiment, the sixth input may be: the click input of the user on the video playing interface, or the voice instruction input by the user, or the specific gesture input by the user, may be specifically determined according to the actual use requirement, which is not limited in the embodiment of the present application.

For example, as shown in fig. 10a and fig. 10b, the video playing interface of the display screen is slid up and down, so as to adjust the playing frame rate of the video in the video playing interface, for example, the sliding up in fig. 10a increases the playing frame rate, and the sliding down in fig. 10b decreases the playing frame rate.

In order to more accurately intercept the target image focused by the user, that is, more accurately acquire the first preview video image, the playing frame rate may be reduced, for example, may be directly reduced, or may be increased first and then reduced.

As shown in fig. 10a, at the 6 th second of video playing, the user's finger slides upwards on the video playing interface, so as to increase the video playing frame rate and achieve the purpose of fast video playing. The display screen may display the current video play frame rate in real time as the video is played, such as in the upper right hand corner of the screen in fig. 10 a. As shown in fig. 10b, at the 8 th second of video playing, the finger slides downwards on the video playing interface, so that the video playing frame rate can be reduced, alternatively, the video playing frame rate can be reduced to 1 at minimum, the purpose of slow video playing is achieved, the timestamp of the first preview video image can be accurately determined, and further the target image focused by the user can be accurately acquired.

In the above embodiment, the playing process of the video in the video playing interface may be controlled, particularly, the playing time may be controlled by adjusting the playing frame rate of the video in the video playing interface, for example, the playing frame rate may be reduced for the video portion focused by the user, the playing frame rate may be improved for the video portion not focused by the user, the flexibility is higher, particularly, the playing frame rate of the video in the video playing interface is reduced, and the target image focused by the user may be more accurately captured.

In one embodiment, after receiving the first input from the user to the video playing interface, the image acquisition method further includes:

suspending playing of the video in the video playing interface;

after obtaining the target image, the image obtaining method further comprises the following steps:

and continuing to play the video in the video playing interface.

Specifically, after receiving the first input of the user to the video recording interface, playing of the video can be paused, so that the electronic device can more accurately determine the timestamp of the current first preview video image, further obtain the first original video image, obtain the video frame sequence based on the first original video image, further obtain the target image, and after obtaining the target image, continue playing of the target video can be continued.

It should be noted that, in the image capturing method provided in the embodiment of the present application, the execution subject may be an image capturing device, or a processing module in the image capturing device for executing the image capturing method. In the embodiment of the present application, an image acquisition apparatus provided in the embodiment of the present application is described by taking an example in which the image acquisition apparatus performs an image acquisition method.

Fig. 11 is a schematic structural view of an image acquisition apparatus provided in the present application. The image acquisition device provided in this embodiment includes:

a receiving module 210, configured to receive a first input from a user to a video playing interface;

an acquisition module 220 for acquiring, in response to the first input, a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined from the first input;

the processing module 230 is configured to obtain a target image according to the video frame sequence, where a resolution of an image of a first area in the target image is greater than a resolution of an image of a second area in the first preview video image, and the second area is an image area corresponding to the first area.

According to the device, a first input of a user to a video playing interface is responded, a video frame sequence comprising a first original video image is obtained, wherein the first original video image is an original image associated with a first preview video image, the first preview video image is an image determined according to the first input from videos of the video playing interface, a target image is obtained according to the video frame sequence, and as the resolution of an image of a first area in the target image is greater than the resolution of an image of a second area in the first preview video image, the image quality of the first area focused by the user in the obtained target image is better.

Optionally, the system further comprises a display module, wherein the display module is used for displaying at least one video frame acquisition option;

the receiving module 210 is specifically configured to: receiving a second input of a first video frame acquisition option from the at least one video frame acquisition option by a user, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

the obtaining module 220 is specifically configured to:

and in response to the second input, acquiring the video frame sequence comprising the first original video image according to the first video frame acquisition mode.

In the embodiment, the user input is received through the displayed video frame acquisition options, so that the video frame sequence is acquired based on the user input, the flexibility is high, and the user experience is good.

Optionally, the obtaining module 220 is specifically configured to:

according to preset image parameters, acquiring X-frame target original video images from the N-frame original video images to obtain the video frame sequence, wherein the X-frame target original video images comprise the first original video image;

optionally, the processing module 230 is specifically configured to:

performing image synthesis on the X-frame target original video image to obtain the target image;

wherein, N and X are positive integers, and X is less than or equal to N.

Optionally, the display module is configured to:

displaying at least one video frame acquisition option;

the receiving module 210 is specifically configured to: receiving a third input of a second video frame acquisition option from the at least one video frame acquisition option by a user;

the display module is also used for: displaying at least one video frame acquisition sub-option in response to the third input;

the receiving module 210 is specifically configured to: receiving a fourth input of a user to the at least one video frame acquisition sub-option;

the obtaining module 220 is specifically configured to: in response to the fourth input, the sequence of video frames including the first original video image is acquired according to a second video frame acquisition mode, the second video frame acquisition mode being determined according to the fourth input.

Optionally, the display module is configured to:

the receiving module 210 is specifically configured to: receiving a fifth input of the user to the at least one image parameter adjustment control;

optionally, the processing module 230 is specifically configured to:

responding to the fifth input, and performing image synthesis on an original video image in the video frame sequence according to a first image parameter to obtain the target image; the first image parameter is determined from the fifth input.

Optionally, the receiving module 210 is specifically configured to: receiving a first input of a user to a target object in a video playing interface;

the obtaining module 220 is specifically configured to: acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

the processing module 230 is specifically configured to: obtaining an intermediate image of the target object according to the target video frame sequence;

image synthesis is carried out on the target object intermediate image and the first preview video image to obtain the target image;

The resolution of the image of the area where the target object is located in the target image is greater than the resolution of the image of the area where the target object is located in the first preview video image.

Optionally, the receiving module 210 is further configured to: receiving a fifth input of a user to the video recording interface;

the processing module 230 is further configured to: responding to the fifth input, recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

Optionally, the receiving module 210 is further configured to: receiving a sixth input of a user to the video playing interface;

the processing module 230 is further configured to: and in response to the sixth input, reducing a play frame rate of the video in the video play interface.

In the above embodiment, the playing process of the video in the video playing interface can be controlled by adjusting the playing frame rate of the video in the video playing interface, in particular, the playing frame rate of the video in the video playing interface is reduced, and the target image focused by the user can be intercepted more accurately.

The image acquisition device in the embodiment of the application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. By way of example, the mobile electronic device may be a cell phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, wearable device, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook or personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device may be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.

The image capturing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The image acquisition device provided in the embodiment of the present application can implement each process implemented by the image acquisition device in the method embodiment of fig. 1 to 10, and in order to avoid repetition, a description is omitted here.

Optionally, as shown in fig. 12, the embodiment of the present application further provides an electronic device 1200, including a processor 1201, a memory 1202, and a program or an instruction stored in the memory 1202 and capable of being executed on the processor 1201, where the program or the instruction implements each process of the embodiment of the image acquisition method when executed by the processor 1201, and the same technical effects are achieved, and for avoiding repetition, a description is omitted herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

The electronic device 1000 includes, but is not limited to: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1010 by a power management system to perform functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 13 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

Wherein, the user input unit 1007 is configured to receive a first input of a user to the video playing interface;

a processor 1010 for obtaining, in response to the first input, a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined from the first input;

In the present embodiment, the user input unit 1007 may be a display screen of the electronic apparatus.

According to the electronic device provided by the embodiment of the application, the first input of the user to the video playing interface is responded, the video frame sequence comprising the first original video image is obtained, the first original video image is the original image related to the first preview video image, the first preview video image is the image determined according to the first input from the video of the video playing interface, the target image is obtained according to the video frame sequence, and the resolution of the image of the first area in the target image is greater than the resolution of the image of the second area in the first preview video image, so that the image quality of the first area focused by the user in the obtained target image is better.

Optionally, the display unit 1006 is configured to:

displaying at least one video frame acquisition option;

a user input unit 1007, configured to receive a second input of a first video frame acquisition option from the at least one video frame acquisition option, where the first video frame acquisition option indicates a first video frame acquisition mode;

the processor 1010 is specifically configured to: and in response to the second input, acquiring the video frame sequence comprising the first original video image according to the first video frame acquisition mode.

Optionally, the processor 1010 is further configured to:

wherein, N and X are positive integers, and X is less than or equal to N.

Optionally, the display unit 1006 is further configured to: displaying at least one video frame acquisition option;

a user input unit 1007 for receiving a third input of a second video frame acquisition option from the at least one video frame acquisition option by a user;

the display unit 1006 is specifically configured to: displaying at least one video frame acquisition sub-option in response to the third input;

a user input unit 1007 further configured to receive a fourth input from a user of the at least one video frame acquisition sub-option;

the processor 1010 is specifically configured to: in response to the fourth input, the sequence of video frames including the first original video image is acquired according to a second video frame acquisition mode, the second video frame acquisition mode being determined according to the fourth input.

Optionally, the display unit 1006 is specifically configured to: in response to the third input, displaying at least one image parameter adjustment control;

a user input unit 1007 for receiving a fifth input of a user to said at least one image parameter adjustment control;

the processor 1010 is specifically configured to: responding to the fifth input, and performing image synthesis on an original video image in the video frame sequence according to a first image parameter to obtain the target image; the first image parameter is determined from the fifth input.

Optionally, a user input unit 1007 is configured to: receiving a first input of a user to a target object in a video playing interface;

the processor 1010 is specifically configured to: acquiring a target video frame sequence comprising a target object original image, wherein the target object original image is an image of a third area where a target object in the first original video image is located;

Optionally, a user input unit 1007 is configured to:

receiving a fifth input of a user to the video recording interface;

the processor 1010 is specifically configured to: responding to the fifth input, recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

Optionally, a user input unit 1007 is configured to:

receiving a sixth input of a user to the video playing interface;

the processor 1010 is specifically configured to: and in response to the sixth input, reducing a play frame rate of the video in the video play interface.

It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 can include two portions, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein. Memory 1009 may be used to store software programs as well as various data including, but not limited to, application programs and an operating system. The processor 1010 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 1010.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the processes of the embodiment of the image acquisition method are implemented, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, so as to implement each process of the embodiment of the image acquisition method, and achieve the same technical effect, so that repetition is avoided, and no redundant description is provided here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application further provide a computer program product, which includes a computer program, where the computer program when executed by a processor implements each process of the embodiments of the image acquisition method, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. An image acquisition method, comprising:

receiving a first input of a user to a video playing interface; the video played in the video playing interface is obtained based on video playing data, the video playing data and the original video data are obtained by recording a pre-recorded video according to a preset frame rate and a preset resolution, and the original video data and the video playing data are stored in a one-to-one correspondence mode according to a time stamp;

in response to the first input, obtaining a sequence of video frames comprising a first original video image, the first original video image being an original image associated with a first preview video image determined from video played in the video playback interface in accordance with the first input; the first original video image is an original image in the original video data;

2. The image acquisition method according to claim 1, wherein the acquiring a sequence of video frames comprising a first original video image comprises:

displaying at least one video frame acquisition option;

receiving a second input of a first video frame acquisition option from the at least one video frame acquisition option by a user, wherein the first video frame acquisition option indicates a first video frame acquisition mode;

3. The image capturing method according to claim 2, wherein the capturing the sequence of video frames including the first original video image according to the first video frame capturing manner includes:

The obtaining a target image according to the video frame sequence comprises the following steps:

wherein, N and X are positive integers, and X is less than or equal to N.

4. The image acquisition method according to claim 1, wherein the acquiring a sequence of video frames comprising a first original video image comprises:

displaying at least one video frame acquisition option;

in response to the fourth input, the sequence of video frames including the first original video image is acquired according to a second video frame acquisition mode, the second video frame acquisition mode being determined according to the fourth input.

5. The image acquisition method of claim 4, wherein the method further comprises:

6. The method of claim 1, wherein receiving a first user input to a video playback interface comprises:

the acquiring a sequence of video frames comprising a first original video image comprises:

7. The method of any of claims 1-6, wherein prior to receiving the first user input to the video playback interface, further comprising:

receiving a fifth input of a user to the video recording interface;

responding to the fifth input, recording according to a preset frame rate and a preset resolution to obtain original video data and video playing data, wherein the original video data comprises the video frame sequence, and the video playing data comprises the first preview video image;

8. The method of any of claims 1-6, wherein prior to receiving the first user input to the video playback interface, further comprising:

receiving a sixth input of a user to the video playing interface;

and in response to the sixth input, reducing a play frame rate of the video in the video play interface.

9. An image acquisition apparatus, comprising:

The receiving module is used for receiving a first input of a user to the video playing interface; the video played in the video playing interface is obtained based on video playing data, the video playing data and the original video data are obtained by recording a pre-recorded video according to a preset frame rate and a preset resolution, and the original video data and the video playing data are stored in a one-to-one correspondence mode according to a time stamp;

an acquisition module, configured to acquire, in response to the first input, a sequence of video frames including a first original video image, the first original video image being an original image associated with a first preview video image, the first preview video image being determined from a video played in the video playback interface according to the first input; the first original video image is an original image in the original video data;

10. An electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the image acquisition method as claimed in any one of claims 1 to 8.

11. A readable storage medium, characterized in that the readable storage medium has stored thereon a program or instructions which, when executed by a processor, implement the steps of the image acquisition method according to any one of claims 1-8.