CN106686451A

CN106686451A - Terminal and video playing control method

Info

Publication number: CN106686451A
Application number: CN201611232217.0A
Authority: CN
Inventors: 周颖; 陈鹏飞
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2016-12-28
Filing date: 2016-12-28
Publication date: 2017-05-17

Abstract

The invention discloses a terminal and a video playing control method. The terminal comprises an extraction module, a detection module and a control module. The extraction module is used for extracting video frames of played video at the beginning of the preset initial time according to sequence of play time and preset extraction cycle. The detection module is used for detecting image diversity factor of every two adjacent video frames extracted by the extraction module. The control module is used for adjusting play frame rate of the video at the detection node according to the image diversity factor; the detection node refers to the corresponding time node of the video frame, played later, of the two video frames. By the video playing control method, on the premise of guaranteeing video play smoothness, the play frame rate is adjusted dynamically during video playing, processor resource occupied during video playing can be reduced effectively, burden of the processor can be reduced effectively, power consumption of the terminal can be decreased, and service life of the battery of the terminal is prolonged; meanwhile, in the process of dynamic adjusting of the play fame rate, video playing visual effect can be improved, and users' experiences are improved further.

Description

Terminal and video playing control method

Technical Field

The invention relates to the technical field of terminal application, in particular to a terminal and a video playing control method.

Background

At present, no matter a mobile terminal or other video playing devices play video, once video playing definition (standard definition, high definition, blue light) is selected, namely a video playing frame rate is determined, the playing frame rate cannot be changed in the whole playing process unless a video playing mode is manually switched.

However, in any video, not every part of the video needs a high frame rate for human eyes, and if the high frame rate is adopted in the whole video playing process, not only is an unnecessary long-term burden imposed on the processor caused, but also the corresponding power consumption is increased.

Disclosure of Invention

The invention mainly aims to provide a terminal and a video playing control method, and aims to solve the problem that the playing frame rate cannot be dynamically adjusted in the existing video playing process.

In order to achieve the above object, the present invention provides a terminal, including:

the extraction module is used for extracting the video frames of the played video from the preset initial time according to the playing time sequence and the set extraction period;

the detection module is used for detecting the image difference degree of the two adjacent video frames aiming at the extracted two adjacent video frames;

the control module is used for adjusting the playing frame rate of the video at a detection node according to the image difference degree; and the detection node is a time node corresponding to a video frame with a later playing time in the two video frames.

Optionally, the extraction period is a time period or a frame number period.

Optionally, the control module is specifically configured to, at the detection node, increase the playing frame rate of the video according to a preset adjustment policy if the image difference reaches a preset first adjustment threshold; if the image difference degree is lower than a preset second adjustment threshold value, reducing the playing frame rate of the video at the detection node according to a preset adjustment strategy; the first adjustment threshold is greater than the second adjustment threshold; or,

specifically, the method is configured to adjust, at the detection node, the current play frame rate corresponding to the video to the play frame rate range corresponding to the detected image difference according to a corresponding relationship between a preset image difference range and the play frame rate range.

Optionally, the detecting module is specifically configured to determine variances of pixel parameters corresponding to the two frames of video frames according to the selected pixel parameters, and use a difference absolute value of the two determined variances as the image difference; or,

the image difference determination module is specifically configured to perform face image recognition on the two video frames, determine the number of face images in the two video frames, and use the absolute value of the difference between the two determined numbers as the image difference; or,

the video processing device is specifically used for respectively dividing the two frames of video frames into a plurality of frame images according to the set dividing number, and sequentially comparing the frame images at the same position in the two frames of video frames; recording the number of times that the frame images are not matched according to the comparison result, and taking the ratio of the number of times to the segmentation number as the image difference; or,

the face image recognition module is specifically used for carrying out face image recognition on the first video frame, recording first position information of any face image in the first video frame when at least one face image is recognized in the first video frame, and extracting image features of the face image; searching the face image in the second video frame according to the image characteristics, and recording second position information of the face image in the second video frame if the face image is searched; if the second position information is not found, setting the second position information to be 0; taking the absolute value of the difference between the second position information and the first position information as the image difference degree; the two video frames are a first video frame and a second video frame.

Specifically, the determining, according to the selected pixel parameter, variances of the pixel parameters corresponding to the two frames of video frames, and using a difference absolute value of the determined two variances as the image difference degree includes:

aiming at any video frame, determining a pixel parameter value corresponding to each pixel according to the RGB value of each pixel of the video frame;

determining the average value of the pixel parameter values of all pixels of the video frame according to each pixel parameter value;

determining the pixel parameter variance corresponding to each pixel according to the parameter value and the average value of each pixel;

and determining the variance of the pixel parameter corresponding to the video frame according to each variance.

In addition, in order to achieve the above object, the present invention further provides a video playing control method, including the steps of:

extracting video frames of a playing video from a preset initial time according to a playing time sequence and a set extraction period;

detecting the image difference degree of two extracted adjacent video frames;

adjusting the playing frame rate of the video at a detection node according to the image difference degree; and the detection node is a time node corresponding to a video frame with a later playing time in the two video frames.

Optionally, the extraction period is a time period or a frame number period.

Optionally, the adjusting, at a detection node, a play frame rate of the video according to the image difference degree includes:

if the image difference reaches a preset first adjustment threshold, improving the playing frame rate of the video at the detection node according to a preset adjustment strategy; if the image difference degree is lower than a preset second adjustment threshold value, reducing the playing frame rate of the video at the detection node according to a preset adjustment strategy; the first adjustment threshold is greater than the second adjustment threshold; or,

and adjusting the current playing frame rate corresponding to the video to the playing frame rate range corresponding to the detected image difference degree at the detection node according to the corresponding relation between the preset image difference degree range and the playing frame rate.

Optionally, the two video frames are a first video frame and a second video frame; the detecting the image difference degree of the two video frames comprises the following steps:

respectively determining the variances of the pixel parameters corresponding to the two frames of video frames according to the selected pixel parameters, and taking the absolute value of the difference value of the two determined variances as the image difference; or,

respectively carrying out facial image recognition on the two frames of video frames, respectively determining the number of facial images in the two frames of video frames, and taking the absolute value of the difference value of the two determined numbers as the image difference; or,

respectively dividing the two frames of video frames into a plurality of frame images according to the set dividing number, and sequentially comparing the frame images at the same position in the two frames of video frames; recording the number of times that the frame images are not matched according to the comparison result, and taking the ratio of the number of times to the segmentation number as the image difference; or,

carrying out facial image recognition on the first video frame, recording first position information of any facial image in the first video frame when at least one facial image is recognized in the first video frame, and extracting image features of the facial image; searching the face image in the second video frame according to the image characteristics, and recording second position information of the face image in the second video frame if the face image is searched; if the second position information is not found, setting the second position information to be 0; and taking the absolute value of the difference value between the second position information and the first position information as the image difference degree.

Specifically, the determining the variance of the pixel parameters corresponding to the two frames of video frames according to the selected pixel parameters includes:

The terminal and the video playing control method provided by the invention realize the dynamic adjustment of the playing frame rate in the video playing process, can effectively reduce the occupied processor resources when playing the video on the premise of ensuring the video playing smoothness, effectively reduce the burden of the processor, effectively reduce the power consumption of the terminal, and improve the service time of a terminal battery, and meanwhile, can also improve the visual effect of video playing and further improve the user experience in the dynamic adjustment process of the playing frame rate.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention;

FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;

fig. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention;

fig. 4 is a flowchart of a video playing control method according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Fig. 1 is a schematic hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.

The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.

The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive a broadcast signal by using a signal such as multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO)^@) A digital broadcasting system of a terrestrial digital broadcasting integrated service (ISDB-T), etc. receives digital broadcasting. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium)。

The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.

The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.

The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth^TMRadio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee^TMAnd so on.

The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.

The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.

The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device.

The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.

In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.

The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.

Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.

The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.

The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.

The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.

The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.

The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.

The extraction module 210, the detection module 220, and the control module 230 dynamically adjust the playing frame rate during the video playing process.

The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.

Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.

A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.

Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.

Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 275.

Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).

The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.

As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.

In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.

As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.

Based on the above mobile terminal hardware structure and communication system, various embodiments of the terminal of the present invention are provided.

As shown in fig. 3, a first embodiment of the present invention proposes a terminal, including:

the extracting module 210 is configured to extract video frames of a played video from a preset initial time according to a playing time sequence and a set extracting period;

a detecting module 220, configured to detect an image difference degree of two extracted adjacent frames of video frames;

a control module 230, configured to adjust, at a detection node, a playing frame rate of the video according to the image difference; and the detection node is a time node corresponding to a video frame with a later playing time in the two video frames.

Further, the extraction period is a time period or a frame number period. For example, the two video frames are a first video frame and a second video frame; the first video frame and the second video frame may be two video frames with an interval time of a (i.e. a time period), or may be video frames with a frame interval of N (a frame period); wherein A and N are natural numbers greater than 1.

Further, the initial time may be set according to actual conditions, for example, the playing start time of the video may be set, and the time corresponding to the video frame of the first frame may also be set when the video is played.

The Frame rate (Frame rate) is a measure for measuring the number of display frames. The measurement unit is the number of display Frames Per Second (FPS) or "Hertz" (Hz).

Due to the special physiological structure of the human eye, a picture is considered coherent if the frame rate of the viewed picture is higher than 24, which is called persistence of vision.

In the prior art, when a terminal plays a video through playing software, once a video playing definition (standard definition, high definition, blue light) is selected, a video playing frame rate is determined, and then the playing frame rate is not changed in the whole playing process unless a video playing mode is manually switched.

However, the number of Frames Per Second (FPS), or frame rate, represents the number of times per second that a graphics processor can update while processing a field. A high frame rate may result in a smoother, more realistic video effect. Generally 30fps is acceptable, but increasing performance to 60fps can significantly improve cross-talk and fidelity, but generally over 75fps a significant fluency increase is not easily perceived.

In the process of playing the video, a higher playing frame rate is generally adopted during the video playing, and at the moment, the unchanged higher playing frame rate only wastes the capacity of graphic processing, thereby not only causing unnecessary long-term burden of a processor, but also increasing corresponding power consumption;

in some cases, a lower play frame rate is adopted during video playing, and although the load of the processor is reduced, the lower play frame rate for a long time presents a lower visual effect to the user, thereby bringing a poor experience to the user.

Based on this, in the embodiment of the present invention, the video frames of the playing video are extracted from the preset initial time according to the playing time sequence and the set extraction period, the image difference of the two video frames is detected for the two extracted adjacent video frames, and the playing frame rate of the video is adjusted at the detection node according to the image difference, so as to implement dynamic adjustment of the playing frame rate of the playing video, thereby effectively reducing processor resources occupied during playing the video, effectively reducing the burden of the processor, effectively reducing the power consumption of the terminal, improving the service time of the terminal battery, and further improving the user experience. Meanwhile, in the dynamic adjustment process of the playing frame rate, the visual effect of video playing can be improved, and the user experience is further improved.

Briefly describing the principles of embodiments of the present invention:

the inventor finds that for human eyes, not every part of video needs a high playing frame rate, and based on this, the playing frame rate can be dynamically adjusted by detecting the change speed of the image content in the video.

Specifically, in the embodiment of the present invention, the change speed of the video image content of the played video is determined by periodically detecting the image difference between two adjacent video frames.

When the image difference degree is larger, namely the image content change speed is higher, the video can be played according to a higher playing frame rate;

when the image difference degree is small, namely the image content change speed is slow, the video can be played at a low playing frame rate.

Based on the adjustment mode, the dynamic adjustment of the playing frame rate of the playing video is realized.

On the basis of the first embodiment, modified embodiments of the first embodiment are further proposed, and it is to be noted herein that, in order to make the description brief, only the differences from the first embodiment are described in each modified embodiment.

In an embodiment of the present invention, the control module 230 is specifically configured to, at the detection node, increase the playing frame rate of the video according to a preset adjustment policy if the image difference reaches a preset first adjustment threshold; if the image difference degree is lower than a preset second adjustment threshold value, reducing the playing frame rate of the video at the detection node according to a preset adjustment strategy; the first adjustment threshold is greater than the second adjustment threshold.

Further, the control module 230 is further configured to analyze the played video, obtain a maximum playing frame rate of the played video, and obtain a playing frame rate corresponding to each definition of the played video.

In the embodiment of the present invention, according to a preset adjustment policy, improving the playing frame rate of the video includes:

increasing the current playing frame rate to be within the playing frame rate range corresponding to the highest definition or to be higher than the maximum playing frame rate corresponding to the current definition;

reducing the playing frame rate of the video according to a preset adjustment strategy, comprising:

and reducing the current playing frame rate to be within the playing frame rate range corresponding to the lowest definition or to be lower than the lowest playing frame rate corresponding to the current definition.

The embodiment of the invention improves the efficiency of dynamically adjusting the playing frame rate in a threshold value mode.

In another embodiment of the present invention, the control module 230 is specifically configured to adjust, at the detection node, a current playing frame rate corresponding to the video to a playing frame rate corresponding to the detected image difference degree according to a preset corresponding relationship between the image difference degree range and the playing frame rate.

In the embodiment of the invention, multiple batches of data of the image difference range, the playing frame rate, the visual effect of the video and the occupancy rate of processor resources when the processor processes the video frames can be obtained through multiple tests in advance;

determining a playing frame rate according to the visual effect data of the video and the occupancy rate data of processor resources;

and determining the image difference degree range according to the playing frame rate.

Specifically, visual effect data of multiple batches of videos are divided into at least three categories, such as best effect, worst effect and better effect; the occupancy rate data of the multiple batches are divided into corresponding maximum occupancy rates, minimum occupancy rates and lower occupancy rates; therefore, the video frame rate range corresponding to the lower occupancy rate and the better effect is determined, and the image difference degree range is determined.

In a further embodiment of the present invention, the detecting module 220 is specifically configured to determine variances of pixel parameters corresponding to the two frames of video frames according to the selected pixel parameters, and use a difference absolute value of the two determined variances as the image difference;

Wherein the selected pixel parameter is a gray scale parameter or a brightness parameter.

The gray scale parameter is taken as an example, and the determination principle of the variance of the pixel parameter corresponding to the video frame is briefly described.

Calculating the gray value X of each pixel according to the RGB value of each pixel in any video frame, and calculating the gray average value of all pixels in the video frame to obtain the gray average value E (X).

And calculating the gray variance D (x) of the video frame or the gray standard deviation of the video frame according to the gray value and the gray average value of each pixel.

Wherein the gray variance

D(X)＝E{Σ[X-E(X)]}；

Wherein, the standard deviation of gray scale

By the above method, the gray variance d (x)1 of the first video frame and the gray variance d (x)2 of the second video frame can be obtained.

Further, a difference B between the gray variance D (X)1 of the first video frame and the gray variance D (X)2 of the second video frame is calculated.

Furthermore, if the value of the difference B is smaller than a preset value, it indicates that the content of the first video frame and the content of the second video frame do not change much, the control module 230 correspondingly decreases the video playing frame rate, and if the value of the difference B is larger than a preset value, it indicates that the content of the first video frame and the content of the second video frame change greatly, a higher video playing frame rate is required to ensure the definition of video playing, and the control module 230 increases the video playing frame.

Of course, the association relationship between the difference value B and the video playing frame may be stored in advance, and different video playing frame rates may be given to different difference values B.

Of course, the above algorithm may also be used to calculate the change of the brightness parameter in the first video frame and the second video frame, so as to indicate the change speed of the content information of the obtained first video frame and the second video frame, and further correspondingly adjust the video playing frame rate.

Optionally, the detecting module 220 is specifically configured to perform face image recognition on the two video frames, determine the number of face images in the two video frames, and use the absolute value of the difference between the two determined numbers as the image difference;

that is, the face image recognition is performed on the first video frame and the second video frame, respectively, a first number of face images in the first video frame and a second number of face images in the second video frame are determined, and an absolute value of a difference between the second number and the first number is taken as the image difference degree.

According to the embodiment of the invention, whether the contents of the two video frames change or not and the change speed can be judged according to the quantity difference of the face images, so that the video playing frame rate can be correspondingly adjusted.

Optionally, the detecting module 220 is specifically configured to perform facial image recognition on the first video frame, and when at least one facial image is recognized in the first video frame, record, for any facial image, first position information of the image in the first video frame, and extract an image feature of the facial image; searching the face image in the second video frame according to the image characteristics, and recording second position information of the face image in the second video frame if the face image is searched; if the second position information is not found, setting the second position information to be 0; taking the absolute value of the difference between the second position information and the first position information as the image difference degree;

that is to say, in the embodiment of the present invention, by analyzing several key picture details, such as a face, in the first video frame and the second video frame, and by analyzing the pixel coordinate average value of the face in the first video frame and the pixel coordinate average value of the face in the second video frame, if the difference value C between the two coordinate average values is greater than a preset value, it indicates that the contents of the two video frames change faster, and then the video playing frame rate is correspondingly adjusted, so as to ensure the definition of video playing; if the difference value C of the coordinate mean values of the two video frames is smaller than a preset value, the contents of the two video frames are not changed rapidly, and the video playing frame rate is correspondingly reduced. Of course, different video playing frame rates can also be given to different coordinate average difference values C in advance.

Optionally, the detecting module 220 is specifically configured to divide the two frames of video frames into a plurality of frame images according to a set dividing number, and sequentially compare the frame images at the same position in the two frames of video frames; and recording the times of unmatched frame images according to the comparison result, and taking the ratio of the times to the segmentation number as the image difference.

Specifically, the first video frame and the second video frame are respectively divided into a plurality of frame images according to a set dividing number, and the frame images at the same position in the first video frame and the second video frame are sequentially compared; and recording the times of unmatched frame images according to the comparison result, and taking the ratio of the times to the segmentation number as the image difference.

That is to say, in the embodiment of the present invention, whether the contents of the two video frames change and how fast the contents change can be determined through the difference between the two images, so as to correspondingly adjust the video playing frame rate.

According to the embodiment of the invention, the terminal acquires the current video playing state through the preset rule, and dynamically adjusts the playing frame rate of the video playing, so that the video playing definition is ensured, the workload of the video playing processor is properly reduced on the premise of meeting the user experience, and the power consumption of the mobile device is reduced.

The invention further provides a video playing control method.

Referring to fig. 4, a video playing control method in the embodiment of the present invention includes the steps of:

s401, extracting video frames of a playing video from a preset initial time according to a playing time sequence and a set extraction period;

s402, aiming at the extracted two adjacent video frames, detecting the image difference degree of the two video frames;

s403, adjusting the playing frame rate of the video at a detection node according to the image difference degree; and the detection node is a time node corresponding to a video frame with a later playing time in the two video frames.

Further, the extraction period is a time period or a frame number period.

In an embodiment of the present invention, the adjusting, at a detection node, a frame rate of playing the video according to the image difference degree includes:

In another embodiment of the present invention, the two video frames are a first video frame and a second video frame; the detecting the image difference degree of the two video frames comprises the following steps:

According to the embodiment of the invention, the video frames of the playing video are extracted from the preset initial time according to the playing time sequence and the set extraction period, the image difference degree of the two video frames is detected aiming at the two extracted adjacent video frames, and the playing frame rate of the video is adjusted at the detection node according to the image difference degree, so that the dynamic adjustment of the playing frame rate of the playing video is realized, the processor resource occupied during the playing of the video is effectively reduced, the burden of a processor is effectively reduced, the power consumption of a terminal is effectively reduced, the service time of a terminal battery is improved, and the user experience is further improved. Meanwhile, in the dynamic adjustment process of the playing frame rate, the visual effect of video playing can be improved, and the user experience is further improved.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A terminal, characterized in that the terminal comprises:

2. The terminal of claim 1, wherein the extraction period is a time period or a frame number period.

3. The terminal of claim 1, wherein the control module is specifically configured to, at the detection node, increase a playing frame rate of the video according to a preset adjustment policy if the image difference reaches a preset first adjustment threshold; if the image difference degree is lower than a preset second adjustment threshold value, reducing the playing frame rate of the video at the detection node according to a preset adjustment strategy; the first adjustment threshold is greater than the second adjustment threshold; or,

4. The terminal according to any one of claims 1 to 3, wherein the detection module is specifically configured to determine variances of pixel parameters corresponding to the two video frames according to the selected pixel parameters, and use a difference absolute value of the determined two variances as the image difference; or,

5. The terminal according to claim 4, wherein the determining the variance of the pixel parameter corresponding to the two frames of video frames according to the selected pixel parameter, and using the absolute value of the difference between the two determined variances as the image difference comprises:

6. A video playback control method, comprising the steps of:

detecting the image difference degree of two extracted adjacent video frames;

7. The method of claim 6, wherein the extraction period is a time period or a frame number period.

8. The method as claimed in claim 6, wherein said adjusting, at a detection node, a frame rate of playing the video according to the image disparity degree comprises:

9. The method of any one of claims 6-8, wherein the two frames of video frames are a first video frame and a second video frame; the detecting the image difference degree of the two video frames comprises the following steps:

10. The method of claim 9, wherein said determining the variance of the pixel parameters corresponding to the two frames of video frames according to the selected pixel parameters comprises: