WO2021109892A1

WO2021109892A1 - Video data transmission method and terminal

Info

Publication number: WO2021109892A1
Application number: PCT/CN2020/130868
Authority: WO
Inventors: 李昭早
Original assignee: 深圳市道通智能航空技术股份有限公司
Priority date: 2019-12-03
Filing date: 2020-11-23
Publication date: 2021-06-10
Also published as: CN111225268A

Abstract

Embodiments of the present invention relate to the technical field of data processing, and in particular, to a video data transmission method and a terminal. The method comprises: operating a coding thread and a storage thread of the terminal, wherein the coding thread is used for writing video data into a buffer queue, and the storage thread is used for writing the video data in the buffer queue into a storage unit; detecting a data state of the video data in the buffer queue; and determining a working mode of the coding thread according to the data state, and transmitting the video data in the determined working mode of the coding thread. The embodiments of the present invention can prevent the problems of data overflow and the like of the buffer queue, and the stability and reliability of video data transmission are improved on the whole.

Description

Video data transmission method and terminal

【Technical Field】

The present invention relates to the technical field of data processing, in particular to a method and terminal for transmitting video data.

【Background technique】

SD card is a data storage device based on semiconductor flash memory. Due to its small size and fast data transmission speed, it is widely used as a large-capacity storage device. For example, SD cards are used to store high-quality video data. In the process of use, if the code rate of the data to be stored is too high, when the data is directly stored in the SD card, it is easy to lose data, which will cause problems such as blurring.

[Summary of the invention]

The embodiment of the present invention provides a video data transmission method and terminal, which can solve the technical problem that data loss is prone to occur when the SD card stores data.

In order to solve the above technical problems, the first technical solution provided by the embodiments of the present invention is to provide a method for transmitting video data, which is applied to a terminal, and the method includes:

Run an encoding thread and a storage thread of the terminal, where the encoding thread is used to write video data into a buffer queue, and the storage thread is used to write video data in the buffer queue into a storage unit;

Detecting the data state of the video data in the buffer queue;

The working mode of the encoding thread is determined according to the data state, and the video data is transmitted in the determined working mode of the encoding thread.

Optionally, the detecting the data status of the video data in the buffer queue includes:

Acquiring the retention rate and fluctuation status of the video data in the buffer queue;

The data status is determined according to the retention rate and the fluctuation status, wherein the data status includes a data retention status, a data empty window status, and a data circulation status.

Optionally, the determining the data status according to the retention rate and the fluctuation status includes:

When the retention rate of the video data is greater than the first preset threshold and the fluctuation state is the rising state, the number of rises within the preset time is acquired, and the data state is determined according to the retention rate and the number of rises Whether it is the data retention state;

When the retention rate of the video data is less than a second preset threshold and the fluctuation state is a non-increasing state, the retention rate of the video data within the preset time is acquired, and the video data retention rate is obtained according to the preset time. The retention rate of data determines whether the data state is the data empty window state;

When the data state of the video data is not the data retention state and is not the data empty window state, it is determined that the data state of the video data is the data circulation state.

Optionally, the determining whether the data status is the data retention status according to the retention rate and the number of rises includes:

When the retention rate and the number of rises meet any one of the following preset conditions, it is determined that the data status is the data retention status, otherwise, it is not the data retention status;

Wherein, the preset conditions include:

It is detected that more than 90% of the data retained in the buffer queue is exceeded, and the data retained in the buffer queue is increasing;

It is detected that more than 80% of the data retained in the buffer queue is exceeded, and it is continuously detected that the data retained in the buffer queue is increasing for 2 times;

It is detected that more than 70% of the data held in the buffer queue is exceeded, and it is detected that the data held in the buffer queue is rising continuously for 3 times;

It is detected that the data retained in the buffer queue exceeds 60%, and it is continuously detected that the data retained in the buffer queue is rising for 4 times;

It is detected that the data retained in the buffer queue exceeds 50%, and it is detected that the data retained in the buffer queue is rising continuously for 5 times.

Optionally, the determining whether the data state is the data empty window state according to the retention rate of the video data within the preset time includes:

When it is detected that the retention rate of the video data is less than the second preset threshold within the preset time, it is determined that the data state is the data empty window state; otherwise, it is not the data empty window state.

Optionally, the determining the working mode of the encoding thread according to the data state includes:

When the data state is a data retention state, it is determined that the working mode of the encoding thread is a reduced code rate mode;

When the data state is a data empty window state, it is determined that the working mode of the encoding thread is an up-rate mode.

Optionally, the code reduction mode specifically includes:

Obtain the current video encoding rate according to the previous video encoding rate. If video data is transmitted according to the current video encoding rate, and the data status is still the data retention state, continue according to the last video encoding rate. Obtain the current video encoding rate until the data state is not the data retention state, wherein the current video encoding rate is M% of the previous video encoding rate, and the M is a positive number less than 100.

Optionally, the bit rate up mode specifically includes:

Obtain the current video encoding rate according to the last video encoding rate. If video data is transmitted according to the current video encoding rate, the data state is still the data empty window state, then continue to be based on the previous video encoding rate. Obtain the current video encoding bit rate for one video encoding rate until the current video encoding rate is the maximum encoding rate, where the current video encoding rate is N% of the previous video encoding rate , The N is a positive number greater than 100.

Optionally, the storage unit is an SD card.

In order to solve the above technical problem, the second technical solution provided by the embodiment of the present invention is to provide a terminal, the terminal includes: an SD card; a main controller connected to the SD card; wherein, the main controller It includes at least one processor; and a buffer in communication with the at least one processor; wherein the buffer stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor. Executing, so that the at least one processor executes the video data transmission method as described above.

Compared with the prior art, the video data transmission method and terminal provided by the embodiments of the present invention, by running the encoding thread and the storage thread at the same time, first write the video data to be written into the storage unit into the buffer queue and read from the buffer queue. Take the video data and write it into the storage unit instead of directly writing the video data into the storage unit, thereby reducing the probability of video data loss and reducing the probability of problems such as blurring. In addition, in the process of transmitting video data, the data status of the buffer queue is also monitored in real time, and the working mode of the encoding thread is adjusted according to the data status of the buffer queue, so as to avoid problems such as data overflow in the buffer queue, and improve the overall video Stability and reliability of data transmission.

【Explanation of the drawings】

One or more embodiments are exemplified by the pictures in the corresponding drawings. These exemplified descriptions do not constitute a limitation on the embodiments. The elements with the same reference numerals in the drawings are denoted as similar elements. Unless otherwise stated, the figures in the attached drawings do not constitute a scale limitation.

FIG. 1 is a flowchart of a method for transmitting video data according to an embodiment of the present invention;

2 is a flowchart of a method for detecting the data state of the video data in the buffer queue in a video data transmission method provided by an embodiment of the present invention;

3 is a schematic structural diagram of a video data transmission device provided by an embodiment of the present invention;

Fig. 4 is a schematic structural diagram of a terminal provided by an embodiment of the present invention.

【Detailed ways】

In order to facilitate the understanding of the present invention, the present invention will be described in more detail below with reference to the accompanying drawings and specific embodiments. It should be noted that when an element is expressed as being "fixed to" another element, it can be directly on the other element, or there may be one or more elements in between. When an element is said to be "connected" to another element, it can be directly connected to the other element, or there may be one or more intervening elements in between. The terms "upper", "lower", "inner", "outer", "bottom", etc. used in this specification indicate the orientation or positional relationship based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention. The invention and simplified description do not indicate or imply that the pointed device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention. In addition, the terms "first", "second", "third", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance.

Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the specification of the present invention in this specification are only for the purpose of describing specific embodiments, and are not used to limit the present invention. The term "and/or" used in this specification includes any and all combinations of one or more related listed items.

In addition, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

In the embodiment of the present invention, the video data provided by the encoding unit is obtained through the encoding thread, and the video data is stored in the buffer queue, and the video data is read from the buffer queue through the storage thread and stored in the storage unit. Wherein, the encoding thread and the storage thread run in parallel at the same time, and the encoding thread releases the currently occupied system resources after storing the video data in the buffer queue, and continues to obtain the next video data from the encoding unit. The storage thread also releases the system resources currently occupied by the storage thread after storing the video data in the storage unit, and continues to read the next video data from the buffer queue. In addition, during the video data transmission process, the data status of the video data in the buffer queue is monitored in real time, and the working mode of the encoding thread is determined according to the storage status of the video data in the buffer queue, so that the video data transmission can be adjusted in time Speed to avoid abnormal situations such as data overflow or empty data in the buffer queue.

Based on the foregoing principles, embodiments of the present invention provide a method for transmitting video data. The method may be applied to a terminal, and the terminal may be other terminal devices including an SD card such as a drone. As shown in Figure 1, the method:

S11. Run an encoding thread and a storage thread of the terminal, where the encoding thread is used to write video data into a buffer queue, and the storage thread is used to write video data in the buffer queue into a storage unit.

The encoding thread refers to an operation process used to transmit data edited by the encoding unit to the buffer queue. The encoding unit may specifically be an encoding module integrated in the video signal generating device, and the encoding unit converts image data into a video signal. The data may specifically be video data. The storage thread refers to an operation process used to write data in the buffer queue into the storage unit. The storage unit may specifically be an SD card. The buffer queue may be a cache chip integrated in the video signal generating device.

In this embodiment, the encoding thread and the storage thread run in parallel at the same time. In the working process, the programming thread fetches the video data from the coding unit and sends it to the buffer queue, and then continues to fetch the video data from the coding unit. The storage thread fetches the video data from the buffer queue, sends it to the storage unit for SD card storage, and then continues back to fetch the video data from the buffer queue after the storage is complete.

Wherein, when the SD card does not fluctuate and the storage is smooth, the data transmission speed of the storage thread is generally greater than the data transmission speed of the encoding thread. Therefore, when the encoding thread inputs data into the buffer queue, the input data will be transferred by the storage thread immediately. As a result, the data can be read from the buffer queue quickly, avoiding data generated in the buffer queue. At the same time, the data buffering effect of the buffer queue can reduce the occurrence of problems such as data overflow in the storage unit.

It should be noted that the above-mentioned transmitted data is video data, and the video data may be a video edited based on coding standards such as H264 and H265. Of course, in practical applications, the data may be other data in addition to video data, such as pictures, audio, and so on.

When the SD card fluctuates, the storage thread may easily be blocked, so that the data transmitted by the storage thread cannot be smoothly written into the storage unit. The encoding thread will not be affected, and will continue to transmit video data to the buffer queue, resulting in more and more data stranded in the buffer queue. When the stranded data exceeds the preset threshold, the data in the buffer queue overflows, resulting in Huaping phenomenon occurs. Therefore, it is of great significance to monitor the data status of the data stored in the buffer queue in real time, and adjust the running process according to the data status.

S12. Detect the data status of the video data in the buffer queue.

The data status refers to the data storage status of the video data in the buffer queue, including data storage amount, data size, data type, dynamic change trend of data (such as rising or falling or stable) and so on. When the buffer queue is a cache chip integrated in the video signal generating device, the data state of the video data in the buffer queue can be detected by a controller integrated in the video signal generating device.

Specifically, referring to FIG. 2, the S12, detecting the data status of the video data in the buffer queue includes:

S121. Obtain the retention rate and the fluctuation status of the video data in the buffer queue.

S122. Determine the data status according to the retention rate and the fluctuation status, where the data status includes a data retention status, a data empty window status, and a data circulation status.

The retention rate refers to the percentage of the retained video data in the total video data that can be stored in the buffer queue when video data is retained in the buffer queue. When the time that the video data stays in the buffer queue exceeds a preset time threshold, it can be considered that a data retention phenomenon has occurred in the buffer queue. When the phenomenon of data retention occurs, the speed at which the storage thread reads data from the buffer queue is slower than the speed at which the encoding thread writes data to the buffer queue.

The rising and falling state refers to the dynamic change trend of video data in the buffer queue. The rising and falling state can be detected in a time period, and the size of the time period can be self-defined by the system. The rising and falling state includes a data rising state and a data falling state.

In this embodiment, the data status includes a data retention status, a data empty window status, and a data circulation status. The data retention state refers to a state in which the data storage amount of the video data in the buffer queue within the first preset time is greater than a first preset threshold. The data empty window state refers to a state in which the data storage amount of the video data in the buffer queue within the second preset time is less than a second preset threshold. When the buffer queue is in the data empty window state, it may be that an empty window opportunity for data waiting occurs in the buffer queue, and the video data stored in the buffer queue may be empty at the empty window opportunity. Wherein, the first preset time and the second preset time, as well as the first preset threshold and the second preset threshold may be customized by the system. Generally, when the data transmission speed of the storage thread is significantly lower than the data transmission speed of the encoding thread, a data stagnation state occurs in the buffer queue, and when the data transmission speed of the storage thread is significantly greater than the data transmission speed of the encoding thread This will cause a data empty window state to appear in the buffer queue. When the data transmission speed of the storage thread is the same as the data transmission speed of the encoding thread or the difference between the two is within a preset range, the buffer queue is in the data circulation state, that is, when the data is in the data circulation state There will be no data retention in the buffer queue, and no window opportunity for data waiting.

In this embodiment, the determining the data status according to the retention rate and the fluctuation status specifically includes:

a. When the retention rate of the video data is greater than the first preset threshold and the fluctuation state is the rising state, obtain the number of rises within the preset time, and determine the number of rises according to the retention rate and the number of rises Whether the data state is the data retention state.

The first preset threshold may be set by the system based on experience, and the size of the first preset threshold may be related to the maximum amount of data that can be stored in the buffer queue. For example, the first preset threshold is the total 50% of data storage, etc. The rising state means that the data held in the buffer queue is in a continuously increasing state. The preset time can be system-defined equipment, such as half a minute, 1 minute, etc. The number of rises may be the number of consecutive rises within a preset time.

Determining whether the data state is a data detention state according to the detention rate and the number of rises includes: when the detention rate is greater than the first preset threshold, and the number of rises meets the preset time of continuous rise Times, it is determined that the data state is a data retention state.

In some embodiments, when the retention rate and the number of rises meet any one of the following preset conditions, it is determined that the data status is the data retention status, otherwise, it is not the data retention status.

Wherein, the preset conditions include:

b. When the retention rate of the video data is less than the second preset threshold and the fluctuation state is a non-rising state, the retention rate of the video data within the preset time is acquired, and the retention rate of the video data within the preset time The retention rate of the video data determines whether the data state is the data empty window state.

The second preset threshold may be set by the system based on experience, and the size of the second preset threshold may be related to the maximum amount of data that can be stored in the buffer queue. For example, the second preset threshold is the total 10% of data storage, etc. The non-rising state includes a falling state and a non-increasing or non-decreasing state.

Wherein, the determining whether the data state is the data empty window state according to the retention rate of the video data within the preset time includes: when the retention rate of the video data is detected within the preset time When both are less than the second preset threshold, it is determined that the data state is the data empty window state; otherwise, it is not the data empty window state.

For example, if it is detected that the retention rate of the video data in the buffer queue is less than 10% for three minutes, it is determined that the data state is the data empty window state.

For another example, if it is continuously detected that the retention rate of the video data in the buffer queue is less than 10% for 10 times, it is determined that the data state is the data empty window state.

c. When the data state of the video data is not the data retention state and the data empty window state, it is determined that the data state of the video data is the data circulation state.

It can be understood that when the data state is the data retention state, it indicates that more and more data are stored in the buffer queue, and a data overflow problem may occur. When the data state is the data empty window state, it means that the data stored in the buffer queue is getting less and less, or the data stuck in the buffer queue is empty for a long time, which means that the storage unit is fast enough and needs to be increased. The data transmission speed of the large encoding thread can improve the efficiency of data storage. When the data state is the data circulation state, it indicates that the current data transmission process is reasonable and can meet the storage requirements of the storage unit.

Therefore, the following steps of the embodiment of the present invention further determine the working mode of the encoding thread according to the data state, especially when the data state is a data retention state or a data empty window state, adjust the work of the encoding thread mode.

S13. Determine a working mode of the encoding thread according to the data state, and transmit the video data in the determined working mode of the encoding thread.

In this embodiment, the working mode of the encoding thread includes an up-rate mode and a down-rate mode. The up-rate mode refers to increasing the data encoding rate of the encoding thread, and the down-rate mode refers to The purpose is to reduce the data encoding rate of the encoding thread. When the data state is a data retention state, it is determined that the working mode of the encoding thread is a reduced code rate mode, that is, the data transmission speed of the encoding thread is reduced. When the data state is a data empty window state, it is determined that the working mode of the encoding thread is an increased code rate mode, that is, the data transmission speed of the encoding thread is increased.

The code rate reduction mode specifically includes: obtaining the current video encoding rate according to the last video encoding rate, and if the video data is transmitted according to the current video encoding rate, the data status is still the data retention Status, then continue to obtain the current video encoding rate according to the last video encoding rate until the data status is not the data retention state, wherein the current video encoding rate is the last video encoding rate M% of the coding rate, where M is a positive number less than 100.

For example, reduce the video encoding rate of the current encoding thread to 80% of the previous time, and then determine whether the buffer queue is still in a data retention state, if so, continue to reduce the video encoding rate of the encoding thread, and change the encoding The video encoding rate of the thread is reduced to 80% of the last time, and then it is judged whether the buffer queue is still in the data retention state under the new video encoding rate. If so, the above process is repeated until the adjusted video encoding The rate is the minimum video encoding rate, or until the data state is not a data retention state. Wherein, the minimum video encoding rate may be 10% of the highest video encoding rate. For example, the highest video encoding rate is 3Mbps (ie 3M bits per second), a reduction of 80% is 2.4Mbps, and a further reduction of 80% is 1.92 Mbps, another 80% reduction is 1.536Mbps, and so on, the lowest can be reduced to 0.3Mbps.

The bit rate up mode specifically includes: obtaining the current video coding bit rate according to the last video coding bit rate, if the video data is transmitted according to the current video coding bit rate, the data status is still the data empty Window state, continue to obtain the current video encoding rate according to the last video encoding rate until the current video encoding rate is the maximum encoding rate, wherein the current video encoding rate is above N% of the one-time video encoding bit rate, where N is a positive number greater than 100.

For example, when the data state is the data empty window state, the video encoding rate of the encoding thread is increased to 110% of the previous time, and then it is judged whether the data state of the buffer queue is the data empty window state, if so, Then continue to increase the video encoding rate by 110% until the data state is not a data empty window state, or the video encoding rate is the maximum encoding rate.

It should be noted that the above-mentioned code-up rate mode and code-down mode can be triggered according to the data state corresponding to the buffer queue, and the coding thread can run in one of the coding modes, or it can be in one of the two coding modes. Convert between. In addition, the embodiment of the present invention mainly adjusts the working mode of the encoding thread according to the data state of the buffer queue. In some other embodiments, the working mode of the storage thread can also be adjusted, or the encoding thread and the storage are adjusted at the same time. The working mode of the thread.

The following takes the storage unit as an SD card for specific examples.

For example, if the SD card is a high-speed card and has little fluctuation, the aforementioned bit rate reduction condition will not be triggered when the video data is stored through the SD card, and the video data can be transmitted at the highest bit rate state. If the SD card is a high-speed card and the fluctuation is large, the above code rate condition will be triggered when the SD card fluctuation is blocked, and the above code rate condition will be triggered when the SD card fluctuation ends. At this time, the video data transmission can be The highest bit rate status transmission. If the SD card is a low-speed card, the storage thread speed is slow, and the aforementioned code reduction rate condition will continue to be triggered. When the video encoding rate is reduced to the point where the speed of the storage thread exceeds the speed of the encoding thread, the data stuck in the buffer queue It will gradually decrease. If the data in the buffer queue is empty for a long time, the above-mentioned rate-up rate condition will be triggered. After several down-code adjustments and up-code adjustments, the video encoding rate will eventually be maintained at a certain value, and the encoding thread and storage thread will maintain A balance to achieve the result of adaptive SD card storage rate.

The video data transmission method provided by the embodiment of the present invention can be applied to the recording process, such as drone recording.

Various SD card compatibility issues and SD card storage volatility issues can be solved through the above-mentioned bit rate up strategy and bit rate down strategy, and a low-speed card storage solution is also provided.

The embodiment of the present invention provides a video data transmission method. The method writes the video data to be written into the storage unit into the buffer queue first, reads the video data from the buffer queue by running the encoding thread and the storage thread at the same time, and then reads the video data from the buffer queue. Write to the storage unit instead of directly writing the video data to the storage unit, thereby reducing the probability of video data loss and reducing the probability of problems such as blurring. In addition, in the process of transmitting video data, the data status of the buffer queue is also monitored in real time, and the working mode of the encoding thread is adjusted according to the data status of the buffer queue, so as to avoid problems such as data overflow and data empty windows in the buffer queue. The above improves the stability and reliability of video data transmission.

As shown in FIG. 3, an embodiment of the present invention provides a video data transmission device 20. The device 20 is applied to a terminal. The device 20 includes an operation module 21, a detection module 22, and a processing module 23.

The running module 21 is used to run the encoding thread and the storage thread of the terminal, wherein the encoding thread is used to write video data into the buffer queue, and the storage thread is used to transfer the video in the buffer queue. Data is written to the storage unit. The detection module 22 is used to detect the data state of the video data in the buffer queue. The processing module 23 is configured to determine the working mode of the encoding thread according to the data state, and transmit the video data in the determined working mode of the encoding thread.

Wherein, the detection module 22 includes a first acquisition unit 221 and a first processing unit 222. The first obtaining unit 221 is configured to obtain the retention rate and the fluctuation status of the video data in the buffer queue. The first processing unit 222 is configured to determine the data status according to the retention rate and the fluctuation status, where the data status includes a data retention status, a data empty window status, and a data circulation status.

Wherein, the first processing unit 222 is specifically configured to:

Wherein, the determining whether the data state is the data detention state according to the detention rate and the number of rises includes: when the detention rate and the number of rises meet any one of the following preset conditions , It is determined that the data status is the data retention status, otherwise, it is not the data retention status. Wherein, the preset conditions include:

Wherein, the processing module 23 is specifically configured to: when the data state is a data retention state, determine that the working mode of the encoding thread is a reduced code rate mode; when the data state is a data window state, determine that The working mode of the encoding thread is an up-rate mode, and the video data is transmitted in the determined working mode of the encoding thread.

Wherein, the bit rate reduction mode specifically includes: obtaining the current video coding bit rate according to the last video coding bit rate, and if the video data is transmitted according to the current video coding bit rate, the data status is still the Data retention status, then continue to obtain the current video encoding bit rate according to the last video encoding bit rate until the data status is not the data retention status, wherein the current video encoding bit rate is the last time M% of the video encoding bit rate of, where M is a positive number less than 100.

It is worth noting that the information interaction between the modules and units in the above-mentioned device, the execution process, etc., are based on the same concept as the method embodiment of the present invention. For specific content, please refer to the description in the method embodiment of the present invention. No longer.

As shown in FIG. 4, it is a schematic structural diagram of a terminal provided by an embodiment of the present invention. The internal structure of the terminal 30 includes, but is not limited to: a processor 31 and a memory 32. The memory 32 includes an encoding thread 321, a buffer queue 322, and a storage thread 323. Wherein, the processor 31 and the memory 32 in the terminal 30 may be connected by a bus or other methods. In FIG. 4 shown in the embodiment of the present invention, a bus connection is taken as an example.

The processor 31 is the computing core and control core of the terminal 30, which can process various data of the terminal. For example, the processor 31 can control the encoding thread 321 to obtain the video data that needs to be stored, and store the video data. To the buffer queue 322; for another example, the processor 31 may control the storage thread 323 to read video data from the buffer queue 322 and store the video data in an SD card, and so on.

The memory 32 is a memory device in the terminal 30 for storing data and programs. It is understandable that the memory 32 may include a built-in memory of the terminal 30 or an extended memory supported by the terminal 30. In the embodiment of the present invention, the storage space of the memory 32 also stores an encoding thread 321, a buffer queue 322, and a storage thread 323.

The one or more modules are stored in the memory 32, and when executed by the one or more processors 31, the video data transmission method in any of the foregoing method embodiments is executed, for example, as shown in FIG. 1 The method steps S11 to S13 and the method steps S121 to S122 shown in FIG. 2 implement the functions of the modules 21-23 and units 221-222 in FIG. 3.

The above-mentioned products can execute the methods provided in the embodiments of the present invention, and have corresponding functional modules and beneficial effects for executing the methods. For technical details that are not described in detail in this embodiment, refer to the method provided in the embodiment of the present invention.

The terminals of the embodiments of the present invention exist in various forms, including but not limited to other devices with video recording functions and SD card storage such as drones.

The device embodiments described above are merely illustrative, where the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

Through the description of the above implementation manners, a person of ordinary skill in the art can clearly understand that each implementation manner can be implemented by means of software plus a general hardware platform, and of course, it can also be implemented by hardware. A person of ordinary skill in the art can understand that all or part of the processes in the method of the foregoing embodiments can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. When executed, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; under the idea of the present invention, the technical features of the above embodiments or different embodiments can also be combined. The steps can be implemented in any order, and there are many other variations of the different aspects of the present invention as described above. For the sake of brevity, they are not provided in the details; although the present invention has been described in detail with reference to the foregoing embodiments, it is common in the art The skilled person should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or equivalently replace some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the implementations of the present invention. Examples of the scope of technical solutions.

Claims

A method for transmitting video data, applied to a terminal, characterized in that the method includes:

Run an encoding thread and a storage thread of the terminal, where the encoding thread is used to write video data into a buffer queue, and the storage thread is used to write video data in the buffer queue into a storage unit;

Detecting the data state of the video data in the buffer queue;

The working mode of the encoding thread is determined according to the data state, and the video data is transmitted in the determined working mode of the encoding thread.
The method according to claim 1, wherein the detecting the data status of the video data in the buffer queue comprises:

Acquiring the retention rate and fluctuation status of the video data in the buffer queue;

The data status is determined according to the retention rate and the fluctuation status, wherein the data status includes a data retention status, a data empty window status, and a data circulation status.
The method according to claim 2, wherein the determining the data status according to the retention rate and the fluctuation status comprises:

When the retention rate of the video data is greater than the first preset threshold and the fluctuation state is the rising state, the number of rises within the preset time is acquired, and the data state is determined according to the retention rate and the number of rises Whether it is the data retention state;

When the retention rate of the video data is less than a second preset threshold and the fluctuation state is a non-increasing state, the retention rate of the video data within the preset time is acquired, and the video data retention rate is obtained according to the preset time. The retention rate of data determines whether the data state is the data empty window state;

When the data state of the video data is not the data retention state and is not the data empty window state, it is determined that the data state of the video data is the data circulation state.
The method according to claim 3, wherein the determining whether the data state is the data detention state according to the detention rate and the number of rises comprises:

When the retention rate and the number of rises meet any one of the following preset conditions, it is determined that the data status is the data retention status, otherwise, it is not the data retention status;

Wherein, the preset conditions include:

It is detected that more than 90% of the data retained in the buffer queue is exceeded, and the data retained in the buffer queue is increasing;

It is detected that more than 80% of the data retained in the buffer queue is exceeded, and it is continuously detected that the data retained in the buffer queue is increasing for 2 times;

It is detected that more than 70% of the data held in the buffer queue is exceeded, and it is detected that the data held in the buffer queue is rising continuously for 3 times;

It is detected that the data retained in the buffer queue exceeds 60%, and it is continuously detected that the data retained in the buffer queue is rising for 4 times;

It is detected that the data retained in the buffer queue exceeds 50%, and it is detected that the data retained in the buffer queue is rising continuously for 5 times.
The method according to claim 3, wherein the determining whether the data state is the data empty window state according to the retention rate of the video data within the preset time comprises:

When it is detected that the retention rate of the video data is less than the second preset threshold within the preset time, it is determined that the data state is the data empty window state; otherwise, it is not the data empty window state.
The method according to any one of claims 2 to 5, wherein the determining the working mode of the encoding thread according to the data state comprises:

When the data state is a data retention state, determining that the working mode of the encoding thread is a reduced code rate mode;

When the data state is a data empty window state, it is determined that the working mode of the encoding thread is an up-rate mode.
The method according to claim 6, wherein the code rate reduction mode specifically comprises:

Obtain the current video encoding rate according to the previous video encoding rate. If video data is transmitted according to the current video encoding rate, and the data status is still the data retention state, continue to follow Obtain the current video encoding rate until the data state is not the data retention state, wherein the current video encoding rate is M% of the previous video encoding rate, and the M is a positive number less than 100.
The method according to claim 6, wherein the bit rate up mode specifically comprises:

Obtain the current video encoding rate according to the last video encoding rate. If video data is transmitted according to the current video encoding rate, the data state is still the data empty window state, then continue to be based on the previous video encoding rate. Obtain the current video encoding bit rate for one video encoding rate until the current video encoding rate is the maximum encoding rate, where the current video encoding rate is N% of the previous video encoding rate , The N is a positive number greater than 100.
The method according to any one of claims 1 to 5, wherein the storage unit is an SD card.
A terminal, characterized in that the terminal includes:

At least one processor; and

A memory communicatively connected with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute any one of claims 1 to 9 method.