CN108322802A - Stick picture disposing method, computer readable storage medium and the terminal of video image - Google Patents

Stick picture disposing method, computer readable storage medium and the terminal of video image Download PDF

Info

Publication number
CN108322802A
CN108322802A CN201711476832.0A CN201711476832A CN108322802A CN 108322802 A CN108322802 A CN 108322802A CN 201711476832 A CN201711476832 A CN 201711476832A CN 108322802 A CN108322802 A CN 108322802A
Authority
CN
China
Prior art keywords
beat point
textures
music
point
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711476832.0A
Other languages
Chinese (zh)
Inventor
危文
袁少龙
周宇涛
丘智鉴
颜乐驹
魏启征
李敬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Baiguoyuan Information Technology Co Ltd
Original Assignee
Guangzhou Baiguoyuan Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Baiguoyuan Information Technology Co Ltd filed Critical Guangzhou Baiguoyuan Information Technology Co Ltd
Priority to CN201711476832.0A priority Critical patent/CN108322802A/en
Publication of CN108322802A publication Critical patent/CN108322802A/en
Priority to PCT/CN2018/119266 priority patent/WO2019114582A1/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4394Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H04N21/8113Monomedia components thereof involving special audio data, e.g. different tracks for different languages comprising music, e.g. song in MP3 format
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The present invention provides a kind of stick picture disposing method of video image, and this method includes:The image played in video is obtained, increases textures in described image;The music signal for obtaining the music for being intended to play in playing video, the beat point of the music is detected according to the music signal;It determines when playing music in playing video, beat point occurs in current play position;Obtain the corresponding textures special efficacy of the beat point;The textures in described image are handled according to the textures special efficacy, obtain the video image for including the textures special efficacy.This method can realize that simultaneously real-time edition obtains personalized broadcasting video to user to express the individual character of oneself by the music of self-defined setting, textures and textures special efficacy, it meets the personalized of user and plays video designs demand, increase the interest of Video Applications and the interactivity of application and user, significantly improves the satisfaction of user experience.

Description

Stick picture disposing method, computer readable storage medium and the terminal of video image
Technical field
The present invention relates to technical field of image processing, specifically, the present invention relates to a kind of stick picture disposings of video image Method, computer readable storage medium and terminal.
Background technology
With the continuous development of Internet technology and image processing techniques, added in video image in video capture The style of shooting of textures gradually receives pursuing for people.User can be applied by corresponding textures in captured video image It is middle to add the paster oneself liked, and then increase the interest of shooting process.
However, the textures application of the prior art, is typically only capable to simply add the textures that user selectes on the video images, Textures exhibition method is single, fails to give full play to the interactivity between user and application, the pleasure that user obtains in shooting process Interest is less, and satisfaction of users is not high.
Invention content
For overcome the above technical problem, the especially prior art can not improve user and application between interactive enthusiasm, Using the interesting insufficient problem of experience, spy proposes following technical scheme:
The embodiment of the present invention provides a kind of stick picture disposing method of video image according on one side, including:
The image played in video is obtained, increases textures in described image;
The music signal for obtaining the music for being intended to play in playing video, the music is detected according to the music signal Beat point;
It determines when playing music in playing video, beat point occurs in current play position;
Obtain the corresponding textures special efficacy of the beat point;
The textures in described image are handled according to the textures special efficacy, obtain the video for including the textures special efficacy Image.
Preferably, the textures include:Two dimensional model textures based on AR augmented realities and/or threedimensional model textures.
Preferably, described to obtain the image played in video, increase textures in described image, including:
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
Preferably, described to obtain the image played in video, after increasing textures in described image, further include:
Confirmation receives textures switching command;Switch in increased textures in described image.
Further, the confirmation receives textures switching command, including:
The sound in the broadcasting video is obtained, identifies the audio frequency characteristics of the sound;If the audio frequency characteristics with it is preset Textures switching password audio frequency characteristics matching it is consistent, confirmation receives the textures switching command;Or
The personage region in described image is identified, if in personage's region detection to preset textures switching action, really Recognize and receives the textures switching command.
Preferably, the video is live video;
It is described to obtain the image played in video, before increasing textures in described image, further include:
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action;
If so, obtaining the preset textures of the main broadcaster;The image for obtaining and playing in video is carried out, in described image The step of increasing textures.
Preferably, the beat point includes strong beat point and weak beat point;
The beat point that the music is detected according to the music signal, including:
The music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum;
According to the frequency spectrum, the energy change value of test point is determined;
According to energy change value, detect that strong beat point or weak beat point occurs in test point.
Preferably, the beat point includes strong beat point and weak beat point;
The beat point that the music is detected according to the music signal, including:
Processing is weighted to the music signal, the music signal after being weighted;
According to the energy intensity value of the music signal after the weighting, detect that strong beat point or weak beat occurs in test point Point.
Preferably, the beat point includes strong beat point;
The beat point that the music is detected according to the music signal, including:
Candidate beat point is obtained according to the energy intensity value of the music signal;
According to each candidate beat point, each two neighboring candidate beat point of statistics time interval between frames;
According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
Preferably, the beat point includes strong beat point;
The beat point that the music is detected according to the music signal, including:
According to the energy variation difference of the music signal of test point, candidate beat point is obtained;
According to the candidate beat point, two sections of music letters are intercepted as signal starting point using each two neighboring candidate beat point Number;
According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs.
Preferably, the acquisition is intended to the music signal of the music played in playing video, is examined according to the music signal The beat point of the music is measured, including:
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong section of detection Clap point and weak beat point;
If detecting strong beat point, judge using intensity value detection or changing value detection;
It is detected according to intensity value, candidate beat point is obtained according to the energy intensity value of the music signal, according to each time Select beat point, each two neighboring candidate beat point of statistics time interval between frames detected according to the time interval Candidate beat point corresponds to test point and strong beat point occurs;
It is detected according to changing value, according to the energy variation difference of the music signal of test point, obtains candidate beat point, root According to the candidate beat point, two sections of music signals, root are intercepted as signal starting point using each two neighboring candidate beat point According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs;
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection;
It is detected according to intensity value, processing is weighted to the music signal, the music signal after being weighted, according to The energy intensity value of music signal after the weighting detects that strong beat point or weak beat point occurs in test point;
It is detected according to changing value, the music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtained Frequency spectrum determines the energy change value of test point according to the frequency spectrum, according to energy change value, detects that weak section occurs in test point Clap point or strong candidate beat point;
The judgement detects strong beat point, or detects strong beat point and weak beat point, including:
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point according to textures special efficacy type needed for video, also It is to detect strong beat point and weak beat point;
If described detect strong beat point, judge using intensity value detection or changing value detection, including:
If detecting strong beat point, the type of the music is obtained, judges to detect or change using intensity value according to type Value detection;
If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including:
If detecting strong beat point and weak beat point, the type of the music is obtained, judges to examine using intensity value according to type It surveys or changing value detects.
Preferably, after the beat point that the music is detected according to the music signal, further include, described in record The correspondence of music position and beat point;
There is beat point when playing music in playing video in current play position in the determination, including:
According to the correspondence, determines when playing music in playing video, beat point occur in current play position.
The embodiment of the present invention additionally provides a kind of computer readable storage medium, the calculating according on the other hand It is stored with computer program on machine readable storage medium storing program for executing, which realizes the textures of above-mentioned video image when being executed by processor Processing method.
The embodiment of the present invention additionally provides a kind of terminal according to another aspect, and the terminal includes one or more Processor;Memory;One or more application program, wherein one or more of application programs are stored in the memory In and be configured as being executed by one or more of processors, one or more of programs are configured to:It executes above-mentioned The stick picture disposing method of video image.
Compared with prior art, the present invention having the advantages that:
The stick picture disposing method of video image provided by the invention, by increasing textures in video image, and to being intended to Play the music that plays in video and carry out beat point detection, and during music according to detected beat point regarding The corresponding textures special efficacy of beat point is shown in frequency image, so that the textures special efficacy shown on video image and selected video The beat point tight association for playing music, improves the textures of the music and display that are played in playing video in the sense of hearing and regards Appeal in feel;And user can express the individual character of oneself simultaneously by the music of self-defined setting, textures and textures special efficacy Can real-time edition obtain personalized broadcasting video, this method meets the personalized of user and plays video designs demand, increases The interest of Video Applications and the interactivity of application and user, significantly improve the satisfaction of user experience.
In addition, the stick picture disposing method of video image provided by the invention is realized fast in conjunction with multiple beat point detecting methods Speed, the beat point for accurately detecting selected video playing music, and can be according to textures special efficacy type and music needed for video Type come the type of detection beat point needed for selecting and the method for detecting beat point, with realize using suitable method come To accurate beat point, and operand can be reduced, shorten detection duration, be further ensured that the textures special efficacy shown on video image With the beat point close association of selected video playing music;User can be by conveniently and efficiently increasing according to the wish of oneself Add or switch textures, further increases the interest of Video Applications and the interactivity of application and user;Straight applied to video When broadcasting field, the requirement of live streaming disclosure satisfy that, set off live streaming atmosphere, and the more preferable interaction for promoting main broadcaster and spectators by contrast, further carry The satisfaction of high user experience.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description Obviously, or practice through the invention is recognized.
Description of the drawings
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments Obviously and it is readily appreciated that, wherein:
Fig. 1 is a kind of method flow diagram of the stick picture disposing method of video image of the embodiment of the present invention;
Fig. 2 is a kind of structural schematic diagram of terminal of the embodiment of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached The embodiment of figure description is exemplary, and is only used for explaining the present invention, and is not construed as limiting the claims.
Embodiment one
An embodiment of the present invention provides a kind of stick picture disposing methods of video image, as shown in Figure 1, this method includes:
Step S101, the image played in video is obtained, increases textures in described image.
For the present embodiment, the textures can be the two dimensional model textures based on AR augmented realities, can also be to be based on The threedimensional model textures of AR augmented realities.The AR (Augmented Reality) is a kind of by real world information and virtual The augmented reality that world information is combined and shown.By augmented reality, increase base in the image in playing video In the textures of AR augmented realities, the image of real world can will be played in video with computer virtual image superposition in same picture In, to realize information integration and the interaction of real world and virtual world.
For the present embodiment, the textures can specifically be used as the materials such as fireworks, love, the snowflake of background classes textures, Can also be the materials such as corner, beard, glasses as face decorative kind textures, the specific manifestation form of the material is in this reality It applies in example and does not limit.Wherein, increased textures can be that User Defined is arranged in playing video image, can also be Video Applications default setting.After determining textures, terminal-pair plays the image in video and carries out scene Recognition, and then in video The corresponding position of image increases textures.
Step S102, the music signal for obtaining the music for being intended to play in playing video is detected according to the music signal Go out the beat point of the music.
For the present embodiment, the music for being intended to play in playing video can be from the music that prestores in Video Applications Selected music can also be the selected music loaded in Video Applications of the music that prestores from user terminal, can also be The live music played using other equipment obtained by microphone in Video Applications, the source of the music is in the present embodiment In do not limit.
For the present embodiment, the action for obtaining music signal, which is implemented in user, to be selected and is intended to play in playing video After music, and the action for selecting the music can execute before playing video, can also be executed in playing video.
For example, when applied to net cast field, the music can be selected before net cast or in net cast, terminal The music signal of selected music can be obtained immediately, and the beat point of the music is detected according to the music signal.
In another example when being applied to the recording of short-sighted frequency, the music is selected before playing video that is, before video record, Terminal can obtain the music signal of selected music at once after selected music, and detect the sound according to the music signal Happy beat point.
It is described to detect that a variety of methods can be used in the beat point of the music according to the music signal for the present embodiment It realizes.
For example, for this method, the beat point includes strong beat point and weak beat point;This method includes:To the sound Music signal is filtered, and short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum;According to the frequency spectrum, the energy of test point is determined Measure changing value;According to energy change value, detect that strong beat point or weak beat point occurs in test point.
In another example for this method, the beat point includes strong beat point and weak beat point;This method includes:To described Music signal is weighted processing, the music signal after being weighted;According to the energy intensity of the music signal after the weighting Value detects that strong beat point or weak beat point occurs in test point.
In another example for this method, the beat point includes strong beat point;This method includes:According to the music signal Energy intensity value obtain candidate beat point;According to each candidate beat point, frame where each two neighboring candidate beat point of statistics it Between time interval;According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
For another example for this method, the beat point includes strong beat point;This method includes:According to the music of test point The energy variation difference of signal obtains candidate beat point;According to the candidate beat point, made with each two neighboring candidate beat point Two sections of music signals are intercepted for signal starting point;According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to There is strong beat point in test point.
Step S103, it determines when playing music in playing video, beat point occurs in current play position.
For the present embodiment, each beat point detected in step s 102 corresponds to the different broadcasting positions of the music It sets, when playing music in net cast, if music current play position is corresponding with the beat point that step S102 is detected, really The fixed beat point is strong beat point or weak beat point.
Step S104, the corresponding textures special efficacy of the beat point is obtained.
For the present embodiment, the textures special efficacy refers to textures state when textures correspond to different resemblance parameters. Different resemblance parameters can be arranged in material in the textures, and the resemblance parameter includes state parameter, size ginseng Number, color parameter etc., do not limit in the present embodiment.In addition, the beat point in a piece of music generally includes strong beat Point and weak beat point, the material in strong beat point textures special efficacy corresponding with weak beat point is identical, but material is outer Shape characteristic parameter differs.For example, the textures that user chooses are Little Bear threedimensional model, and for the textures in strong beat point and weak Different resemblance parameters is set when beat point, the dance step that Little Bear threedimensional model is danced in video image in strong beat point Frequency is larger, and the dance step frequency that it is danced in weak beat point is then relatively low.
Step S105, the textures in described image are handled according to the textures special efficacy, it includes the textures to obtain The video image of special efficacy.
For the present embodiment, by obtaining the material for being provided with a certain resemblance parameter in the textures special efficacy, and The material and the image in the broadcasting video are synthesized in a manner of map overlay, obtained comprising in the textures special efficacy Material video image.In other embodiments, it can also use and textures special efficacy and image are subjected to Data Integration or root The other modes such as image, which are changed, according to the resemblance parameter of material in textures special efficacy realizes that it includes the textures special efficacy to obtain described Video image.
For example, in net cast field, can the data of textures special efficacy and net cast image data be subjected to data Integration obtains vedio data packet, and the data packet is sent to client, so that client is shown comprising textures spy The video image of effect.
In another example can be by the resemblance parameter of material in acquisition textures special efficacy, according to the resemblance parameter Processing is zoomed in and out to image, to obtain the video image that special effect can be achieved and highlight.
The stick picture disposing method of video image provided by the invention, by increasing textures in video image, and to being intended to Play the music that plays in video and carry out beat point detection, and during music according to detected beat point regarding The corresponding textures special efficacy of beat point is shown in frequency image, so that the textures special efficacy shown on video image and selected video The beat point tight association for playing music, improves the textures of the music and display that are played in playing video in the sense of hearing and regards Appeal in feel;And user can express the individual character of oneself simultaneously by the music of self-defined setting, textures and textures special efficacy Can real-time edition obtain personalized broadcasting video, this method meets the personalized of user and plays video designs demand, increases The interest of Video Applications and the interactivity of application and user, significantly improve the satisfaction of user experience.
In addition, the stick picture disposing method of video image provided by the invention is realized fast in conjunction with multiple beat point detecting methods Speed, the beat point for accurately detecting selected video playing music, are further ensured that the textures special efficacy shown on video image With the beat point close association of selected video playing music, the satisfaction of user experience is further increased.
Embodiment two
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one Step shown in example two, wherein
Further include the correspondence for recording the music position and beat point after the step S102.
For the present embodiment, after detecting the beat point of the music according to the music signal, by the beat Correspondence is established in the corresponding music position of point, and records the correspondence.The foundation side of the correspondence Method does not limit in the present embodiment, can be the mode for adding label information.
For example, the signal data in the corresponding music position of the beat point adds label information, the label information Carry the information for indicating that there is beat point in the music position and the beat point is strong beat point or weak beat point.
The step S103, including:According to the correspondence, determine when playing music in playing video, current There is beat point in play position.
For the present embodiment, when playing music in playing video, in current play position, there are corresponding with beat point When record, obtains the music position and the correspondence of beat point records, extract the correspondence, and then according to institute It states correspondence and determines that current play position beat point occurs and determines that the beat point is strong beat point or weak beat point.
For the present embodiment, by recording the correspondence of the music position and beat point, it can be achieved that simple, fast It is strong beat point or weak beat point to determine whether current play position beat point and beat point occurs fastly.
Embodiment three
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one Step shown in example three, wherein
The step S101, including:
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
For the present embodiment, the textures are mainly the materials such as face decorative kind textures, such as corner, beard, glasses, eventually End to the image played in video by carrying out recognition of face, and then the corresponding position of face increases textures in video image. For example, being selected in the human face region played in video increases the textures such as virtual ear, beard, textures can be with the face one of user Play movement, realize virtually and the combination of reality with it is interactive.
For the present embodiment, user can by it is self-defined setting textures and textures special efficacy come express oneself individual character and can be real When editor obtain the broadcasting video of its personalized visualization design, meet the personalized visualization design requirement of user, increase video The interest of application and the interactivity of application and user, significantly improve the satisfaction of user experience.
Example IV
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one Step shown in example four, wherein
After the step S101, further include:
Confirmation receives textures switching command;Switch in increased textures in described image.
For the present embodiment, when user to increased textures are dissatisfied in video image when, textures can be sent out to terminal Textures to be switched to the textures material oneself liked by switching command.The mode of the instruction textures switching can be that voice refers to Show, act instruction and input instruction etc. modes, the present embodiment this is not limited.
For example, when by switching of the voice to indicate textures, terminal obtains the sound in the broadcasting video first, and knows The audio frequency characteristics and preset textures are then switched password, such as " switching ", " change " mouth by the audio frequency characteristics of the not described sound The audio frequency characteristics of order are matched, if matching is consistent, confirmation receives the textures switching command, and is cut to textures It changes.
In another example when by acting the switching to indicate textures, terminal identifies the personage region in described image first, And the figure action in personage region is detected, if in personage's region detection to preset textures switching action, such as The actions such as " waving ", " shaking the head " then confirm and receive the textures switching command, and switched over to textures.
For another example when by inputting the switching to indicate textures, it is another that user need to only re-enter selection in Video Applications One textures, you can current textures are switched over.
For the present embodiment, user can switch over textures by the wish conveniently and efficiently according to oneself, further The interest of Video Applications and the interactivity of application and user are increased, the satisfaction of user experience is significantly improved.
Embodiment five
For the present embodiment, the video is live video, i.e. method in the present embodiment is mainly used in net cast Field.
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one Step shown in example five, wherein
Before the step S101, further include:
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action;
If so, obtaining the preset textures of the main broadcaster;The image for obtaining and playing in video is carried out, in described image The step of increasing textures.
For the present embodiment, main broadcaster can ask to wrap to obtain during net cast by executing preset increase textures Net cast image containing textures.The mode that the request increases textures can be voice request, action request and input request Etc. modes, the present embodiment this is not limited.
For example, by voice come when asking to increase textures, terminal obtains the sound in the broadcasting video first, and identifies The audio frequency characteristics of the sound, then by the audio frequency characteristics and preset increase textures password, such as " textures ", " variable body " mouth The audio frequency characteristics of order are matched, if matching is consistent, just increase textures in the image for playing video.
In another example when by acting to ask to increase textures, terminal identifies the personage region in described image first, and Figure action in personage region is detected, if in personage's region detection to preset textures switching action, such as " ratio The actions such as the heart ", " airkissing " just increase textures in the image for playing video.
For another example when by inputting to ask to increase textures, user need to only click one textures of selection in Video Applications, Just increase the textures in the image for playing video.
In other embodiments, the textures can also be selected by the spectators in net cast, can also by main broadcaster according to The highest textures of temperature are selected according to the wish of spectators between net cast.This method disclosure satisfy that the requirement of live streaming, set off live streaming atmosphere by contrast It encloses, and the more preferable interaction for promoting main broadcaster and spectators, further increases the satisfaction of user experience.
Embodiment six
The alternatively possible realization method of the embodiment of the present invention further includes implementing on the basis of shown in embodiment one Step shown in example six, wherein
The step S102, including:
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong section of detection Clap point and weak beat point;
If detecting strong beat point, judge using intensity value detection or changing value detection;It is detected according to intensity value, according to The energy intensity value of the music signal obtains candidate beat point, according to each candidate beat point, each two neighboring candidate section of statistics Point institute time interval between frames is clapped, according to the time interval, detects that candidate beat point corresponds to test point and occurs saving by force Clap point;It is detected according to changing value, according to the energy variation difference of the music signal of test point, obtains candidate beat point, according to Candidate's beat point intercepts two sections of music signals using each two neighboring candidate beat point as signal starting point, according to The comparing result of two sections of music signals detects that candidate beat point corresponds to test point and strong beat point occurs;
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection;According to intensity Value detection, processing is weighted to the music signal, and the music signal after being weighted is believed according to the music after the weighting Number energy intensity value, detect that strong beat point or weak beat point occurs in test point;It is detected according to changing value, to the music Signal is filtered, and short time discrete Fourier transform is carried out after filtering, is obtained frequency spectrum and is determined the energy of test point according to the frequency spectrum Changing value detects that weak beat point or strong candidate beat point occurs in test point according to energy change value;
The present embodiment is corresponding with different for the type and examination criteria of different required detection beat points Beat detection methods.
Wherein, the judgement detects strong beat point, or detects strong beat point and weak beat point, including:
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point according to textures special efficacy type needed for video, also It is to detect strong beat point and weak beat point;If described detect strong beat point, judge using intensity value detection or changing value detection, Including:If detecting strong beat point, the type of the music is obtained, judges to examine using intensity value detection or changing value according to type It surveys;If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including:If detection Strong beat point and weak beat point, obtain the type of the music, judge to examine using intensity value detection or changing value according to type It surveys.
For the present embodiment, can textures special efficacy type needed for the video by acquisition come the class of detection beat point needed for judging Type.Textures special efficacy type needed for the video is user's selection or Video Applications acquiescence textures special efficacy type.For example, with Family wishes there is the textures special efficacy to emerge one after another in playing video, therefore being judged according to textures special efficacy type needed for its video should Strong beat point is detected, weak beat point is also detected.
It is that examination criteria is judged by the type of the music of acquisition for the present embodiment.For example, acquired music Type be rock and roll, the music signal of the music type often has very high intensity value, but its changing value unobvious, thus according to Its type selects to detect the beat point of the music by detection intensity value.
For the present embodiment, required detection beat can be selected according to the type of textures special efficacy type and music needed for video The type of point and the method for detecting beat point are obtained accurate beat point using suitable method to realize, and can reduced Operand shortens detection duration, is further ensured that the tight association of the textures special efficacy and music beat point that are shown on video image Property, further increase the satisfaction of user experience.
In addition, an embodiment of the present invention provides a kind of computer readable storage medium, deposited on computer readable storage medium Computer program is contained, at the textures that the video image described in above example one to six is realized when which is executed by processor Reason method.Wherein, the computer readable storage medium includes but not limited to any kind of disk (including floppy disk, hard disk, light Disk, CD-ROM and magneto-optic disk), ROM (Read-Only Memory, read-only memory), RAM (Random AcceSS Memory, immediately memory), EPROM (EraSable Programmable Read-Only Memory, erasable programmable Read-only memory), EEPROM (Electrically EraSable Programmable Read-Only Memory, electrically erasable Programmable read only memory), flash memory, magnetic card or light card.It is, storage device include by equipment (for example, calculate Machine, mobile phone) any medium of storage or transmission information in the form of it can read can be read-only memory, disk or CD etc..
A kind of computer readable storage medium provided in an embodiment of the present invention by increasing in video image, it can be achieved that pasted Figure, and the music to being intended to play in playing video carries out beat point detection, and during music detected by Beat point the corresponding textures special efficacy of beat point is shown in video image so that the textures special efficacy shown on video image with The beat point tight association of selected video playing music, improves the textures of the music and display that are played in playing video In the sense of hearing and visual appeal;And user can be expressed by the music of self-defined setting, textures and textures special efficacy The individual character of oneself and can real-time edition obtain personalized broadcasting video, the personalized video that plays that this method meets user is set Meter demand increases the interest of Video Applications and the interactivity of application and user, significantly improves the satisfaction of user experience.This Outside, the computer readable storage medium can be additionally used in:In conjunction with multiple beat point detecting methods, realization quickly and accurately detects Go out the beat point of selected video playing music, and can be according to the type of textures special efficacy type and music needed for video to select The method that the type of beat point need to be detected and detect beat point obtains accurate beat using suitable method to realize Point, and operand can be reduced, shorten detection duration, is further ensured that the textures special efficacy shown on video image is regarded with selected Frequency plays the beat point close association of music;User can be pasted by conveniently and efficiently being increased according to the wish of oneself or being switched Figure further increases the interest of Video Applications and the interactivity of application and user;When applied to net cast field, energy Enough requirements for meeting live streaming set off live streaming atmosphere, and the more preferable interaction for promoting main broadcaster and spectators by contrast, further increase user experience Satisfaction.
The embodiment of the method for above-mentioned offer may be implemented in computer readable storage medium provided in an embodiment of the present invention, specifically Function realizes the explanation referred in embodiment of the method, and details are not described herein.
In addition, the embodiment of the present invention additionally provides a kind of terminal, as shown in Fig. 2, the terminal may include one or More than one processor 201, further include memory 202, WiFi (wireless fidelity, Wireless Fidelity) circuit 203, RF (Radio Frequency, radio frequency) circuit 204, voicefrequency circuit 205, sensor 206, output equipment 207, input equipment 204, power supply 209, processor 201 are the control centres of terminal, utilize various interfaces and the above each section of connection.This field Technical staff is appreciated that the restriction of terminal structure shown in Figure 2 not structure paired terminal, may include than illustrate it is more or Less component either combines certain components or different components arrangement.
WiFi circuitry 203 can provide WLAN or internet access to the user;It may include antenna, WiFi module Deng.RF circuits 204 can receive and send messages, or signal sends and receivees in communication process;It may include antenna, at least one puts Big device, tuner, one or more oscillators, coupler, duplexer etc..The audio data that voicefrequency circuit 205 can will receive It is converted into electric signal, is transferred to loud speaker, also the voice signal that microphone is collected audio data can be converted to, issue processor 201 processing;Loud speaker, microphone, earphone interface etc. can be arranged in it.Sensor 206 can be used for incuding outer signals, and issue place Device 201 is managed to handle;It may include motion sensor, optical sensor etc..Output equipment 207 can be used for showing various signals;It can For using LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) etc. forms configure display panel.Input equipment 204 can be used for inputting the letters such as number and character Breath;It can be physical button, touch panel etc..Power supply 209 can be that terminal each section is powered, and pass through power-supply management system and processing 209 logical connection of device;It may include one or more direct current or AC power, charging system, power supply status indicator Equal components.Memory 202 can be used for storing software program and module;It can be computer readable storage medium, be specifically Hard disk, flash memory etc..Processor is the control centre of terminal, by running or executing the software program being stored in memory 202 And/or module, and the data for being stored in memory 202 are called, execute terminal various functions, processing terminal data.
As one embodiment, terminal includes:One or more processors 201, memory 202, one or more application Program, wherein one or more of application programs are stored in memory 202 and are configured as by one or more of Processor 201 executes, and one or more of programs are configured to carry out the video image described in above example one to six Stick picture disposing method.
A kind of terminal provided in an embodiment of the present invention in video image, it can be achieved that by increasing textures, and to being intended to broadcasting Put the music that is played in video and carry out beat point detection, and during music according to detected beat point in video The corresponding textures special efficacy of beat point is shown in image, so that the textures special efficacy shown on video image is broadcast with selected video The beat point tight association put the music on, improves the textures of the music and display that are played in playing video in the sense of hearing and vision On appeal;And user can by the music of self-defined setting, textures and textures special efficacy come express oneself individual character and can Real-time edition obtains personalized broadcasting video, and this method meets the personalized of user and plays video designs demand, and increase regards The interest of frequency application and the interactivity of application and user, significantly improve the satisfaction of user experience.In addition, the terminal may be used also For:In conjunction with multiple beat point detecting methods, the beat point for quickly and accurately detecting selected video playing music is realized, And the type of detection beat point and detection needed for being selected according to the type of textures special efficacy type and music needed for video save The method for clapping point is obtained accurate beat point using suitable method to realize, and can reduce operand, when shortening detection It is long, it is further ensured that the beat point tight association of the textures special efficacy and selected video playing music shown on video image Property;User can further increase the interest of Video Applications by conveniently and efficiently increasing or switching textures according to the wish of oneself Taste and the interactivity of application and user;When applied to net cast field, the requirement of live streaming disclosure satisfy that, set off live streaming atmosphere by contrast It encloses, and the more preferable interaction for promoting main broadcaster and spectators, further increases the satisfaction of user experience.
The embodiment of the method for above-mentioned offer may be implemented in terminal provided in an embodiment of the present invention, and concrete function realization refers to Explanation in embodiment of the method, details are not described herein.
The above is only some embodiments of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered It is considered as protection scope of the present invention.

Claims (14)

1. a kind of stick picture disposing method of video image, which is characterized in that include the following steps:
The image played in video is obtained, increases textures in described image;
The music signal for obtaining the music for being intended to play in playing video, the section of the music is detected according to the music signal Clap point;
It determines when playing music in playing video, beat point occurs in current play position;
Obtain the corresponding textures special efficacy of the beat point;
The textures in described image are handled according to the textures special efficacy, obtain the video figure for including the textures special efficacy Picture.
2. stick picture disposing method according to claim 1, which is characterized in that the textures include:Based on AR augmented realities Two dimensional model textures and/or threedimensional model textures.
3. stick picture disposing method according to claim 1, which is characterized in that it is described to obtain the image played in video, Increase textures in described image, including:
The image played in video is obtained, identifies the human face region in described image, increases textures in the human face region.
4. stick picture disposing method according to claim 1, which is characterized in that it is described to obtain the image played in video, After increasing textures in described image, further include:
Confirmation receives textures switching command;Switch in increased textures in described image.
5. stick picture disposing method according to claim 4, which is characterized in that the confirmation receives textures switching command, Including:
The sound in the broadcasting video is obtained, identifies the audio frequency characteristics of the sound;If the audio frequency characteristics and preset patch The audio frequency characteristics matching of figure switching password is consistent, and confirmation receives the textures switching command;Or
The personage region in described image is identified, if in personage's region detection to preset textures switching action, confirmation connects Receive the textures switching command.
6. stick picture disposing method according to claim 1, which is characterized in that the video is live video;
It is described to obtain the image played in video, before increasing textures in described image, further include:
Judge whether the main broadcaster that end is broadcast live executes preset increase textures request action;
If so, obtaining the preset textures of the main broadcaster;The image for obtaining and playing in video is carried out, is increased in described image The step of textures.
7. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point and weak section Clap point;
The beat point that the music is detected according to the music signal, including:
The music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtains frequency spectrum;
According to the frequency spectrum, the energy change value of test point is determined;
According to energy change value, detect that strong beat point or weak beat point occurs in test point.
8. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point and weak section Clap point;
The beat point that the music is detected according to the music signal, including:
Processing is weighted to the music signal, the music signal after being weighted;
According to the energy intensity value of the music signal after the weighting, detect that strong beat point or weak beat point occurs in test point.
9. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point;
The beat point that the music is detected according to the music signal, including:
Candidate beat point is obtained according to the energy intensity value of the music signal;
According to each candidate beat point, each two neighboring candidate beat point of statistics time interval between frames;
According to the time interval, detect that candidate beat point corresponds to test point and strong beat point occurs.
10. stick picture disposing method according to claim 1, which is characterized in that the beat point includes strong beat point;
The beat point that the music is detected according to the music signal, including:
According to the energy variation difference of the music signal of test point, candidate beat point is obtained;
According to the candidate beat point, two sections of music signals are intercepted as signal starting point using each two neighboring candidate beat point;
According to the comparing result of two sections of music signals, detect that candidate beat point corresponds to test point and strong beat point occurs.
11. stick picture disposing method according to claim 1, which is characterized in that the acquisition is intended to play in playing video Music music signal, the beat point of the music is detected according to the music signal, including:
The music signal for obtaining the music for being intended to play in playing video judges to detect strong beat point, or the strong beat point of detection With weak beat point;
If detecting strong beat point, judge using intensity value detection or changing value detection;
It is detected according to intensity value, candidate beat point is obtained according to the energy intensity value of the music signal, according to each candidate section Clap point, each two neighboring candidate beat point of statistics time interval between frames candidate is detected according to the time interval Beat point corresponds to test point and strong beat point occurs;
It is detected according to changing value, according to the energy variation difference of the music signal of test point, candidate beat point is obtained, according to institute Candidate beat point is stated, two sections of music signals are intercepted as signal starting point using each two neighboring candidate beat point, according to two The comparing result of section music signal detects that candidate beat point corresponds to test point and strong beat point occurs;
If detecting strong beat point and weak beat point, judge using intensity value detection or changing value detection;
It is detected according to intensity value, processing is weighted to the music signal, the music signal after being weighted, according to described The energy intensity value of music signal after weighting detects that strong beat point or weak beat point occurs in test point;
It is detected according to changing value, the music signal is filtered, short time discrete Fourier transform is carried out after filtering, obtain frequency Spectrum, according to the frequency spectrum, determines the energy change value of test point, according to energy change value, detects that weak beat occurs in test point Point or strong candidate beat point;
The judgement detects strong beat point, or detects strong beat point and weak beat point, including:
Textures special efficacy type needed for video is obtained, is judged to detect strong beat point, or inspection according to textures special efficacy type needed for video Survey strong beat point and weak beat point;
If described detect strong beat point, judge using intensity value detection or changing value detection, including:
If detecting strong beat point, the type of the music is obtained, judges to examine using intensity value detection or changing value according to type It surveys;
If described detect strong beat point and weak beat point, judge using intensity value detection or changing value detection, including:
If detecting strong beat point and weak beat point, the type of the music is obtained, is judged using intensity value detection also according to type It is changing value detection.
12. stick picture disposing method according to claim 1, which is characterized in that described to be detected according to the music signal Further include the correspondence for recording the music position and beat point after the beat point of the music;
There is beat point when playing music in playing video in current play position in the determination, including:
According to the correspondence, determines when playing music in playing video, beat point occur in current play position.
13. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program realizes claim 1 to 12 any one of them stick picture disposing method when the program is executed by processor.
14. a kind of terminal, which is characterized in that it includes:
One or more processors;
Memory;
One or more application program, wherein one or more of application programs are stored in the memory and are configured To be executed by one or more of processors, one or more of programs are configured to:It executes according to claim 1 to 12 Any one of them stick picture disposing method.
CN201711476832.0A 2017-12-15 2017-12-29 Stick picture disposing method, computer readable storage medium and the terminal of video image Pending CN108322802A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201711476832.0A CN108322802A (en) 2017-12-29 2017-12-29 Stick picture disposing method, computer readable storage medium and the terminal of video image
PCT/CN2018/119266 WO2019114582A1 (en) 2017-12-15 2018-12-05 Video image processing method and computer storage medium and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711476832.0A CN108322802A (en) 2017-12-29 2017-12-29 Stick picture disposing method, computer readable storage medium and the terminal of video image

Publications (1)

Publication Number Publication Date
CN108322802A true CN108322802A (en) 2018-07-24

Family

ID=62894187

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711476832.0A Pending CN108322802A (en) 2017-12-15 2017-12-29 Stick picture disposing method, computer readable storage medium and the terminal of video image

Country Status (1)

Country Link
CN (1) CN108322802A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108986842A (en) * 2018-08-14 2018-12-11 百度在线网络技术(北京)有限公司 Music style identifying processing method and terminal
CN109034063A (en) * 2018-07-27 2018-12-18 北京微播视界科技有限公司 Plurality of human faces tracking, device and the electronic equipment of face special efficacy
CN109120992A (en) * 2018-09-13 2019-01-01 北京金山安全软件有限公司 Video generation method and device, electronic equipment and storage medium
CN109361852A (en) * 2018-10-18 2019-02-19 维沃移动通信有限公司 A kind of image processing method and device
CN109379623A (en) * 2018-11-08 2019-02-22 北京微播视界科技有限公司 Video content generation method, device, computer equipment and storage medium
CN109618229A (en) * 2018-12-21 2019-04-12 广州酷狗计算机科技有限公司 Association playback method, device, server and the storage medium of audio-video
CN109688324A (en) * 2018-12-04 2019-04-26 深圳市子瑜杰恩科技有限公司 Short-sighted channel tool switching method and Related product
CN109729394A (en) * 2018-12-05 2019-05-07 深圳市子瑜杰恩科技有限公司 The stage property sort method and Related product of short-sighted frequency
WO2019114582A1 (en) * 2017-12-15 2019-06-20 广州市百果园信息技术有限公司 Video image processing method and computer storage medium and terminal
CN110069641A (en) * 2019-03-27 2019-07-30 北京字节跳动网络技术有限公司 Image processing method, device and electronic equipment
CN110072047A (en) * 2019-01-25 2019-07-30 北京字节跳动网络技术有限公司 Control method, device and the hardware device of image deformation
CN110675310A (en) * 2019-07-02 2020-01-10 北京达佳互联信息技术有限公司 Video processing method and device, electronic equipment and storage medium
CN110798737A (en) * 2019-11-29 2020-02-14 北京达佳互联信息技术有限公司 Video and audio synthesis method, terminal and storage medium
CN111225232A (en) * 2018-11-23 2020-06-02 北京字节跳动网络技术有限公司 Video-based sticker animation engine, realization method, server and medium
CN111597984A (en) * 2020-05-15 2020-08-28 北京百度网讯科技有限公司 Sticker testing method, device, electronic equipment and computer readable storage medium
CN111857923A (en) * 2020-07-17 2020-10-30 北京字节跳动网络技术有限公司 Special effect display method and device, electronic equipment and computer readable medium
CN113055738A (en) * 2019-12-26 2021-06-29 北京字节跳动网络技术有限公司 Video special effect processing method and device
CN113632498A (en) * 2019-03-28 2021-11-09 多玩国株式会社 Content distribution system, content distribution method, and content distribution program
CN114201096A (en) * 2020-08-31 2022-03-18 伊普西龙信息科技(北京)有限公司 Method, device, equipment and medium for processing multimedia playing interface
EP4167192A4 (en) * 2020-07-10 2023-12-13 Beijing Bytedance Network Technology Co., Ltd. Image processing method and apparatus for augmented reality, electronic device and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101123086A (en) * 2006-08-09 2008-02-13 株式会社河合乐器制作所 Tempo detection apparatus and tempo-detection computer program
CN101165773A (en) * 2006-10-20 2008-04-23 索尼株式会社 Signal processing apparatus and method, program, and recording medium
CN104103300A (en) * 2014-07-04 2014-10-15 厦门美图之家科技有限公司 Method for automatically processing video according to music beats
US20150007708A1 (en) * 2009-05-27 2015-01-08 Microsoft Corporation Detecting beat information using a diverse set of correlations
CN104822095A (en) * 2015-02-08 2015-08-05 苏州乐聚一堂电子科技有限公司 Composite beat special effect system and composite beat special effect processing method
CN105872838A (en) * 2016-04-28 2016-08-17 徐文波 Sending method and device of special media effects of real-time videos
CN106331735A (en) * 2016-08-18 2017-01-11 北京奇虎科技有限公司 Special effect processing method, electronic device and server
CN106658035A (en) * 2016-12-09 2017-05-10 武汉斗鱼网络科技有限公司 Dynamic display method and device for special effect gift
CN107103917A (en) * 2017-03-17 2017-08-29 福建星网视易信息系统有限公司 Music rhythm detection method and its system
CN107124624A (en) * 2017-04-21 2017-09-01 腾讯科技(深圳)有限公司 The method and apparatus of video data generation

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101123086A (en) * 2006-08-09 2008-02-13 株式会社河合乐器制作所 Tempo detection apparatus and tempo-detection computer program
CN101165773A (en) * 2006-10-20 2008-04-23 索尼株式会社 Signal processing apparatus and method, program, and recording medium
US20150007708A1 (en) * 2009-05-27 2015-01-08 Microsoft Corporation Detecting beat information using a diverse set of correlations
CN104103300A (en) * 2014-07-04 2014-10-15 厦门美图之家科技有限公司 Method for automatically processing video according to music beats
CN104822095A (en) * 2015-02-08 2015-08-05 苏州乐聚一堂电子科技有限公司 Composite beat special effect system and composite beat special effect processing method
CN105872838A (en) * 2016-04-28 2016-08-17 徐文波 Sending method and device of special media effects of real-time videos
CN106331735A (en) * 2016-08-18 2017-01-11 北京奇虎科技有限公司 Special effect processing method, electronic device and server
CN106658035A (en) * 2016-12-09 2017-05-10 武汉斗鱼网络科技有限公司 Dynamic display method and device for special effect gift
CN107103917A (en) * 2017-03-17 2017-08-29 福建星网视易信息系统有限公司 Music rhythm detection method and its system
CN107124624A (en) * 2017-04-21 2017-09-01 腾讯科技(深圳)有限公司 The method and apparatus of video data generation

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019114582A1 (en) * 2017-12-15 2019-06-20 广州市百果园信息技术有限公司 Video image processing method and computer storage medium and terminal
CN109034063A (en) * 2018-07-27 2018-12-18 北京微播视界科技有限公司 Plurality of human faces tracking, device and the electronic equipment of face special efficacy
US11749020B2 (en) 2018-07-27 2023-09-05 Beijing Microlive Vision Technology Co., Ltd Method and apparatus for multi-face tracking of a face effect, and electronic device
CN108986842A (en) * 2018-08-14 2018-12-11 百度在线网络技术(北京)有限公司 Music style identifying processing method and terminal
CN109120992A (en) * 2018-09-13 2019-01-01 北京金山安全软件有限公司 Video generation method and device, electronic equipment and storage medium
CN109361852A (en) * 2018-10-18 2019-02-19 维沃移动通信有限公司 A kind of image processing method and device
CN109379623A (en) * 2018-11-08 2019-02-22 北京微播视界科技有限公司 Video content generation method, device, computer equipment and storage medium
CN111225232A (en) * 2018-11-23 2020-06-02 北京字节跳动网络技术有限公司 Video-based sticker animation engine, realization method, server and medium
CN109688324A (en) * 2018-12-04 2019-04-26 深圳市子瑜杰恩科技有限公司 Short-sighted channel tool switching method and Related product
CN109729394A (en) * 2018-12-05 2019-05-07 深圳市子瑜杰恩科技有限公司 The stage property sort method and Related product of short-sighted frequency
CN109618229A (en) * 2018-12-21 2019-04-12 广州酷狗计算机科技有限公司 Association playback method, device, server and the storage medium of audio-video
CN110072047A (en) * 2019-01-25 2019-07-30 北京字节跳动网络技术有限公司 Control method, device and the hardware device of image deformation
WO2020151491A1 (en) * 2019-01-25 2020-07-30 北京字节跳动网络技术有限公司 Image deformation control method and device and hardware device
US11409794B2 (en) 2019-01-25 2022-08-09 Beijing Bytedance Network Technology Co., Ltd. Image deformation control method and device and hardware device
CN110069641A (en) * 2019-03-27 2019-07-30 北京字节跳动网络技术有限公司 Image processing method, device and electronic equipment
CN110069641B (en) * 2019-03-27 2021-04-20 北京字节跳动网络技术有限公司 Image processing method and device and electronic equipment
US11961190B2 (en) 2019-03-28 2024-04-16 Dwango Co., Ltd. Content distribution system, content distribution method, and content distribution program
CN113632498A (en) * 2019-03-28 2021-11-09 多玩国株式会社 Content distribution system, content distribution method, and content distribution program
CN110675310A (en) * 2019-07-02 2020-01-10 北京达佳互联信息技术有限公司 Video processing method and device, electronic equipment and storage medium
US11705160B2 (en) 2019-07-02 2023-07-18 Beijing Dajia Internet Information Technology Co., Ltd. Method and device for processing video
US11114130B2 (en) 2019-07-02 2021-09-07 Beijing Dajia Internet Information Technology Co., Ltd. Method and device for processing video
CN110798737A (en) * 2019-11-29 2020-02-14 北京达佳互联信息技术有限公司 Video and audio synthesis method, terminal and storage medium
KR20220106848A (en) * 2019-12-26 2022-07-29 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 Video special effects processing methods and devices
WO2021129628A1 (en) * 2019-12-26 2021-07-01 北京字节跳动网络技术有限公司 Video special effects processing method and apparatus
CN113055738A (en) * 2019-12-26 2021-06-29 北京字节跳动网络技术有限公司 Video special effect processing method and device
US11882244B2 (en) 2019-12-26 2024-01-23 Beijing Bytedance Network Technology Co., Ltd. Video special effects processing method and apparatus
KR102700232B1 (en) 2019-12-26 2024-08-30 베이징 바이트댄스 네트워크 테크놀로지 컴퍼니, 리미티드 Method and device for processing video special effects
CN111597984B (en) * 2020-05-15 2023-09-26 北京百度网讯科技有限公司 Label paper testing method, device, electronic equipment and computer readable storage medium
CN111597984A (en) * 2020-05-15 2020-08-28 北京百度网讯科技有限公司 Sticker testing method, device, electronic equipment and computer readable storage medium
EP4167192A4 (en) * 2020-07-10 2023-12-13 Beijing Bytedance Network Technology Co., Ltd. Image processing method and apparatus for augmented reality, electronic device and storage medium
WO2022012182A1 (en) * 2020-07-17 2022-01-20 北京字节跳动网络技术有限公司 Special effect display method and apparatus, electronic device, and computer readable medium
CN111857923A (en) * 2020-07-17 2020-10-30 北京字节跳动网络技术有限公司 Special effect display method and device, electronic equipment and computer readable medium
CN114201096A (en) * 2020-08-31 2022-03-18 伊普西龙信息科技(北京)有限公司 Method, device, equipment and medium for processing multimedia playing interface

Similar Documents

Publication Publication Date Title
CN108322802A (en) Stick picture disposing method, computer readable storage medium and the terminal of video image
CN108111909A (en) Method of video image processing and computer storage media, terminal
CN108259925A (en) Music gifts processing method, storage medium and terminal in net cast
CN109756784B (en) Music playing method, device, terminal and storage medium
CN109302538B (en) Music playing method, device, terminal and storage medium
CN108259983A (en) A kind of method of video image processing, computer readable storage medium and terminal
CN106162369B (en) It is a kind of to realize the method, apparatus and system interacted in virtual scene
US11701567B2 (en) Wireless electronic table game scoreboard
CN108259984A (en) Method of video image processing, computer readable storage medium and terminal
CN108810576A (en) The even method, apparatus and storage medium of wheat live streaming
CN109448761B (en) Method and device for playing songs
CN109600678A (en) Information displaying method, apparatus and system, server, terminal, storage medium
CN108401124A (en) The method and apparatus of video record
CN109151593A (en) Main broadcaster's recommended method, device storage medium
CN112541959B (en) Virtual object display method, device, equipment and medium
CN109040297A (en) User's portrait generation method and device
CN109348247A (en) Determine the method, apparatus and storage medium of audio and video playing timestamp
CN108965922A (en) Video cover generation method, device and storage medium
JP7425805B2 (en) Method, device, terminal, and computer program for previewing actions during a match in a non-combat environment
CN109587549B (en) Video recording method, device, terminal and storage medium
JP2013102359A (en) Control program, input terminal device, control system, and control method
CN109035180A (en) Video broadcasting method, device, equipment and storage medium
CN107948702A (en) Synchronous method, device, terminal and the storage medium of Application Status
CN110139143A (en) Virtual objects display methods, device, computer equipment and storage medium
CN109743461A (en) Audio data processing method, device, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180724

RJ01 Rejection of invention patent application after publication