CN105760386B - Electronic pictures music score of Chinese operas scrolling method, apparatus and system - Google Patents
Electronic pictures music score of Chinese operas scrolling method, apparatus and system Download PDFInfo
- Publication number
- CN105760386B CN105760386B CN201410788131.0A CN201410788131A CN105760386B CN 105760386 B CN105760386 B CN 105760386B CN 201410788131 A CN201410788131 A CN 201410788131A CN 105760386 B CN105760386 B CN 105760386B
- Authority
- CN
- China
- Prior art keywords
- music score
- electronic picture
- bar
- mobile terminal
- sections
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 238000010586 diagram Methods 0.000 claims description 44
- 238000005096 rolling process Methods 0.000 claims description 36
- 210000001260 vocal cord Anatomy 0.000 claims description 33
- 230000006870 function Effects 0.000 description 13
- 230000008569 process Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000033764 rhythmic process Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
Landscapes
- Auxiliary Devices For Music (AREA)
Abstract
The present invention provides a kind of electronic pictures music score of Chinese operas scrolling method, apparatus and system, and method therein includes: to obtain type, position and the normal play speed of each trifle in the electronic pictures music score of Chinese operas；According to the type of acquired each trifle and position and the normal play speed of each trifle, control rolls the electronic pictures music score of Chinese operas in mobile terminal screen.Using the present invention, the rich feature of carrying and collection convenience, Internet resources based on the electronic pictures music score of Chinese operas can solve the problem of electronic pictures music score of Chinese operas need to roll page turning by hand, so that user be allowed more advantageously to use the electronic pictures music score of Chinese operas.
Description
Technical Field
The present invention relates to the field of mobile communication technologies, and in particular, to a method, an apparatus, and a system for scrolling a music score of an electronic picture.
Background
At present, music scores used by players mainly include paper music scores and electronic picture music scores. Wherein, the paper music score is inconvenient to carry and collect, and is difficult to automatically roll and turn pages when playing.
The existing music score display equipment can solve the problems of automatic rolling and page turning of paper music scores, but the equipment is expensive and inconvenient to move. The electronic picture music score well solves the carrying and collection problems of paper music scores, and the on-line music score has rich resources and can conveniently obtain the required music score. However, since the symbols of the electronic picture music score are too small, the electronic picture music score is very inconvenient to view on a portable electronic device with a small screen (such as a mobile terminal like a mobile phone), and the whole content of one music score can still be viewed by manually scrolling and turning pages.
Therefore, it is desirable to provide a method for automatically scrolling an electronic picture music score on a mobile terminal.
Disclosure of Invention
In view of the foregoing problems, an object of the present invention is to provide a method, an apparatus and a system for scrolling an electronic picture music score, which can solve the problem that the electronic picture music score needs to be manually scrolled and turned, so as to enable a user to use the electronic picture music score more conveniently.
According to an aspect of the present invention, there is provided an electronic picture music score scrolling method, including: acquiring the type, position and standard playing speed of each measure in the electronic picture music score;
and controlling the electronic picture music score to scroll in the screen of the mobile terminal according to the acquired type and position of each section and the standard playing speed of each section.
Furthermore, it is preferable that the type and position of each bar in the electronic picture music score are determined as follows:
and scanning the electronic picture music score in an image identification mode, identifying each measure in the electronic picture music score, and analyzing the type and the position of each measure.
Further, it is preferable that the standard playback speed of each bar in the electronic picture score is determined as follows:
scanning the electronic picture music score in an image identification mode, identifying each measure of the electronic picture music score, and analyzing each note of each measure;
analyzing each note of the measure in an audio pitch identification mode to obtain a frequency waveform diagram of the electronic picture music score;
obtaining a frequency oscillogram of the original vocal cords according to the audio data of the original vocal cords corresponding to the electronic picture music score;
the standard playback speed of each bar in the electronic picture music score is determined based on the frequency waveform pattern of the electronic picture music score and the frequency waveform pattern of the acoustic band.
In addition, it is preferable that the analyzing each note of the measure by audio pitch recognition to obtain the frequency waveform diagram of the electronic picture music score comprises:
determining the sound frequency of each note and the number of beats occupied by each note;
and forming a frequency waveform diagram of the music score according to the sound frequency of each note and the number of beats occupied by each note.
Further, it is preferable that the determining of the standard playback speed of each bar in the electronic picture music score based on the frequency waveform pattern of the electronic picture music score and the frequency waveform pattern of the acoustic band includes:
acquiring an inosculating part thereof according to the frequency waveform diagram of the music score and the frequency waveform diagram of the original vocal cords, and determining the number of bars occupied by the inosculating part in the electronic picture music score and the playing time in the audio data of the original vocal cords;
the standard playback speed of each bar in the electronic picture music score is determined based on the number of bars occupied by the matching sections in the electronic picture music score and the playback time in the audio data of the original band.
Further, it is preferable that the controlling of the scrolling of the electronic picture music score in the screen of the mobile terminal according to the type and position of each of the acquired bars and the standard play speed of each of the bars includes:
controlling each bar to scroll on the screen of the mobile terminal at a standard playing speed within a preset time according to the position of each bar and the type of each bar; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling to continue to display the next bar in a rolling way after the bar is displayed in a rolling way; and if the section scroll-displayed on the screen of the mobile terminal is a repeated section, controlling repeated display of the repeated section after the section scroll-displayed.
In addition, it is preferable that the types and positions of the respective measures in the electronic picture music score are acquired from a server or a mobile terminal; and acquiring the standard playing speed of each bar in the electronic picture music score from the server or the mobile terminal.
According to another aspect of the present invention, there is provided an electronic picture music score scrolling device, comprising:
a section information acquisition unit for acquiring the type and position of each section in the electronic picture music score;
the speed information acquisition unit is used for acquiring the standard playing speed of each bar in the electronic picture music score;
and a scrolling unit for controlling scrolling of the electronic picture music score in the screen of the mobile terminal according to the acquired type and position of each bar and the standard playing speed of each bar.
Further, it is preferable that the section information acquiring unit acquires the type and position of each section in the electronic picture curved spectrum includes:
and scanning the electronic picture music score by adopting an image identification mode, identifying each section in the electronic picture music score, and analyzing the type and the position of each section.
Further, it is preferable that the speed information acquiring unit includes:
the system comprises a frequency oscillogram acquisition unit of the music score, a frequency oscillogram acquisition unit and a frequency oscillogram analysis unit, wherein the frequency oscillogram acquisition unit is used for scanning the electronic picture music score in an image identification mode, identifying each measure of the electronic picture music score and analyzing each note of each measure; analyzing each note of the measure in an audio pitch identification mode to obtain a frequency waveform diagram of the electronic picture music score;
the electronic picture music score acquiring unit is used for acquiring the audio data of the original vocal cords corresponding to the electronic picture music score;
and a standard playing speed determination unit for determining the standard playing speed of each bar in the electronic picture music score according to the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cord.
In addition, it is preferable that the frequency waveform diagram obtaining unit of the music score analyzes each note of the measure by using an audio pitch recognition method, and the obtaining of the frequency waveform diagram of the electronic picture music score includes:
determining the sound frequency of each note and the number of beats occupied by each note; and forming a frequency waveform diagram of the music score according to the sound frequency of each note and the number of beats occupied by each note.
Further, it is preferable that the standard playback speed determining unit determines the standard playback speed of each bar in the electronic picture music score based on the frequency waveform pattern of the music score and the frequency waveform pattern of the acoustic band includes:
acquiring an coincident portion thereof from the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords, and determining the number of occupied measures and the time of playback in the audio data of the original vocal cords; the standard playback speed of each bar in the electronic picture score is determined based on the number of bars occupied by the matching section in the electronic picture score and the time of playback in the audio data of the original soundtrack.
Further, it is preferable that the scrolling unit controls the scrolling of the electronic picture music score in the screen of the mobile terminal based on the acquired type and position of each bar and the standard play speed of each bar includes:
controlling each bar to scroll on the screen of the mobile terminal at a standard playing speed within a preset time according to the position of each bar and the type of each bar; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling to continue to display the next bar in a rolling way after the bar is displayed in a rolling way; and if the section scroll-displayed on the screen of the mobile terminal is a repeated section, controlling repeated display of the repeated section after the section scroll-displayed.
In addition, it is preferable that the electronic picture music score scrolling device is provided in the mobile terminal or the server.
According to another aspect of the present invention, there is provided a system comprising a mobile terminal and a server,
a mobile terminal for acquiring the type, position and standard playing speed of each bar in the electronic picture music score from the server, and controlling the electronic picture music score to be scroll-displayed in a screen of the mobile terminal according to the type and position of each bar acquired from the server and the standard playing speed of each bar;
and the server is used for providing the type, the position and the standard playing speed of each measure in the electronic picture music score for the mobile terminal.
According to another aspect of the present invention, there is provided a system comprising a mobile terminal and a server,
the server is used for acquiring the type, the position and the standard playing speed of each section in the electronic picture music score and controlling the mobile terminal to scroll the electronic picture music score in the screen of the mobile terminal according to the acquired type and the position of each section and the standard playing speed of each section;
and the mobile terminal is used for rolling the electronic picture music score in the screen of the mobile terminal according to the control of the server.
According to the technical scheme, the electronic picture music score rolling method can control the electronic picture music score to roll in the screen of the mobile terminal according to the type and the position of each section and the standard playing speed of each section in the electronic picture music score by acquiring the type, the position and the standard playing speed of each section, so that the electronic picture music score can be automatically rolled, a user can play conveniently, the phenomenon that the playing is interrupted in the midway of music score page turning operation is avoided, the requirement of playing at any place can be well met, in addition, expensive music score automatic page turning hardware equipment can be avoided being purchased, and the user can more conveniently use the electronic picture music score.
To the accomplishment of the foregoing and related ends, one or more aspects of the invention comprise the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative aspects of the invention. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Further, the present invention is intended to include all such aspects and their equivalents.
Drawings
Other objects and results of the present invention will become more apparent and more readily appreciated as the same becomes better understood by reference to the following description and appended claims, taken in conjunction with the accompanying drawings. In the drawings:
FIG. 1 is a flowchart illustrating a scrolling method of an electronic picture music score according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a method for identifying the location and type of each section of an electronic picture music score by image recognition according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a process of obtaining a standard playback speed of each bar in an electronic picture score according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating a scrolling process of an electronic picture score on a screen of a mobile terminal according to an embodiment of the present invention;
FIGS. 5-1 and 5-2 are schematic diagrams illustrating effects of scrolling an electronic picture score on a screen of a mobile terminal according to an embodiment of the present invention, respectively;
FIG. 6 is a block diagram of the logic structure of an electronic music score scrolling device according to an embodiment of the present invention;
fig. 7 is a block diagram of a standard playback speed acquisition unit of the electronic picture music score scrolling device according to the embodiment of the present invention;
fig. 8 is a block diagram of a system architecture according to an embodiment of the present invention.
The same reference numbers in all figures indicate similar or corresponding features or functions.
Detailed Description
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that such embodiment(s) may be practiced without these specific details.
The paper music score is inconvenient to carry and collect; although the electronic picture music score solves the carrying and collection problems of paper music scores, the symbols of the electronic picture music score on the display screen of the mobile equipment are too small, so that each section in the music score can be seen clearly only by manually scrolling and turning pages.
Aiming at the problems, the invention provides an electronic picture music score rolling method, which comprehensively utilizes an image identification mode and an audio frequency high identification mode based on the characteristics of carrying and collection convenience and network resource richness of the electronic picture music score to solve the problem that the electronic picture music score needs to be rolled and turned manually, thereby enabling a user to use the electronic picture music score more conveniently. Since the data processing object to which the present invention relates is an electronic picture score, in the following description, unless otherwise specified, the score referred to refers to an electronic picture score.
Specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
In order to illustrate the method for scrolling the electronic picture music score provided by the present invention, fig. 1 shows a flow of the method for scrolling the electronic picture music score according to the embodiment of the present invention.
As shown in fig. 1, the method for scrolling the electronic picture music score provided by the present invention includes:
s110: the type, position and standard playing speed of each bar in the electronic picture music score are obtained.
S120: and controlling the electronic picture music score to scroll in the screen of the mobile terminal according to the acquired type and position of each section and the standard playing speed of each section.
In step S110, the server or the mobile terminal may first identify the position and the type of each bar of the electronic picture music score by using an image identification method, and identify the position of each bar in the electronic picture music score and the type of each bar; then, the image recognition mode is adopted to recognize the note of each measure in the electronic picture music score, and the standard playing speed of each measure is obtained according to the audio pitch recognition mode. It should be noted that, the standard playing speed of each bar is: and the speed of automatic scrolling of the electronic picture music score on the screen of the mobile terminal.
The following will explain in detail how to acquire the type, position, and standard playback speed of each bar of the electronic picture score.
In the process of acquiring the type and the position of each section of the electronic picture music score, the electronic picture music score is scanned in an image identification mode, and the type and the position of each section of the electronic picture music score are identified.
The image recognition is a computer program created by simulating the movement of a human recognition image, and recognizes various images based on an image recognition model in the computer program. In the invention, each bar in the electronic picture music score can be identified in this way, and the identified bar is analyzed to obtain the type, the position and each note of each bar.
It should be noted that the music score is structurally composed of the individual bars, and the playing length of each bar is the same. The music score is played in the order of the bars from the viewpoint of performance, with the exception of a case where a repeated symbol marked on a bar is encountered, and it is necessary to jump back to the bar where repetition starts as instructed by the repeated symbol and then play until an end symbol is encountered, that is, the types of bars of a general music score include both normal types and repeated types. Therefore, the electronic picture music score is played on the premise that the type and position of each bar are identified.
Fig. 2 shows a process for identifying the position and type of each section of the electronic picture music score by image recognition according to the embodiment of the present invention.
As shown in fig. 2, the process of identifying the position and type of each bar of the electronic picture music score includes:
s210: scanning the picture music score to identify a section in the picture music score;
the scanning mode can be from left to right, from top to bottom, and each section can be identified through scanning in sequence.
The step may be performed by using an existing image recognition method, and the present invention is not limited thereto.
S220: the type of the first measure is analyzed and marked, and meanwhile, the position (coordinate x \ y) of the measure on the electronic picture music score is obtained according to the position coordinate information of the measure in the electronic picture music score.
Analyzing the type of the section, namely analyzing whether the type of the section is a common type or a repeated type.
S230, judging whether a next section? exists, if so, executing the step S210, otherwise, executing the step S240.
S240: and (6) ending.
The above steps should be noted that, scanning the electronic picture music score from the top left corner, from left to right, and from top to bottom, and using an image recognition method to sequentially find out the sections in the electronic picture music score, wherein the sequence of the sections in the electronic picture music score is the playing sequence without considering the repeated sections in each section in the electronic picture music score; then identifying the type of each section, and if the section is a repeat type, marking the section as a repeat type; otherwise, marking the section as a common type; if the sections are not processed, the processing is continued, otherwise, the processing is stopped.
The flow shown in fig. 2 may be implemented in a mobile terminal, may be implemented in a server, and is preferably implemented in a server.
Fig. 3 shows a flow of acquiring the standard playback speed of each bar in the electronic picture score according to the embodiment of the present invention.
As shown in fig. 3, the process of obtaining the standard playing speed of each bar in the electronic picture music score includes:
s310: and scanning the picture music score to identify sections in the picture music score, and analyzing each note of each section of the picture music score.
That is, the image recognition mode is used to scan the picture music score from left to right and from top to bottom, so as to recognize each measure in turn and separate out each note.
It should be noted that, this step can also directly use the result of scanning each section in the identified picture music score by the image identification method to analyze each note of each section of the music score.
In addition, in the invention, the notes of each measure in the music score are acquired by adopting an image recognition mode, and an audio mode can be adopted for acquiring.
S320: and analyzing each identified note to determine the sound frequency of each note and the number of beats occupied by each note.
That is, the notes of the electronic picture music score are analyzed, the sound frequencies of the corresponding notes are acquired one by one according to the note frequency correspondence table, the number of beats occupied by each note is analyzed one by one, and the playing rhythm of the music score is obtained according to the number of beats occupied by each note.
S330: forming a frequency waveform diagram of a music score according to the sound frequency of each note and the number of beats occupied by each note; and simultaneously, obtaining a frequency oscillogram of the original vocal cords according to the audio data of the original vocal cords corresponding to the music score.
That is, the frequency of each note on the electronic picture music score is traversed, and according to the playing rhythm of the analyzed music score, a frequency waveform diagram is formed, namely: and combining the analyzed note frequency data and the data of the beat number of the notes together to form a frequency oscillogram.
Meanwhile, the audio data of the original vocal cords corresponding to the music score are input, the sound frequency of each moment is analyzed one by one, and the frequency of the sound at each moment in the audio data of the original vocal cords corresponding to the music score is analyzed and combined with the time record to form a frequency oscillogram.
S340: an agreement portion is obtained from the frequency waveform pattern of the music score and the frequency waveform pattern of the original vocal cords, and the number of bars occupied by the agreement portion in the electronic picture music score and the time of playback in the audio data of the original vocal cords are determined.
That is, the acquired frequency waveform of the curvelet spectrum and the frequency waveform of the vocal cords are compared to find the largest similar portion, that is, the anastomotic portion. The found largest similar portion is extracted, and the number (N) of bars occupied by the portion on the music score is calculated, and the difference (M, in milliseconds) between the end play time and the start play time of the portion in the audio data of the original band is also calculated.
S350: the standard playback speed of each bar in the electronic picture music score is determined based on the number of bars occupied by the matching sections in the electronic picture music score and the playback time in the audio data of the original band.
That is, the standard playback speed of each bar is obtained by dividing the time M (M in milliseconds) occupied by the similar portion in the acoustic soundtrack by the number N of bars occupied by the portion in the electronic picture score.
The above process is a detailed flow for analyzing the original vocal cords and the electronic picture music score corresponding to the music score by using the audio pitch identification mode and the image identification mode to obtain the standard playing speed of each bar in the electronic picture music score.
The flow shown in fig. 3 may be implemented in a mobile terminal, may be implemented in a server, and is preferably implemented in a server.
How to automatically scroll the respective bars in the electronic picture score on the display screen of the mobile terminal will be described in detail below.
In step S120, in controlling the scrolling of the electronic picture music score in the screen of the mobile terminal based on the acquired type and position of each bar and the standard play speed of each bar, each bar is scrolled on the screen of the mobile terminal at the standard play speed for a preset time based on the position of each bar and the type of each bar.
If the bar displayed in the rolling manner on the screen of the mobile terminal is a bar of a common type, controlling to continue to display the next bar in the rolling manner after the bar is displayed in the rolling manner until the music score is finished; and if the section scroll-displayed on the screen of the mobile terminal is a repeated section, controlling repeated display of the repeated section after the section scroll-displayed.
That is, the sections are scrolled and displayed on the screen of the mobile terminal, the sections of the common type are sequentially scrolled and displayed in the order of the electronic picture music score, and the sections of the repeated type are repeatedly scrolled and displayed.
To illustrate in detail how the electronic picture music score on the mobile device side is automatically scrolled, fig. 4 shows a flow of scrolling the electronic picture music score on the screen of the mobile terminal according to an embodiment of the present invention.
As shown in fig. 4, a specific process of scrolling an electronic picture music score on a screen of a mobile terminal includes:
s410: starting from the first subsection of the electronic picture music score.
S420: a bar symbol of the current bar is fetched.
S430: and moving the electronic picture music score to the position of the mark of the next bar from the position of the current bar according to the preset standard playing speed.
S440: after the movement is completed, the process proceeds to S450 and is determined again.
S450: judging whether the section is an end symbol; if yes, go to step S480, otherwise go to step S460.
S460: judging whether the mark is a repeated mark; if yes, go to step S470, otherwise go to step S420.
S470: finding out the section which is corresponding to the repeated symbol and restarts; then, step S420 is performed.
S480: the flow ends.
The above-mentioned flow is a detailed process of scrolling the electronic picture music score on the screen of the mobile terminal, that is, when preparing to automatically scroll a certain electronic picture music score on the screen of the mobile terminal, first acquiring the position coordinate information of each bar, the type of each bar and the standard playing speed of the bar (i.e. the standard playing speed (the playing time of each bar is T)), and controlling the automatic scrolling between adjacent bars to be completed in the T time period according to the position coordinate information of the bar; determining the scrolling sequence of the bars on the screen of the mobile terminal according to the type of each bar of the electronic picture music score; if the bar is a bar of the common type, the bar is sequentially scrolled according to the order of the music score, and if the bar is a bar of the repeated type, the start position of the corresponding repeated bar is found, and the scrolling display is repeated.
In one embodiment of the invention, the automatic scrolling of the electronic picture music score is realized by adopting an image recognition mode and an audio tone high recognition mode. Firstly, the type, the position and each note of each measure of the electronic picture music score can be identified at the server end by adopting an image identification mode, and the type and the position of each identified measure are saved in a database at the server end; then, acquiring the standard playing speed of each measure by using an audio pitch identification mode, and storing the standard playing speed into a database of a server side; then, when the user performs a performance according to the electronic picture music score displayed on the mobile terminal, the client of the mobile terminal first acquires the type and position of all the bars of the music score and the standard playing speed, which are obtained before, from the server, and then automatically scrolls the electronic picture music score according to the information. In addition, when the mobile terminal is networked with the server, the server can directly control the mobile terminal to automatically scroll the electronic picture music score according to the standard playing speed.
It should be noted that the type, position and standard playing speed of each bar of the electronic picture music score are obtained at the server side and stored in the database at the server side, so that the type, position and standard playing speed of each bar of the electronic picture music score stored in the database can be shared with all users of the electronic picture music score, and then the user can directly obtain and utilize the type, position and standard playing speed from the database at the server side at the client side of the mobile terminal, thereby saving the time for re-obtaining the type, position and standard playing speed of the bar at the mobile terminal when the user uses the music score.
To illustrate the effect of the electronic picture music score scrolling on the mobile terminal screen by using the electronic picture music score scrolling method provided by the present invention, fig. 5-1 and 5-2 respectively show the effect of the electronic picture music score scrolling on the mobile terminal screen according to an embodiment of the present invention.
Only the contents of two bars are displayed on the screen of the mobile terminal shown in fig. 5-1, and as time moves, the bars of the electronic picture composition continue to scroll on the screen according to the standard play speed (scroll speed) of the bars, and then the next two bars in the electronic picture are displayed on fig. 5-2.
Corresponding to the method, the invention also provides an electronic picture music score scrolling device, and fig. 6 shows the logical structure of the electronic picture music score scrolling device according to the embodiment of the invention.
As shown in fig. 6, the electronic picture score scrolling device 600 provided by the present invention includes a section information acquiring unit 610, a speed information acquiring unit 620 and a scrolling unit 630.
Wherein, the section information acquiring unit 610 is used for acquiring the type and position of each section in the electronic picture music score.
The speed information acquisition unit 620 is for acquiring the standard playback speed of each bar in the electronic picture score.
The scrolling unit 630 is used for controlling scrolling of the electronic picture music score in the screen of the mobile terminal according to the type and position of each acquired bar and the standard playing speed of each bar.
Wherein the section information acquiring unit 610 acquires the type and position of each section in the electronic picture music score includes: and scanning the electronic picture music score in an image identification mode, identifying each section in the electronic picture music score, and analyzing to obtain the type and the position of each section.
Fig. 7 shows a speed information acquisition unit structure of an electronic picture score scrolling device according to an embodiment of the present invention. As shown in fig. 7, the speed information acquiring unit 620 further includes a frequency waveform diagram acquiring unit 621 of a music score, a frequency waveform diagram acquiring unit 622 of an original vocal cord, and a standard playback speed determining unit 623.
The frequency oscillogram acquiring unit 621 is configured to scan the electronic picture music score by using an image recognition method, recognize each bar of the electronic picture music score, and analyze each note of each bar; and analyzing each note of the measure in an audio pitch identification mode to obtain a frequency waveform diagram of the electronic picture music score.
The original sound band frequency waveform diagram obtaining unit 622 is configured to obtain a frequency waveform diagram of an original sound band according to audio data of the original sound band corresponding to the electronic picture music score.
The standard playback speed determination unit 623 is configured to determine a standard playback speed of each bar in the electronic picture music score based on the frequency waveform pattern of the electronic picture music score and the frequency waveform pattern of the acoustic band.
The frequency waveform diagram obtaining unit 621 of music score analyzes each note of the measure by using an audio pitch recognition method, and obtains a frequency waveform diagram of the electronic picture music score, which includes: determining the sound frequency of each note and the number of beats occupied by each note; and forming a frequency waveform diagram of the music score according to the sound frequency of each note and the number of beats occupied by each note.
The standard playback speed determination unit 623 determines the standard playback speed of each bar in the electronic picture score based on the frequency waveform diagram of the score and the frequency waveform diagram of the original vocal cords, including: acquiring an coincident portion thereof from the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords, and determining the number of occupied measures and the time of playback in the audio data of the original vocal cords; the standard playback speed of each bar in the electronic picture score is determined based on the number of bars occupied by the matching section in the electronic picture score and the time of playback in the audio data of the original soundtrack.
Wherein the scrolling unit 630 controls scrolling of the electronic picture music score in the screen of the mobile terminal according to the acquired type and position of each bar and the standard playing speed of each bar includes: controlling each bar to scroll on the screen of the mobile terminal at a standard playing speed within a preset time according to the position of each bar and the type of each bar; if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling to continue to display the next bar in a rolling way after the bar is displayed in a rolling way; and if the section scroll-displayed on the screen of the mobile terminal is a repeated section, controlling repeated display of the repeated section after the section scroll-displayed.
That is, the sections displayed are automatically scrolled on the screen of the mobile terminal, the sections of the common type are sequentially scrolled and displayed in the order of the electronic picture music score, and the sections of the repeated type are repeatedly scrolled and displayed.
It should be noted that the electronic picture music score scrolling device 600 may be disposed in the mobile terminal or in the server.
For a more specific interaction process of each module unit, reference may be made to the description in the method flow, and details are not described here.
Additionally, FIG. 8 illustrates a system according to an embodiment of the invention. As shown in fig. 8, the present invention also provides a system 800 comprising a mobile terminal 810 and a server 820.
A mobile terminal 810 for acquiring the type, position and standard playing speed of each bar in the electronic picture music score from the server 820, and controlling the electronic picture music score to be scroll-displayed in the screen of the mobile terminal 810 according to the type and position of each bar acquired from the server 820 and the standard playing speed of each bar;
and a server 820 for providing the mobile terminal 810 with the type, position and standard playing speed of each bar in the electronic picture music score.
Further, an electronic picture music score scrolling device is disposed in the mobile terminal 810, and the structure of the electronic picture music score scrolling device is described with reference to fig. 6 and fig. 7.
Or,
a server 820 for acquiring the type, position and standard playing speed of each bar in the electronic picture music score, and controlling the mobile terminal 810 to scroll the electronic picture music score in the mobile terminal screen according to the acquired type and position of each bar and the standard playing speed of each bar;
and a mobile terminal 810 for scrolling the electronic picture music score in the mobile terminal screen according to the control of the server 820.
Further, an electronic picture score scrolling device is provided in the server 820, and the structure of the electronic picture score scrolling device is described with reference to fig. 6 and 7.
According to the embodiment, the method, the device and the system for rolling the electronic picture music score automatically analyze a large amount of information of the picture music score on the network in an image identification mode and an audio high identification mode; the collected music score information is utilized to realize automatic rolling of the music score, so that a user can play the music score conveniently, and the interruption of the operation of turning pages of the music score in midway is avoided; meanwhile, the demand of playing anywhere can be well met by utilizing the convenience and the mobility of the mobile equipment, and the purchase of expensive music score automatic page turning hardware equipment can be avoided, so that a user can use the electronic picture music score more conveniently.
In addition, the mobile terminal according to the present invention may be a variety of handheld terminal devices with bluetooth function, such as a mobile phone with bluetooth function and a Personal Digital Assistant (PDA).
Furthermore, the method according to the present invention may also be implemented as a computer program executed by a processor (such as a CPU) in the mobile terminal and stored in a memory of the mobile terminal. Which when executed by a processor performs the above-described functions defined in the method of the invention.
Furthermore, the method according to the invention may also be implemented as a computer program product comprising a computer readable medium having stored thereon a computer program for performing the above-mentioned functions defined in the method of the invention.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage device for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
While the foregoing disclosure shows illustrative embodiments of the invention, it should be noted that various changes and modifications could be made herein without departing from the scope of the invention as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the inventive embodiments described herein need not be performed in any particular order. Furthermore, although elements of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
In addition, the mobile terminal according to the present invention may be a variety of handheld terminal devices with bluetooth function, such as a mobile phone with bluetooth function and a Personal Digital Assistant (PDA).
Furthermore, the method according to the present invention may also be implemented as a computer program executed by a processor (such as a CPU) in the mobile terminal and stored in a memory of the mobile terminal. Which when executed by a processor performs the above-described functions defined in the method of the invention.
Furthermore, the method according to the invention may also be implemented as a computer program product comprising a computer readable medium having stored thereon a computer program for performing the above-mentioned functions defined in the method of the invention.
Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage device for storing a computer program for causing the controller to implement the functions of the above steps or elements.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
While the foregoing disclosure shows illustrative embodiments of the invention, it should be noted that various changes and modifications could be made herein without departing from the scope of the invention as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the inventive embodiments described herein need not be performed in any particular order. Furthermore, although elements of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
The method, apparatus and system for scrolling the score of an electronic picture proposed in accordance with the present invention are described above by way of example with reference to the accompanying drawings. However, it should be understood by those skilled in the art that various modifications can be made to the electronic picture music score scrolling method, apparatus and system provided by the present invention without departing from the scope of the present invention. Therefore, the scope of the present invention should be determined by the contents of the appended claims.
Claims (14)
1. An electronic picture music score scrolling method, comprising:
acquiring the type, position and standard playing speed of each measure in the electronic picture music score;
controlling scrolling of the electronic picture music score in the screen of the mobile terminal according to the acquired type and position of each bar and the standard playing speed of each bar, including:
controlling the sections to scroll on the screen of the mobile terminal at the standard playing speed within a preset time according to the positions of the sections and the types of the sections; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling the next bar to be displayed in a rolling way after the bar is displayed in a rolling way;
and if the sections which are scrolled and displayed on the screen of the mobile terminal are the sections of the repeated type, controlling the sections of the repeated type to be repeatedly displayed after the sections are scrolled and displayed.
2. The electronic picture score scrolling method as claimed in claim 1, wherein the type and position of each bar in said electronic picture score is determined as follows:
and scanning the electronic picture music score by adopting an image identification mode, identifying each measure in the electronic picture music score, and analyzing the type and the position of each measure.
3. The electronic picture score scrolling method as claimed in claim 1, wherein the standard playback speed of each bar in said electronic picture score is determined as follows:
scanning the electronic picture music score in an image identification mode, identifying each measure in the electronic picture music score, and analyzing each note of each measure;
analyzing each note of the measure in an audio pitch identification mode to obtain a frequency waveform diagram of the electronic picture music score;
obtaining a frequency oscillogram of the original vocal cords according to the audio data of the original vocal cords corresponding to the electronic picture music score;
and determining the standard playing speed of each bar in the electronic picture music score according to the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords.
4. The method for scrolling an electronic picture music score according to claim 3, wherein the step of analyzing each note of the measure by pitch recognition comprises:
determining the sound frequency of each note and the number of beats occupied by each note;
and forming a frequency waveform diagram of the music score according to the sound frequency of each note and the number of beats occupied by each note.
5. The electronic picture music score scrolling method according to claim 3, wherein determining the standard playback speed of each bar in the electronic picture music score based on the frequency waveform pattern of the electronic picture music score and the frequency waveform pattern of the acoustic band comprises:
acquiring an inosculating part thereof according to the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords, and determining the number of bars occupied by the inosculating part in the electronic picture music score and the playing time in the audio data of the original vocal cords;
and determining the standard playing speed of each section in the electronic picture music score according to the number of the sections occupied by the inosculating part in the electronic picture music score and the playing time in the audio data of the original vocal cords.
6. The electronic picture score scrolling method according to any of claims 1 to 5,
acquiring the type and the position of each measure in the electronic picture music score from a server or a mobile terminal;
and acquiring the standard playing speed of each bar in the electronic picture music score from the server or the mobile terminal.
7. An electronic picture music score scrolling device, comprising:
a section information acquisition unit for acquiring the type and position of each section in the electronic picture music score;
a speed information obtaining unit, configured to obtain a standard playing speed of each bar in the electronic picture music score;
a scrolling unit for controlling scrolling of the electronic picture music score in the screen of the mobile terminal according to the acquired type and position of each bar and the standard playing speed of each bar, comprising:
controlling the sections to scroll on the screen of the mobile terminal at the standard playing speed within a preset time according to the positions of the sections and the types of the sections; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling the next bar to be displayed in a rolling way after the bar is displayed in a rolling way; and if the sections which are scrolled and displayed on the screen of the mobile terminal are the sections of the repeated type, controlling the sections of the repeated type to be repeatedly displayed after the sections are scrolled and displayed.
8. The electronic picture score scrolling device according to claim 7, wherein said section information acquiring unit acquiring the type and position of each section in the electronic picture score comprises:
and scanning the electronic picture music score in an image identification mode, identifying each section in the electronic picture music score, and analyzing to obtain the type and the position of each section.
9. The electronic picture score scrolling device according to claim 7, wherein said speed information acquiring unit further comprises:
a frequency oscillogram obtaining unit of the music score, which is used for scanning the electronic picture music score by adopting an image identification mode, identifying each measure of the electronic picture music score and analyzing each note of each measure; analyzing each note of the measure in an audio pitch identification mode to obtain a frequency waveform diagram of the electronic picture music score;
the frequency oscillogram acquiring unit of the original vocal cords is used for acquiring the frequency oscillogram of the original vocal cords according to the audio data of the original vocal cords corresponding to the electronic picture music score;
and the standard playing speed determining unit is used for determining the standard playing speed of each bar in the electronic picture music score according to the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords.
10. The electronic picture music score scrolling device according to claim 9, wherein said frequency waveform pattern acquisition unit of the music score analyzes each note of the measure in an audio pitch recognition manner, and obtaining the frequency waveform pattern of the electronic picture music score comprises:
determining the sound frequency of each note and the number of beats occupied by each note;
and forming a frequency waveform diagram of the music score according to the sound frequency of each note and the number of beats occupied by each note.
11. The electronic picture score scrolling device of claim 9,
the standard playback speed determination unit determining the standard playback speed of each bar in the electronic picture music score based on the frequency waveform pattern of the music score and the frequency waveform pattern of the acoustic band includes:
acquiring an inosculating part thereof according to the frequency waveform diagram of the electronic picture music score and the frequency waveform diagram of the original vocal cords, and determining the number of bars occupied by the inosculating part in the electronic picture music score and the playing time in the audio data of the original vocal cords; and determining the standard playing speed of each section in the electronic picture music score according to the number of the sections occupied by the inosculating part in the electronic picture music score and the playing time in the audio data of the original vocal cords.
12. The electronic picture score scrolling device according to any of claims 7 to 11,
the electronic picture music score rolling device is arranged in the mobile terminal or the server.
13. An electronic picture music score scrolling system comprises a mobile terminal and a server, wherein,
the mobile terminal is used for acquiring the type, the position and the standard playing speed of each section in the electronic picture music score from the server, and controlling the electronic picture music score to be displayed in a scrolling mode in a screen of the mobile terminal according to the type and the position of each section acquired from the server and the standard playing speed of each section, and comprises the following steps:
controlling the sections to scroll on the screen of the mobile terminal at the standard playing speed within a preset time according to the positions of the sections and the types of the sections; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling the next bar to be displayed in a rolling way after the bar is displayed in a rolling way;
if the sections which are displayed in a rolling mode on the screen of the mobile terminal are sections of a repeated type, controlling the sections of the repeated type to be displayed repeatedly after the sections are displayed in a rolling mode;
and the server is used for providing the type, the position and the standard playing speed of each measure in the electronic picture music score for the mobile terminal.
14. An electronic picture music score scrolling system comprises a mobile terminal and a server, wherein,
the server is used for acquiring the type, the position and the standard playing speed of each section in the electronic picture music score, and controlling the mobile terminal to scroll the electronic picture music score in the screen of the mobile terminal according to the acquired type and the position of each section and the standard playing speed of each section, and comprises the following steps:
controlling the sections to scroll on the screen of the mobile terminal at the standard playing speed within a preset time according to the positions of the sections and the types of the sections; wherein,
if the bar displayed in a rolling way on the screen of the mobile terminal is a common bar, controlling the next bar to be displayed in a rolling way after the bar is displayed in a rolling way;
if the sections which are displayed in a rolling mode on the screen of the mobile terminal are sections of a repeated type, controlling the sections of the repeated type to be displayed repeatedly after the sections are displayed in a rolling mode;
and the mobile terminal is used for scrolling the electronic picture music score in a mobile terminal screen according to the control of the server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410788131.0A CN105760386B (en) | 2014-12-16 | 2014-12-16 | Electronic pictures music score of Chinese operas scrolling method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410788131.0A CN105760386B (en) | 2014-12-16 | 2014-12-16 | Electronic pictures music score of Chinese operas scrolling method, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105760386A CN105760386A (en) | 2016-07-13 |
| CN105760386B true CN105760386B (en) | 2019-10-25 |
Family
ID=56339584
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410788131.0A Active CN105760386B (en) | 2014-12-16 | 2014-12-16 | Electronic pictures music score of Chinese operas scrolling method, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105760386B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110767202A (en) * | 2019-11-20 | 2020-02-07 | 刘添忻 | Intelligent electronic curvelet spectrometer |
| CN111554250A (en) * | 2020-04-26 | 2020-08-18 | 苏州缪斯谈谈科技有限公司 | Automatic music score turning method, system, electronic equipment and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1433548A (en) * | 1999-12-20 | 2003-07-30 | 汉索尔索弗特有限公司 | Network based music playing/song accompanying service system and method |
| CN1479916A (en) * | 2000-12-05 | 2004-03-03 | �����ּ�����˾ | Method for analyzing music using sound information of instruments |
| CN1609947A (en) * | 2003-10-23 | 2005-04-27 | 凌阳科技股份有限公司 | Electronic music score apparatus |
| CN101800045A (en) * | 2010-01-21 | 2010-08-11 | 冷明 | Electronic device for displaying and playing music book |
| CN102238147A (en) * | 2010-05-05 | 2011-11-09 | 东方宇阳信息科技(北京)有限公司 | Band electronic music score rack control service system |
| CN102298922A (en) * | 2011-07-28 | 2011-12-28 | 顾昕昀 | Digital music book instrument and automatic music book turning method thereof |
| CN102708907A (en) * | 2012-06-04 | 2012-10-03 | 张弛 | Linear multimedia positioning method based on picture segmentation and synchronous labeling |
| CN104078035A (en) * | 2013-07-02 | 2014-10-01 | 深圳市腾讯计算机系统有限公司 | Music playing method and device |
-
2014
- 2014-12-16 CN CN201410788131.0A patent/CN105760386B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1433548A (en) * | 1999-12-20 | 2003-07-30 | 汉索尔索弗特有限公司 | Network based music playing/song accompanying service system and method |
| CN1479916A (en) * | 2000-12-05 | 2004-03-03 | �����ּ�����˾ | Method for analyzing music using sound information of instruments |
| CN1609947A (en) * | 2003-10-23 | 2005-04-27 | 凌阳科技股份有限公司 | Electronic music score apparatus |
| CN101800045A (en) * | 2010-01-21 | 2010-08-11 | 冷明 | Electronic device for displaying and playing music book |
| CN102238147A (en) * | 2010-05-05 | 2011-11-09 | 东方宇阳信息科技(北京)有限公司 | Band electronic music score rack control service system |
| CN102298922A (en) * | 2011-07-28 | 2011-12-28 | 顾昕昀 | Digital music book instrument and automatic music book turning method thereof |
| CN102708907A (en) * | 2012-06-04 | 2012-10-03 | 张弛 | Linear multimedia positioning method based on picture segmentation and synchronous labeling |
| CN104078035A (en) * | 2013-07-02 | 2014-10-01 | 深圳市腾讯计算机系统有限公司 | Music playing method and device |
Non-Patent Citations (3)
| Title |
|---|
| 电子乐谱的设计与实现;艾晓辉 等;《电子器件》;20010930;第I136-121页 * |
| 电子乐谱的设计与若干关键技术的实现;许锦生;《中国优秀硕士学位论文全文数据库 信息科技辑》;20140415;第228-232页 * |
| 电子乐谱综述;许锦生 等;《电子乐谱综述》;20120229;第88-91页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105760386A (en) | 2016-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2014162788A1 (en) | Facial-expression assessment device, dance assessment device, karaoke device, and game device | |
| JP2000262747A5 (en) | ||
| CN106210836A (en) | Interactive learning method and device in video playing process and terminal equipment | |
| JP2007127813A5 (en) | ||
| US20150193654A1 (en) | Evaluation method, evaluation apparatus, and recording medium | |
| CN106104692B (en) | The sequence of Highlights video segmentation | |
| CN110691633A (en) | Method and system for determining reaction time of response and synchronizing user interface with content being rendered | |
| JP2009201809A (en) | Operation support server device, operation support method, and computer program | |
| CN111888765B (en) | Multimedia file processing method, device, equipment and medium | |
| CN108292509A (en) | Terminal installation, diagnostic system, diagnostic method and program | |
| CN105760386B (en) | Electronic pictures music score of Chinese operas scrolling method, apparatus and system | |
| CN109961800A (en) | A kind of page turning of score processing method and processing device | |
| CN106921802B (en) | Audio data playing method and device | |
| CN105324160A (en) | Electronic game machine, electronic game processing method, and electronic game program | |
| US20150199171A1 (en) | Handwritten document processing apparatus and method | |
| CN111554250A (en) | Automatic music score turning method, system, electronic equipment and computer readable storage medium | |
| JP2017093803A (en) | Evaluation program, evaluation method and evaluation device | |
| CN112667081A (en) | Bullet screen display method and device, storage medium and terminal | |
| JP6256738B2 (en) | Movie selection device, movie selection method and program | |
| JP2007074149A5 (en) | ||
| CN105630579A (en) | Computer capable of selective playing | |
| CN111176535B (en) | Screen splitting method based on intelligent sound box and intelligent sound box | |
| CN110764676B (en) | Information resource display method and device, electronic equipment and storage medium | |
| CN107479725A (en) | A kind of characters input method, device, dummy keyboard, electronic equipment and storage medium | |
| US20200075025A1 (en) | Information processing apparatus and facilitation support method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20160929 Address after: 510665 Tianhe District, Guangdong, China Road, building No. 64, No. 66 West, room 902, two Applicant after: GUANGZHOU I9GAME INFORMATION TECHNOLOGY CO., LTD. Address before: 510627 Guangdong city of Guangzhou province Whampoa Tianhe District Road No. 163 Xiping Yun Lu Yun Ping B radio 16 floor tower square Applicant before: Guangzhou Dongjing Computer Technology Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200527 Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Patentee after: Alibaba (China) Co.,Ltd. Address before: Two, room 902, West 64, 66 Middle Road, Tianhe District, Guangdong, Guangzhou, China 510665 Patentee before: GUANGZHOU UCWEB COMPUTER TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |