CN110796919A

CN110796919A - Highly-integrated music teaching demonstration system

Info

Publication number: CN110796919A
Application number: CN201911098865.5A
Authority: CN
Inventors: 王志成; 陈哲
Original assignee: Shanghai Chord Beijing Education Technology Co Ltd
Current assignee: Beijing Shanghexian Culture Communication Co ltd
Priority date: 2019-11-11
Filing date: 2019-11-11
Publication date: 2020-02-14

Abstract

The invention discloses a highly integrated music teaching demonstration system, which comprises a teaching musical instrument, a music teaching system and teaching demonstration equipment; the teaching musical instrument collects MIDI signals generated during playing, and transmits the MIDI signals to the music teaching system; the music teaching system comprises a mainboard, and an image acquisition device, a main control device and a video processor which are integrated on the mainboard; the teaching demonstration equipment is used for receiving the virtual pictures and/or the actual images sent by the video processor. This system can make every student can both clearly see teacher's finger action and the key that presses through teaching demonstration equipment, does benefit to the student and refers to the study to this system is the box state, portable can be used for the scene of individual family education, and application scope is wide.

Description

Highly-integrated music teaching demonstration system

Technical Field

The invention relates to the technical field of music education, in particular to a highly-integrated music teaching demonstration system.

Background

Music is an art reflecting the emotion of real life of human beings, and can be used for mastering temperament and performance to cause emotional resonance of people. Today, with the emphasis on quality education, deepening understanding and learning of music also influences thinking ways and three-fold of people, especially children, to a certain extent. Therefore, there are often families that give a tutor of instrumental music for children, develop interest in music, or adults want to receive music education in instrumental music for interest, and even people who already have a certain instrumental music foundation need to perform music education in order to further improve their performance.

The current music teaching mode usually adopts a one-to-many teaching mode, a teacher demonstrates how to play a musical instrument on a platform, and students return to their seats to simulate and practice after gathering on the platform to watch. However, for music teaching, especially instrumental music teaching, it is critical that students can clearly see the performance of the teacher, but the above teaching mode sometimes fails to allow all students to see or clearly see the performance of the teacher, which is not conducive to reference learning of the students and results in a reduction in learning efficiency. Even if all students can see the performance action of the teacher clearly, the teacher can explain the performance action only by language while playing, for example, notes of the performance and music theory of the performance are explained, so that the time for teaching one performance action is long, the teaching progress is slow, and the existing music teaching system is mostly only suitable for large-scale teaching scenes and is not suitable for small-scale teaching scenes (such as personal family education).

Therefore, how to let all students see the performance action of the teacher clearly, improve the learning efficiency, and expand the application range of the music teaching demonstration system is a problem to be solved by those skilled in the art.

Disclosure of Invention

In view of the above problems, the present invention aims to solve the problems that the application range of the present music teaching demonstration system is narrow, and students cannot see the performance action of teachers clearly, so that the learning efficiency is low and the teaching precision is slow.

The embodiment of the invention provides a highly integrated music teaching demonstration system, which comprises: teaching musical instruments, music teaching systems, teaching demonstration equipment;

the teaching musical instrument is used for collecting MIDI signals generated during playing and transmitting the MIDI signals to the music teaching system;

the music teaching system comprises a mainboard, and an image acquisition device, a main control device and a video processor which are integrated on the mainboard; the image acquisition equipment is connected with the mainboard through a bus and used for acquiring an actual image of a playing part of the teaching musical instrument in real time and transmitting the actual image to the video processor, the main control equipment is connected with the teaching musical instrument and used for generating a virtual picture of the playing part of the teaching musical instrument according to a MIDI signal acquired by the teaching musical instrument and transmitting the virtual picture to the video processor, and the video processor transmits the virtual picture and/or the actual image to teaching demonstration equipment;

the teaching demonstration device 3 is used for receiving the virtual pictures and/or the actual images sent by the video processor.

In one embodiment, the teaching musical instrument comprises:

and the MIDI trigger is connected with the music teaching system and is used for acquiring MIDI signals generated by the teaching musical instrument during playing and sending the MIDI signals to the main control equipment.

In one embodiment, the image acquisition apparatus includes:

the image acquisition equipment adopts a miniature camera which is connected with the video processor through a bus.

In one embodiment, the master device includes:

the system comprises a virtual picture generation module, a MIDI recognition module and a sound acquisition module;

the virtual picture generation module is used for generating a virtual picture of the playing part of the teaching musical instrument;

the MIDI recognition module is connected with the MIDI trigger, the virtual picture generation module and the video processor and is used for displaying corresponding playing actions on the virtual picture generated by the virtual picture generation module according to the received MIDI signals and transmitting the virtual picture with the playing actions to the video processor;

the sound acquisition module is connected with the MIDI trigger and the video processor and used for generating playing sound of the teaching musical instrument according to the MIDI signal generated by the MIDI trigger and sending the playing sound to the video processor.

In one embodiment, the music tutoring system comprises:

the power supply is connected with the music teaching system and used for providing power supply voltage for the music teaching system.

In one embodiment, the music tutoring system further comprises:

and the fan is connected with the mainboard and used for dissipating heat of the music teaching system.

In one embodiment, the motherboard includes:

and the power supply conversion module is connected with the fan and the power supply and is used for converting the power supply voltage into the fan voltage.

In one embodiment, the motherboard further comprises: the device comprises a sensor module and an infrared remote control module;

the sensor is connected with a user terminal and used for detecting data information of the music teaching system and transmitting the data information to the user terminal;

the infrared remote control module is connected with an infrared remote controller and used for controlling the music teaching system according to the instruction of the infrared remote controller.

In one embodiment, the instructional presentation device comprises:

and the display device is connected with the video processor and is used for receiving and playing the images and the sound sent by the video processor.

As a second aspect of the present invention, the present invention discloses a highly integrated music teaching demonstration method, comprising:

generating a virtual picture of a playing part of the teaching musical instrument;

acquiring MIDI signals generated during playing in real time, and displaying corresponding playing actions and playing sounds on the virtual picture according to the MIDI signals;

acquiring an actual image of the playing part of the teaching musical instrument in real time;

and displaying the virtual picture and/or the actual image in a split screen or picture-in-picture mode.

The technical scheme provided by the embodiment of the invention has the beneficial effects that at least:

the highly-integrated music teaching demonstration system provided by the embodiment of the invention is in a box shape, is convenient to carry, has a wide application range, and can broadcast finger actions of a teacher when playing a musical instrument and virtual pictures of the playing actions to students, so that each student can clearly watch the finger actions of the teacher and keys pressed down through teaching demonstration equipment, and the teaching demonstration system is beneficial to reference and learning of the students. Through show teacher's the action of playing and play the button and play the sound of playing in step on teaching demonstration equipment for the student can cooperate the music to see fingering and button simultaneously, improves the quality of teaching. Through setting up many teaching demonstration equipment, can carry out the music teaching to the student in a plurality of classrooms simultaneously, simultaneously through the sound information of gathering the musical instrument and send the teaching demonstration equipment in other classrooms on the spot for the student in all classrooms can both cooperate the music to see fingering and button simultaneously, has realized the teaching in on-the-spot many places. The teaching demonstration equipment acquires the teaching content audio and video data uploaded by the video processor in real time through the internet or a cable television network, so that remote music teaching is realized, and the teaching efficiency and the resource utilization rate are improved. The music theory analysis picture is generated through MIDI recognition software of the main control equipment so as to display the musical notes, the chords, the corresponding names and the music scores, the teaching of music composition is realized, meanwhile, a teacher can watch music by a student without explaining the musical notes, the music theory and the like, and the teaching progress is accelerated on the premise of not losing the teaching quality.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:

fig. 1 is a block diagram of a highly integrated music teaching demonstration system according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a display screen of a teaching demonstration device according to an embodiment of the present invention;

fig. 3 is a block diagram of a highly integrated music teaching demonstration method according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Referring to fig. 1, an embodiment of the present invention provides a highly integrated music teaching demonstration system, including: the teaching instrument 1, the music teaching system 2 and the teaching demonstration equipment 3;

the teaching musical instrument 1 is used for collecting the MIDI signals generated during playing and transmitting the MIDI signals to the music teaching system 2.

The teaching musical instrument 1 is a tool used by a teacher for performing demonstration for students during music teaching, and the teacher explains the demonstration of performance actions so that the students can better understand the music theory knowledge of performance.

The music teaching system 2 comprises a mainboard 4, and an image acquisition device 5, a main control device 6 and a video processor 7 which are integrated on the mainboard 4; image acquisition equipment 5 passes through bus connection mainboard 4 for gather in real time the teaching musical instrument 1 plays the actual image at position, and will the actual image transmits and gives video processor 7, master control equipment 6 connects teaching musical instrument 1 is used for the basis the MIDI signal generation teaching musical instrument 1 that teaching musical instrument 1 gathered plays the virtual picture at position, and will virtual picture sends video processor 7, video processor 7 sends virtual picture and/or actual image to teaching demonstration equipment 3.

Wherein, above-mentioned mainboard 4 adopts raspberry group integrated circuit board development platform, the raspberry group is a section microcomputer mainboard based on ARM, there are 1/2/4 USB interfaces and a 10/100 ethernet interface around the card mainboard, can connect the keyboard, mouse and net twine, possess video analog signal's output interface and HDMI high definition video output interface simultaneously, all integrate on a mainboard that only is slightly bigger than the credit card above-mentioned part, the basic function that possesses all PCs only needs to put through TV set and keyboard, just can carry out like spreadsheet, word processing, play the recreation, a great deal of functions such as broadcast high definition video. Mainboard 4 adopts raspberry group integrated circuit board development platform, because of its inclusion is strong, can be effectual with image acquisition device 5, main control equipment 6 and video processor 7 integration on mainboard 4.

Further, the image capturing device 5 employs a micro camera, which is connected to the video processor 7 through a bus, and captures an actual image of the playing portion of the teaching musical instrument 1 in real time, and transmits the actual image to the video processor 7. Taking the teaching musical instrument 1 as a piano as an example, the image acquisition device 5 is preset to be aligned with a playing position surface, namely a key part, of the piano, when a teacher plays the piano, the hand action of the teacher is captured, an actual image of the teacher playing the piano is generated, the actual image is transmitted to the video processor 7, and the video processor 7 transmits the processed actual image to the display through the HDMI high-definition video output interface distributed by the raspberry for display.

Furthermore, the main control device 6 is connected with a MIDI-USB transfer line or a USB data line or a wireless MIDI transceiver through a USB interface around the raspberry pi main board to receive MIDI signals generated by the teaching device during playing, and generates a virtual picture of the playing part of the teaching musical instrument 1 through a virtual picture generating module; the MIDI recognition module displays the corresponding performance action on the virtual screen generated by the virtual screen generation module according to the received MIDI signal, and then transmits the virtual screen to the video processor 7 in real time.

Further, the video processor 7 is configured to send the received virtual pictures sent by the main control device 6 and/or the actual images sent by the image capturing device 5 to the teaching demonstration device 3 for music teaching. The video processor 7 supports the input of multiple paths of video signals, can receive image data sent by the image acquisition equipment 5 and the main control equipment 6 at the same time, and the video processor 7 converts the received multiple paths of images into a split screen or picture-in-picture form and sends the split screen or picture-in-picture form to the teaching demonstration equipment 3, so that when each student watches the teaching demonstration equipment 3, the students can see the hand action of a teacher and can see keys corresponding to the hand action of the teacher; meanwhile, the video processor 7 can only send the actual image collected by the image collecting device 5 to the teaching demonstration device 3, and the teaching demonstration device 3 only displays the image of the key part of the actual piano, so that each student can clearly see the hand action of the teacher; the video processor 7 may only send the virtual picture generated by the main control device 6 to the teaching demonstration device 3, and the teaching demonstration device 3 only displays the picture of the virtual key part, so that each student can clearly see which keys are specifically pressed by the teacher.

Meanwhile, when the video processor 7 simultaneously displays the virtual picture and the actual video image, the output image can be divided into an upper part and a lower part, the upper part displays the virtual picture, the lower part displays the actual video image, and the keys in the virtual picture are aligned with the keys in the actual video image, so that the playing action of students is aligned with the actual keys. The video processor 7 may also switch the output image in real time, for example, close one input displayed therein, or add one input newly displayed therein.

The teaching demonstration device 3 is used for receiving the virtual pictures and/or the actual images sent by the video processor 7.

In this embodiment, the conventional single chip microcomputer system can only operate one program at a time, and the function is relatively single. The mainboard in this embodiment adopts raspberry group integrated circuit board development platform, can a plurality of processes of concurrent operation, and better each module of integration can concurrent operation between each module, and the interface that the raspberry group was taken is comprehensive, and common interfaces such as USB-host, RJ45, HDMI, SD card readers all have, and the function is comprehensive, and is small, with low costs. The music teaching system can enable each student to clearly see finger actions and pressed keys of a teacher through the teaching demonstration equipment, facilitates reference learning of the students and improves learning efficiency.

Meanwhile, the traditional music teaching demonstration system is large in required equipment, large in size and not easy to move, so that the teaching place is fixed, the traditional music teaching demonstration system is not suitable for wide popularization and application, and is small in application range.

In one embodiment, the above-mentioned teaching musical instrument 1 includes a MIDI trigger 8;

the MIDI trigger 8 is connected to the music teaching system 2, and is configured to collect a MIDI signal generated by the teaching musical instrument 1 during playing, and send the MIDI signal to the main control device 6.

Midi (musical Instrument Digital interface), a musical Instrument Digital interface, among others, is capable of recording music using Digital control signals of musical notes. The MIDI signals comprise MIDI messages, which are digital descriptions of the score, including instructions for the notes, control parameters, etc.

Specifically, any musical instrument capable of being equipped with the MIDI trigger 8 may be used as the teaching musical instrument and applied to the music teaching demonstration system provided in the present embodiment to perform music teaching, for example, musical instruments such as a piano, an electronic organ, a bass, a violin, a guitar, a trumpet, and a drum.

In one embodiment, the image capturing apparatus 5 includes:

the image acquisition device 5 is a micro camera, and the micro camera is connected with the video processor 7 through a bus.

Wherein, miniature camera can adopt embedded or telescopic setting on the shell of music teaching system 2, and the user can direct manual alignment teaching musical instrument 1's the performance position shoot, perhaps, sets up the support and supports music teaching system 2 and aim at teaching musical instrument 1 and shoot the performance position.

In this embodiment, adopt miniature camera, can be better integrated in the mainboard, can be applicable to the music teaching system of box form to, can gather the face that trades of high definition, demonstrate the student with the actual performance image clearly, guaranteed the quality and the definition of actual image.

In one embodiment, the main control device 6 includes:

a virtual picture generation module 9, a MIDI recognition module 10 and a sound collection module 11;

the virtual frame generating module 9 is configured to generate a virtual frame of the playing portion of the teaching musical instrument 1.

The MIDI recognition module 10 is connected to the MIDI trigger 8, the virtual image generation module 9 and the video processor 7, and configured to display a corresponding performance action on the virtual image generated by the virtual image generation module 9 according to the received MIDI signal, and transmit the virtual image with the performance action to the video processor 7.

Specifically, the MIDI identification module 10 is installed with MIDI identification software, such as MIDI culous software or other software capable of performing the same function, and the MIDI identification software can identify the type of the teaching musical instrument 1 when the main control device 6 is connected to the teaching musical instrument 1, such as identifying that the teaching musical instrument 1 is a piano, and then the virtual screen generation module 9 can generate a virtual screen of a playing part of the piano. The playing part, i.e. the part of the instrument interacting with the hand, is the part of the instrument which is operated by the hand or the hand-held object to cause music, and the playing parts of different instruments are determined according to the structure and the playing mode of the instrument. The piano has 88 keys, and the playing part of the piano is each key as a teaching instrument, so the MIDI recognition module 10 cooperates with the virtual picture generation module 9 to generate virtual pictures of the keys of the piano.

The MIDI recognition module 10 further recognizes the playing motion, which is the key motion of the playing key for the piano, for example, which key or keys the teacher plays, and it can be understood that the playing motions of different teaching instruments are different, for example, the playing motion is the hitting position when hitting the musical instrument for the percussion type musical instrument, and the playing motion is which string is pressed and/or which string is pulled when pulling the musical instrument for the violin. When a teacher plays a key, the MIDI trigger 8 of the piano immediately transmits a MIDI signal containing notes corresponding to the played key to the MIDI recognition module 10 of the main control device 6, and after the MIDI recognition module 10 recognizes the played key, corresponding display or identification is made on the corresponding key on the virtual picture, so that a person can clearly and quickly see the key when the teacher plays.

The sound collection module 11 is connected to the MIDI trigger 8 and the video processor 7, and configured to generate a playing sound of the teaching musical instrument 1 according to a MIDI signal generated by the MIDI trigger 8, and send the playing sound to the video processor 7.

Specifically, the MIDI trigger 8 sends MIDI signals, i.e. MIDI information such as played notes and control parameters, to the sound collection device, the sound collection device generates an electronic music score according to the MIDI information such as the notes and the control parameters, the electronic music score is sent to the video processor 7, and the video processor 7 sends virtual pictures and/or actual pictures and the electronic music score to the teaching equipment for displaying and playing on the teaching equipment.

Or, the sound collection device is provided with a sound pickup, can directly collect the sound played by the teaching musical instrument, and transmits the played sound to the teaching equipment in real time.

In one embodiment, the music teaching system 2 includes:

the power supply 12 is connected with the music teaching system 2 and used for providing power supply voltage for the music teaching system 2.

Specifically, the power supply 12 uses a rechargeable battery (e.g., a nickel-cadmium battery, a nickel-hydrogen battery, a lithium ion battery, a lead-acid battery), and the music teaching system 2 may charge the rechargeable battery through a USB interface, or directly connect to a USB interface of a raspberry pi through a USB data line to directly provide an operating voltage for the music teaching system 2.

In an embodiment, the music teaching system 2 further includes:

and the fan 13 is connected with the main board 4 and used for dissipating heat of the music teaching system 2.

In one embodiment, the main board 4 includes:

and the power supply conversion module 14 is connected with the fan 13 and the power supply 12, and is used for converting a power supply voltage into the fan voltage.

In an embodiment, the main board 4 further includes: a sensor module 15, an infrared remote control module 16;

the sensor is connected with the user terminal and used for detecting the data information of the music teaching system 2 and transmitting the data information to the user terminal.

Specifically, the working process of the sensor module 15 is explained by the following embodiments:

example 1:

the sensor module 15 adopts a distance sensor and is connected with the miniature camera and the user terminal;

the miniature camera shoots playing parts of the teaching musical instrument 1, such as a piano, is arranged right above keys of the piano, and can clearly collect playing actions of teachers playing the keys;

the distance sensor is connected with the miniature camera, collects the vertical distance between the miniature camera and the musical instrument and transmits the change of the distance to the user terminal;

the user terminal displays the vertical distance, adjusts the distance between the miniature camera and the teaching musical instrument 1, can arrange the miniature camera on the support frame, and adjusts the height of the support frame until a playing picture can be clearly shot;

or setting different distance thresholds at the user terminal according to the playing equipment, and transmitting the distance thresholds to the distance sensor;

adjusting the distance between the micro camera and the teaching musical instrument 1, receiving distance data by a distance sensor, comparing the acquired distance data with a distance threshold value, and transmitting the distance difference to the micro camera;

the micro camera (telescopic micro camera) is automatically calibrated according to the distance difference, and the micro camera is fixed to collect the playing pictures of the teaching musical instrument 1 in real time.

Example 2:

the sensor module 15 adopts a distance sensor temperature sensor, and the temperature sensor is connected with the main board 4, the fan 13 and the user terminal;

the user terminal sets a temperature threshold value and transmits the temperature threshold value to the temperature sensor;

the temperature sensor acquires a temperature value of the main board 4, compares a temperature threshold value with the temperature value, and controls the rotating speed of the fan 13;

when the temperature value is smaller than the temperature threshold value, the rotating speed of the fan 13 is controlled to be reduced; when the temperature value is greater than the temperature threshold value, the rotating speed of the adjusting fan 13 is increased; when the temperature value is close to the temperature threshold value, the rotating speed of the fan 13 is adjusted to a normal state, and the music teaching system 2 is cooled, so that the music teaching system 2 can normally operate.

The infrared remote control module 16 is connected to an infrared remote controller, and is configured to control the music teaching system 2 according to an instruction of the infrared remote controller.

Specifically, an on-off key, a pause key, a sound reduction key, a sound increase key, a forward key and a backward key can be arranged on the infrared remote controller.

The process of controlling the music teaching system 2 by the infrared remote control module 16 according to the instruction of the infrared remote controller is as follows:

A. the user selects a switch key on the infrared remote controller, and sends an on/off instruction to the infrared remote sensing module, and the infrared remote sensing module controls the power supply 12 in the music teaching system 2 to turn on/off the power supply 12;

B. when a user selects a pause key on the infrared remote controller, a pause instruction is sent to the infrared remote sensing module, and the infrared remote sensing module controls the video processor 7 in the main control equipment 6 to pause the playing of sound and virtual pictures and/or actual pictures;

C. when a user selects a sound reduction key/a sound increase key on the infrared remote controller, a sound reduction/sound increase instruction is sent to the teaching demonstration equipment 3 through the infrared remote sensing module, and the teaching demonstration equipment 3 reduces/increases the played sound;

D. when the user selects the forward key/backward key on the infrared remote controller, a forward/backward instruction is sent to the infrared remote sensing module, and the infrared remote sensing module calls the playing picture and sound of the previous section/the next section stored in the video processor 7 and sends the playing picture and sound to the teaching demonstration equipment 3 for displaying.

In this embodiment, can carry out remote control to the music teaching demonstration system of high integration through infrared remote controller, the function is abundanter, and is more convenient, and the teacher can directly teach with infrared remote controller and guide, need not manually go to adjust, has improved teaching efficiency.

In one embodiment, the instructional presentation device 3 comprises:

and the display device is connected with the video processor 7 and is used for receiving and playing the images and the sound sent by the video processor 7.

The display device is arranged on the wall of a teacher facing students, and can adopt a projector or a high-definition large screen and other devices, so that the students can clearly see the actions and sounds of the teacher when playing. When the teacher plays on site, the students can clearly hear the performance sound of the teacher, the teacher selects the sound reducing key in the infrared remote control module to modulate the sound to be in a forbidden state, the sound generated by the teacher during playing is synchronous with the actual picture and the virtual picture of the performance part of the teacher displayed by the display device, and the students can perform music teaching on the students by matching with music and simultaneously watching fingering, pressing keys and music feeling, so that the teaching quality is improved.

When the teacher is in classroom A, but still need to do the music teaching to the student that is located classroom B next door in classroom A simultaneously, and the sound that the teacher in classroom B played the piano can not be heard, this can bring inconvenience for the teaching, influences teaching quality and teaching progress.

Specifically, the display devices can be respectively installed in the classroom a and the classroom B, the teaching musical instrument, the main control device, the image acquisition device and the video processor are all arranged in the classroom a, and the display device of the classroom B is connected with the video processor (when the classroom a is far away from the classroom B, the display device is connected with the video processor through bluetooth). When a teacher plays a piano of a teaching instrument, the sound tone of the display equipment in the classroom A is in a forbidden state, only the actual picture and the virtual picture of the playing action of the teacher are displayed, the display equipment in the classroom B can also display the playing action and the playing keys of the teacher, and play music in real time, so that the teaching contents watched and experienced by students in a plurality of classrooms are the same, and the on-site multi-place teaching is realized.

In addition, as shown in fig. 2, the display device located in the classroom B may also be a large-screen tiled display wall composed of a plurality of display screens, the tiled video processor converts multiple signal input sources into modes of drawing or picture-in-picture, and splits the picture into, for example, a plurality of parts, each part is respectively sent to the display screens at the same tiled position in different classrooms through the signal output end, and one video processor outputs videos of the plurality of tiled display walls.

Furthermore, when remote teaching (network teaching) is carried out, the display device can be a user terminal, the video processor generates sound, actual pictures and virtual pictures played by a teacher in advance, the sound, the actual pictures and the virtual pictures are stored in the video processor and uploaded to the user terminal, the user terminal accesses the internet or a cable television network to acquire teaching content audio and video data uploaded by the video processor in real time, meanwhile, the user terminal carries out video on the teacher in a mode of drawing pictures, and the teacher can carry out real-time explanation according to the playing change displayed by the user terminal, so that the learning efficiency and the resource utilization rate of students are improved. The user terminal may be any one of the following: cell phone, computer.

Meanwhile, the user terminal can be provided with software to control the highly-integrated music teaching demonstration system, for example, an App is arranged at the user terminal, functions can be set in the App, more expansion is achieved, and resource utilization maximization is achieved.

Specifically, the teacher uploads the video to a class group in an App of the user terminal, the class group is created by the teacher of each class, the student logs in the App, and when the class group checks the teaching video for learning, the student can pause, fast forward and fast backward the video or intercept the video of a certain time period in the video for local amplification and watching, so that the student can observe and play the action more clearly, further review by the student is facilitated, knowledge is consolidated, and efficiency is improved. Meanwhile, the user terminal can be connected with highly integrated music teaching demonstration equipment through Bluetooth, receives related data collected by the sensor, issues a control instruction according to the related data, and adjusts data of each module of the music teaching system; and the control of the music teaching system can be realized through the infrared remote control module.

As shown in fig. 3, the music teaching demonstration method provided by this embodiment includes the following steps:

step 100, generating a virtual picture for teaching the playing part of the musical instrument.

The teaching musical instrument in this embodiment takes a piano as an example, the piano is provided with a MIDI trigger, the music teaching system is connected with the piano, and the main control device is connected with the piano and is used for generating virtual pictures of piano keys according to MIDI signals collected by the piano and sending the virtual pictures to the video processor.

Step 200, acquiring the MIDI signals generated during the playing in real time, and displaying the corresponding playing actions and playing sounds on the virtual screen according to the MIDI signals.

The MIDI trigger generates a MIDI signal during playing, wherein the MIDI signal includes instructions such as musical notes and control parameters for recording music. The main control equipment acquires the MIDI signals in real time, identifies the played keys according to the MIDI signals, displays the played keys on the generated virtual picture and generates corresponding playing sounds according to the keys.

And 300, acquiring the actual image of the playing part of the teaching musical instrument in real time.

An image acquisition device is held or fixed above the piano in a hand mode, the image acquisition device adopts a miniature camera, and the miniature camera shoots the key part of the piano entity in an alignment mode to acquire an actual image of the key part.

Step 400, displaying the virtual picture and/or the actual image.

The main control equipment sends the generated key virtual picture and playing sound to the video processor, the miniature camera also sends real-time collected key entity images to the video processor as a signal input source of the video processor, the video processor processes data sent by a plurality of signal sources, and the plurality of signal inputs are converted into split screen display or picture-in-picture display and then output to the teaching demonstration equipment. The teaching demonstration device can be a high-definition display with a large screen, students can watch hand actions and pressed keys when teachers play the piano through the high-definition display, and the teaching demonstration device plays collected playing sounds in real time.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A highly integrated music teaching demonstration system, comprising: teaching musical instruments, music teaching systems, teaching demonstration equipment;

the teaching demonstration equipment is used for receiving the virtual pictures and/or the actual images sent by the video processor.

2. A highly integrated music teaching demonstration system according to claim 1 wherein said teaching instrument comprises:

3. A highly integrated music teaching presentation system according to claim 1 wherein said image capturing device comprises:

4. The highly integrated music instructional presentation system according to claim 1, wherein said master device comprises:

5. A highly integrated music teaching presentation system according to claim 1, wherein said music teaching system comprises:

6. The highly integrated music instructional presentation system according to claim 1, wherein said music instructional system further comprises:

7. A highly integrated music teaching presentation system according to claim 1, wherein said main board comprises:

8. The highly integrated music instructional presentation system according to claim 1, wherein said main board further comprises: the device comprises a sensor module and an infrared remote control module;

9. A highly integrated music instructional presentation system as claimed in claim 1, wherein said instructional presentation apparatus comprises:

10. The highly integrated music teaching demonstration method according to claim 1 comprising: