KR20060017933A - Method, apparatus and medium of motion imitation by image processing - Google Patents

Abstract

The present invention relates to a method, an apparatus and a medium for mimicking motion by image processing, comprising: photographing a motion of a model with a camera and displaying the motion on a display device; And displaying, on the display apparatus, an image photographed by a camera of the exercise of the exerciser following the operation of the model displayed on the display apparatus. As described above, according to the present invention, the exerciser is free from the burden of having to practice body movements or performances with the help of someone each time. In the field, there is an advantage in that the best education and training can be performed by having an excellent effect and especially imitating the best model. Especially in the field of piano playing or violin playing where many people are educated, it can have an excellent effect. The area is that it has the advantage of covering the playing field of all the instruments put into the orchestra. In addition, the model and the practitioner play at the same time through the Internet communication will be able to train the distance playing.

Model, exerciser, imitation, camera, video, footage

Description

Method, apparatus and medium of motion imitation by image processing

1 is an explanatory diagram showing a prior art;

Figure 2 is a model drum player shooting plane state diagram in one embodiment of the present invention,

3 is a schematic diagram of a model drum playing video in a display device according to an embodiment of the present invention;

Figure 4 is a plan view showing the practice drum player shooting plane state diagram and a model drum playing video and practice drum player video in one embodiment of the present invention implemented in one display device,

5 is a schematic view of a display device showing an identification unit at the time of hitting according to an embodiment of the present invention;

6 is a state diagram in which an image projector is projected onto a piano keyboard by an image projector according to an embodiment of the present invention; and

7 is a state diagram in which an image projector is projected onto other ground by an image projector according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

24: model camera 31: display device                 

      32: model video 43: mimic camera

48: imitation image 51: display point

The present invention relates to a method of mimicking motion by image processing, and more particularly, an image taken by a camera and an image taken by a practitioner who follows an operation of a model displayed by the camera. The present invention relates to a method for allowing a user to train a body movement or a performance by displaying a display device. The invention also relates to an operation imitation device for the method.

In the prior art, the example shown in FIG. 1 as 'a dancing karaoke' (01) will be described as an example. First, the singer or dancer model (02) is photographed (04) by the camera 03, and the image is inverted horizontally. (05) By processing the synthesized lyrics, performance music, video, etc. (06) and expressing the image (08) that the music 10 or the subtitle (09) appear at the same time on the display device 07, the exerciser (11) You can practice the same as the model (02) while watching such videos, so you can do similar training without going to a special educational institution. This method has good advantages as a method of training body movements, but because the video must be reversed, the procedure is cumbersome and distorts the actual situation, which can cause confusion. There is a drawback to being almost eliminated. Another conventional technique is disclosed in Patent Publication No. 10-1991-0005221 (1991.03.30) 'Piano with automatic playing function' and converts the strength of the keyboard, pedals and key presses into digital signals when the piano is playing, If necessary, the recorded digital signal can be played back and the strings are driven directly by this signal to automatically reproduce the music played. When the player presses a key to play the music, The hammer driving device is pushed up, whereby the hammer mounted on the upper part of the driving device is operated to strike the string corresponding to the pressed key. Thus, the resonance sound of the string is generated, and at the same time, Since the key switch is pressed, the press signal of the corresponding key is output, and the vibrating sound of the generated string is input into the microphone. When the push signal is output by the operation of the keyboard and the pedal switch, and the vibrating sound of the string is input through the microphone, the master clock generator applies a reference clock signal of a predetermined frequency to the clock counter, and the clock counter inputs the clock signal. The timing signal of each of the timing generator, the multiplexer data generator, and the data generator is supplied to supply the clock signal required by the micro-input string. It is separated and applied to the comparator, which is applied to the comparator, and the vibrating sound of the string divided into high and low by a predetermined voltage applied to the comparator is converted into a bass signal BS and a treble signal TB, which are digital signals. A serial output applied to the other input of the data generator and output from the data generator Specifically, the data signal is recorded in the recording / reproducing apparatus. The keyboard and the pedal that the player presses are sensed by the matrix circuit to output the pedal and the key press signals, and the strength and weakness of the sound generated by driving the strings are sensed. A signal detection unit for outputting a low tone signal and a high tone signal, a recording circuit unit for combining and synthesizing the detection signal output from the signal detection unit, converting the digital signal into a digital data signal, and a data signal output from the recording circuit onto a tape. A recording / playback apparatus for recording or reproducing the recorded signal, and the data signal reproduced by the recording / playback apparatus into a keyboard signal, a pedal signal, a bass signal, and a treble signal to separate data on the strength of the keyboard, pedal, and sound. A reproducing circuit section for outputting a signal and a logic circuit combining the data signal output from the reproducing circuit section It is a piano having an auto-playing function, characterized in that it comprises a drive circuit unit for outputting a drive signal, and a solenoid unit for driving the corresponding keyboard and pedal by the keyboard and pedal drive signal output from the drive circuit unit. Such a device is complicated in structure, difficult to manage, high in cost, and can not be said to be very helpful in practicing piano playing.

Another prior art is disclosed in Patent Publication No. 20-1999-0034761 (1999.09.06) 'electronic musical instruments and dancing boards using the Internet' and the contents thereof, the invention is a music that can be separated a specific sound using a computer network It is designed to be synthesized into original music when the user plays the electronic instrument connected to the user's computer or sings after erasing any specific musical instrument sound or human part of music. If you are a beginner who does not know the basics of music, you can play a virtual instrument through the monitor of your computer in software and send a signal to the electronic instrument connected to the communication port of the computer in hardware. In addition to displaying the location as a light, it also allows the user to recognize the intensity of the light or the length of the light. In addition, the application of this design is to be able to learn the dance movement by sending a light signal to the grid on the floor in association with the movement of the human foot when the music is a dance song. Is that. However, in order to provide a sheet music that can be separated from a particular sound, the sheet music must be edited one by one and most of the sheet music must be processed in order to establish a business.

 Another prior art is disclosed in Patent Publication No. 10-2000-0024639 (2000.05.06) 'music learning system capable of self-learning', the present invention provides a music learning system capable of self-learning, the present invention is A music learning system for performing music lessons to learners, comprising: a first storage medium storing performance learning data to be learned; Reproducing means for reproducing performance learning data from the storage medium; Input means for inputting performance data by the learner playing the instrument; A second storage medium storing the input performance data; And a microcomputer comparing the performance learning data stored in the first storage medium with the performance data stored in the second storage medium to determine and output a different part. Further comprising a video / audio input / output unit to enable communication or PC communication, the teacher and the learner at a remote location to enable remote music lessons, if there is a music learning system and method that can be learned by students as in the present invention It can save a lot of music teaching staff. Such a method is advantageous in comparing the performance state of the model and the exerciser, but it is difficult to bring about a great practice effect.

 Another conventional technique is disclosed in Korean Patent Laid-Open Publication No. 10-2002-0016976 (2002.03.07) 'On-line piano lesson server, online piano lesson client, and a recording medium on which online piano lesson programs are recorded.' An online piano lesson apparatus for providing online piano lessons through the present invention, the online piano lesson apparatus comprising a server and a client, the server comprising: a storage device; A processor coupled to the storage device; And an internet access interface for controlling data flow over the internet, wherein the storage device stores a piano performance database, a piano performance music download program, and a piano performance music playback program including information on a plurality of piano performance music, The client includes an Internet access interface for controlling access and data flow through the server and the Internet; A client playing music downloader which downloads information on the piano playing music from the server through an internet access interface; A playing music player for playing and outputting piano playing music by using the downloaded information on the piano playing music; A score display unit for displaying the sheet music included in the downloaded information on the piano-played music and displaying the playing progress on the displayed score in synchronization with the piano-played music; And a keyboard display portion for displaying the piano keys and displaying the positions of keys played on the displayed piano keys in synchronization with the piano playing music reproduced by using the downloaded information on the piano playing music, according to the present invention. In addition, you can download and play piano music online via the Internet, and receive live music scores, keyboard positions, and lesson information required for your performance in real time. It is easy to learn how to play the piano on the music played. However, this method is different from being able to compare models and exercisers in real time, so the practice effect is not big.

Another prior art is Patent Publication No. 10-2002-0030609 (2002.04.25) 'Piano keyboard for the computer', the present invention is coupled to the keyboard connection port of the computer and is configured to be coupled to the output port of the keyboard, The present invention relates to a computer piano keyboard configured to output keyboard key information of a piano keyboard to a computer or to output input key information applied from a keyboard to a computer. And a first coupling means electrically coupled with the keyboard, a second coupling means electrically coupled with the keyboard, a plurality of function keys and a keyboard key in the form of a piano keyboard, and the first number of lines and the second number of heat lines cross each other. Arranged in such a way as to provide a plurality of contact switches at the intersection of the line and the line, corresponding to the position and the number of function keys and keys A matrix circuit for outputting destination information and hot wire information corresponding to an input keyboard key, a data conversion processor for converting and outputting the destination information and hot wire information applied from the matrix circuit into a keyboard data form, and a data output path And a switching switching means for switching an output path of data applied from the key input means and the second coupling means based on selection information applied from the switch. The present invention is intended to illustrate that it can be applied when it is difficult to provide a means for practice as a device that can be seen as a huge piano like conventional.

Another conventional technology is Utility Model Application No. 20-2000-0016971 (2000.06.15) 'Piano keyboard containing bioceramic' and the present invention relates to a piano keyboard containing bioceramic, more specifically By specially treating porous ceramic powder that emits far infrared rays to produce a bioceramic that generates negative ions together with far infrared rays, it contains bioceramic powder as a whole on the surface of a normal piano keyboard and inside, so it is very reasonable by the effect of emitting far infrared rays. The player's fingers touch the ceramic gun intimately, and far-infrared rays are radiated to the player, causing vibrations of atoms and molecules in the skin.Thermal reaction occurs in the body, causing the temperature of the subcutaneous tissue to rise, Expansion, promoting blood circulation, enhancing metabolism, regenerating cellular tissues, etc. By maintaining the proper body temperature, the effect of warming, aging, and fatigue recovery prevents the performer from numbing the fingers and wrist even after playing or practicing for a long time. There is a characteristic that can alleviate the problem. It is illustrated to infer various modifications of the keyboard.

Another conventional technique is disclosed in Patent Publication No. 10-2002-0073457 (2002.09.26) 'optical keyboard acquisition device' and the present invention is that the keyboard itself of the touched area when the user touches the keyboard of the piano light and the user The optical keyboard acquiring device, in which the keyboard to be touched next emits light by different light, comprising: a sensor contact portion which is operated when a hand or a part of the body is in contact with the light keyboard, which emits light by the keyboard itself. and; An input device for converting weak signals generated in the sensor contact portion of the optical keyboard into signals that can be input to the CPU; An output device operable to emit a voltage necessary for emitting light emitting elements of the optical keyboard under the control of the CPU and an optical keyboard to emit light; A CPU for controlling the output device in accordance with the memorized contents of the input device and the memory unit; It is a light keyboard learning device that can practice the music through the decorative effect and the keyboard to generate a light consisting of a memory unit which is stored by the information of the performance to be played to operate by the CPU. This type of device is considered to be effective when practicing piano, but it has the disadvantages of complicated instrumentation, the need to prepare data one by one, and difficulty of routineizing at high cost. I think there is a number.

Another conventional technique is a utility model application No. 20-2001-0025290 (2001.08.21) 'an image music accompaniment device capable of practicing the instrument' and the present invention is to customize the performance of the instrument part for the music of the predetermined piece Audio signal processing by excluding the sound input data, the sound source data memory storing sound source data according to the performance sound of each instrument part for a plurality of pieces of music, and the sound sound data of the instrument part for performance practice from the sound source data of the sound source data memory An audio signal processor to output a sound source signal of a predetermined music through a speaker and to amplify a play sound signal input from an electronic instrument, and to analyze a play sound signal from an electronic instrument to generate a play sound evaluation signal. A performance sound evaluation processing unit, each instrument corresponding to sound source data of a plurality of pieces of music stored in the sound source data memory Accompaniment data memory in which the character data of the beam is stored, and character data on the performance information of the currently accompaniment music from the accompaniment data memory are processed and the video signal is processed, and the musical instrument performance score evaluated for the performance sound of the electronic musical instrument A video signal processor for processing a video signal of the character data of the character, an image monitor for displaying the character data of the performance information and the instrument performance score, and controls to enable the performance of the instrument part selected in accordance with the user input of the key input unit And a control unit for controlling the performance sound evaluation signal to be displayed on the video monitor by calculating the evaluation score of the instrument performance by comparing the accompaniment sound of the corresponding instrument part. Such an invention has advantages as an evaluation system, but there are many inadequate parts to improve the actual performance.

The present invention is to solve the above problems of the prior art, the step of photographing the operation of the model with a camera and displaying on the display device; It is an object of the present invention to provide a method for mimicking motion by image processing comprising the step of displaying on the display device an image taken by a camera of an exerciser's motion following the operation of a model displayed on the display device. .

Still another object of the present invention is to display an image taken with a camera of an exerciser's movement following a model on the display device, wherein the image is displayed as a similar sized image. It is to provide a method of mimicking the motion by the.                         

It is another object of the present invention to provide a method of mimicking motion by image processing, wherein each image is semi-transparently processed to be displayed as a similarly sized image.

Still another object of the present invention is to capture the operation of the model by the camera and displaying on the display device; It is an object of the present invention to provide a method of mimicking motion by image processing, wherein the step of displaying an image taken by a camera on the display device of an exerciser's motion following the operation of a model displayed on the display device is simultaneously implemented.

It is another object of the present invention to provide a method for mimicking motion by image processing, characterized in that the image having an identification means so as to know the position of the object hitting time of the model.

Still another object of the present invention is a photographing means for photographing body motion or playing model; A display device for displaying an image photographed by the photographing means; Photographing means for photographing an exerciser who follows an operation of a model displayed on the display apparatus; It is an object of the present invention to provide an apparatus for mimicking motion by image processing, wherein the video image photographed by the photographing means for photographing the exerciser is composed of editing means for overlapping the model image and displaying on the display device.

Still another object of the present invention is to provide an image medium photographed by a photographing means for photographing a body motion or a performance model, for an exerciser who follows an operation of a model displayed on a display device.                         

Still another object of the present invention is an image taken by the shooting means for shooting the body motion or performance model, and an image taken by the shooting means for shooting the exerciser to follow the operation of the model appears when the image is displayed on the display device This is to provide an edited video medium.

Still another object of the present invention is to provide a cradle for mounting each camera so that each image can be the same size image.

Still another object of the present invention is to photograph the motion of the model with a camera; Mimicking the motion by image processing, comprising: displaying the image by a projector for an image in a practice part in which an exerciser's practice operation is performed and the gaze of the exerciser is focused, in a form similar to the image; How to provide

Still another object of the present invention is to photograph the motion of the model with a camera; Storing the photographed image on a medium; And displaying the image of the medium in a form similar to the image of the medium by the projector for the image on the exercise unit where the practice operation of the exerciser is made and the gaze of the exerciser is focused. It is to provide a method of mimicking motion by processing.

It is still another object of the present invention to provide a method for mimicking motion by internet image processing, wherein the method for mimicking motion by image processing is implemented via the Internet.

It is still another object of the present invention to provide a method for mimicking motion by image processing, wherein identification means are obtained so that identification of an object that changes during operation of the model is easily identified.

Still another object of the present invention is a photographing means for photographing the operation of the model; It is similar to the image, the exercise is performed by the exerciser, the display unit for displaying on the exercise unit to focus the gaze of the exerciser; to provide a motion imitation device by the image processing, characterized in that it comprises a.

Still another object of the present invention is a photographing means for photographing the operation of the model; Storage means for storing the photographed image on a medium; And display means for displaying the image of the medium in a form similar to the image of the medium, in which the exercise of the exerciser is practiced and the gaze of the exerciser is focused. It is to provide an imitation device.

Another object of the present invention is to provide a training means equipped with a shooting means for photographing the movement of the model or the exercise of the exerciser.

Method for mimicking motion by image processing according to the present invention comprises the steps of photographing the motion of the model with a camera and displaying on the display device; And displaying, on the display apparatus, an image photographed by a camera of the exercise of the exerciser following the operation of the model displayed on the display apparatus. In this way, the practitioner can freely practice the movements or performances with the help of someone each time, and can use the media with computer-related media indefinitely to practice the exercises. In particular, it is possible to imitate the best model and to perform the best education and training. In the embodiments described below, the case related to the drum performance has been described, but it can have an excellent effect in the piano playing field or the violin playing field that many people are educated. The area is that it has the advantage of covering the playing field of all the instruments put into the orchestra. In addition, the model and the practitioner play at the same time through the Internet communication will be able to train the distance playing.

In addition, in displaying an image photographed by a camera of an exerciser's motion following the operation of the model on the display device, the image material is displayed to be superimposed and displayed as a similar size, respectively. In the superimposed display, each video object is translucent. Such a method provides an optimal method to complete the motion imitation method by the image processing according to the present invention, and maximizes the practice effect by dynamically matching the body motion or performance of the model with one's own motion on the screen. You can do it. In addition, whether to use computer skills to repeat training until mastery, to adjust the salary by the demands of the practitioner, or to score the exerciser's learning to determine the progress has been a lot of It can be said that it is easy to implement and apply to this invention.

Method for mimicking motion by image processing according to the present invention comprises the steps of photographing the motion of the model with a camera and displaying on the display device; And displaying the image taken by the camera on the display device of the exercise of the exerciser following the operation of the model displayed on the display device.

In addition, it is characterized in that the image having an identification means so as to know the position of the object hitting time of the model. In this way, for example, when you play the piano, you usually shoot from the upper surface of the keyboard, so you can't know whether your finger hits the keyboard or not. It is to aim at ease of use by doing. Preferably, the identification means is a color having a different color. In addition, if the instrument used by the model is a piano, it is also preferable to use a piano that allows the built-in light to spread throughout the keyboard.

An apparatus for mimicking motion by image processing according to the present invention includes photographing means for photographing a body motion or a performance model; A display device for displaying an image photographed by the photographing means; Photographing means for photographing an exerciser who follows an operation of a model displayed on the display apparatus; It characterized in that the image is taken by the shooting means for shooting the exerciser is composed of the editing means for displaying on the display device overlapping the model image, and each camera so that each of the image can be the same size of the image It is characterized in that the cradle to mount. Most of these devices are easy to implement and require the development of editing means by editing only two images, but they are easily developed as technology of these days.

The motion-mimicking video medium according to the image processing according to the present invention is for an exerciser who follows the motion of a model displayed on a display device, and is a video medium photographed by a photographing means for photographing a body motion or a performance model. An image medium edited by superimposing an image photographed by a photographing means for photographing a performance model and an image photographed by photographing means for photographing an exerciser following an operation of a model displayed when the image is displayed on a display device. Having such a medium by instrument and sheet music creates a relevant new market. For example, in the orchestra, each instrument player has practiced in different places and then gathered together to form harmony, and then gathered together from the beginning. You will be able to practice using and you will also see the effect of saving time through quick lessons. Moreover, when these devices become generalized, those who give up due to age may challenge the playing of the instrument, and it will be able to see the effects in terms of cost and learning even for children who spend a lot of time and money to study playing the instrument. It can also be a big advantage that there is not much cost to implement it.

Method for mimicking motion by image processing according to the present invention includes the steps of photographing the motion of the model with a camera; And a form similar to the image, in which a practice operation of the exerciser is made and the gaze of the exerciser is focused, displaying the image by an image projector.

Method for mimicking motion by image processing according to the present invention includes the steps of photographing the motion of the model with a camera; Storing the photographed image in a medium; the image of the medium is similar to the image of the medium, and is displayed by a projector for an image on a practice unit where a practice operation of an exerciser is made and the gaze of the exerciser is focused; It characterized in that it comprises a. In order to display the image on the exercise means by the image projector as described above, it is preferable to apply a piano, for example, in the case of a keyboard, the surface of which is processed to display the image well. This is done by applying the principle of the screen of the project for image. If the black keyboard interferes with the display of the image, it is preferable to replace the color with another one.

Another practice for using video projects is to use a video projector for models and two video projectors for exercisers.

The motion imitation method by the image processing according to the present invention is characterized in that the motion imitation methods by the image processing are implemented through the Internet.

The motion imitation method by the image processing according to the present invention is characterized in that the identification means is obtained so that identification of a subject that changes during operation of the model can be easily identified. The identification means may be implemented through image editing after shooting, and may be implemented by displaying the identification means at the time of shooting, and the specific apparatus may be referred to the related art. Keystrokes can be made in such a way that the keyboard's built-in display device works.

An apparatus for mimicking motion by image processing according to the present invention includes: photographing means for photographing motion of a model; In a similar form to the image, a display unit for displaying on the exercise unit, the exercise of the exercise is practiced and the gaze of the exerciser is focused.                     

An apparatus for mimicking motion by image processing according to the present invention includes: photographing means for photographing motion of a model; Storage means for storing the photographed image on a medium; And display means for displaying the image of the medium in a form similar to the image of the medium, in which the exercise of the exercise of the exerciser is performed and the gaze of the exerciser is focused.

In the imitation of motion by the image processing according to the present invention, the training means is a training means provided with photographing means for photographing the motion of the model and the exerciser of the exerciser, and the training means is a string instrument group (stringed musical instrument). Violin, Viola, Cello, Double Bass, Trev Viol, Tenor Viol, Bass Viol, Baritone as Baritone, Viola di Moree, Kitara Battene as Guitar, Guitar, Giton, Theor as Lute In the lute, theorvo, the kitarones, the lute, the harp as the harp, the liar, the cheater, the cheater, the spirit, the clavicord, the harpsichord virgin, the harpsichord, the octave spinet, the wind instrument group As a wind instrument trumpet, trombone, French horn, tuba, sousaphone, a woodwind instrument record tribly cord, tenor cord, bass record, piccolo as flute, In the Pubul, Oboe, Bassoon, clarinet, Clarinet, Bassethorn, Dun, Kung, Bagpipe, Organ organ, Position organ, Regal organ, Percussion group (beating instrument), Tambourine, Triangle, Cymbal, Timpani, It is a xylophone and, in a traditional instrument, as a string instrument, a bow using a bow, a haegeum, a lyre using a bar, a gayageum using a finger, a great hawk, a gold, a dew, a loquat, a moon, a ball, a gold using a pole, a wind instrument As, horizontally poured, heavy, salt, lichen, vertically poured incense, sugar, sepiri, taepyeongso, medicine, red, cattle, tungso, danso, other life, hun, shell, nabal, percussion instrument Musical instruments, scoops, slices, slices, direction, luck, bellows without instruments, bells, gongs, ginsengs, gourds, axes, fish, boo, janggo (or janggu), grind, jingo, jingo, yonggo, segogo , Brain, young, young, nogo, nodoi Characterized in that the drum else, Lee code, harmonica, ocarina.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Prior to this, the terms or words used in the present specification and claims should not be interpreted in the ordinary and dictionary sense, and the inventors can appropriately define the concept of terms in order to explain their own invention in the best way. It should be interpreted as meaning and concept corresponding to the technical idea of the present invention based on the principle.

Therefore, the embodiments described in the present specification and the configuration shown in the drawings are only exemplary embodiments of the present invention, and do not represent all of the technical ideas of the present invention, and various equivalents may be substituted for them at the time of the present application. It should be understood that there may be water and variations.

1 is an explanatory diagram showing a prior art and refer to the technical field to which the present invention pertains.

Figure 2 shows a model drum 22 player 21 photographing plane state diagram according to an embodiment of the present invention, and shows a model camera 24 for photographing the situation of hitting a drum with a stick 23 on the player's head. . At this time, the sound is preferably recorded together. In addition, the position of the camera for the model should be used in consideration of the screen size, but a separate holder such that the size of the imitation camera to be described later to be similar to the size.

3 is a schematic diagram of the model drum playing video 32 implemented in the display device 31 according to an embodiment of the present invention, and the playing music sound 33 is also represented.

4 is a view showing a practice drum 41 player shooting plane state diagram and a model drum playing video 32 and a practice drum player video 46 in one display device 31 according to one embodiment of the present invention. As a flat state diagram showing that the practice player hits the instrument with a stick 42, the sound 45 is produced and the sound and the corresponding image are recorded and recorded by the imitation camera 43 located above the exercise player's head. The sound 47 and the corresponding video object are simultaneously displayed on the display device 31. At this time, the video model 32 and the sound 33 of the original model can be performed by trying to match as much as possible to perform efficient playing practice. Such mimic cameras may transmit data by wires 44, but would be efficient in terms of management if they were to be transmitted wirelessly.

FIG. 5 is a schematic view of a display device 31 showing an identification mark 51 as an identification means at the time of hitting, according to one embodiment of the present invention, wherein the model video 32 and the imitation video 45 are sound 33 respectively. , 47), which represents the situation that is being expressed and is intended to visualize the point at which the blow is actually being made, which has the effect of enhancing the practice effect.

FIG. 6 shows a state diagram in which the model image 55 is projected onto the piano keyboard 52 by the image projector 59, and the piano practicing apparatus 51 is formed of a keyboard and other parts. And an identification mark 54 identifying the model's hand 55 and the key being keyed, with the exerciser's hand 56 being placed on the keyboard and the image 53 of the projector being displayed thereon, preferably Indicates that the sheet music 58 is displayed together with the image on the sheet music display section 57. In this way, the practitioner can follow the movement of the model as it is, so that even if there is no leader in particular, he can practice playing the instrument. Of course, at first you can not follow the operation of the model as it is, you can easily follow if you adjust the motion of the video to 1/2 times. This method can be easily implemented on the Internet, and the fact that this method is activated serves as a catalyst for generalizing the aristocratic instrument playing field, especially in the case of the older generations who are building musical instruments and walls. It is to provide a joy to play, and the activation of musical instrument performance contributes to the improvement of human intelligence.

7 shows an identification display unit 65 for identifying the model 63 and the corresponding guitar string in the model image by the image projector 67 on the guitar string 64 in one embodiment of the present invention. The displayed image indicates what is displayed on the hand of the exerciser 62 and other fingerboards, and if you follow the identification indicator displayed on the guitar line, you can practice alone. The above methods have the advantage of breaking the stereotype that the player should always practice a lot because the player is able to play without sufficient practice, and furthermore, the development of a whole new instrument that is easy to apply the method. It is considered to be sufficient to act as an initiator.

Although not shown in the drawings, the key to the method and apparatus is that images of the same size should be implemented on the display device, and for this purpose, consideration should be given to the mounting position or distance of each camera. Various brackets, cradles, supports for this purpose will be easy for those skilled in the art to implement.

As copyright, I want to refer to the contents included in the user manual (author: Choi Hyo-seung).

1. Method of mimicking motion by image processing using media

1-1. Install the imitation camera holder correctly as described in the media or in separate instructions.

1-2. Make sure to record the video and sound at the same time.

1-3. Familiar sheet music is practiced at the same speed, and for the first sheet music or for not enough sheet music, practice using the adjustment function.

1-4. To prevent sound confusion, wear separate headphones to practice.

1-5. If there is no distinction between overlapping images, readjust brightness, brightness, or saturation, and especially optimize each transparency.

1-6. If you want to know the practice of the practice, you or your parents check the progress using the scorecard included in the program.                     

1-7. Half the overall playing speed in orchestra practice. Start with 1/3 and gradually practice at the same or faster pace.

1-8. The display device applies a product that is light and small in size and has sufficient visibility.

1-9. High resolution camera is recommended.

1-10. In order to prevent the camera from falling down or falling down, the device should be firmly mounted and the related device should be installed in a flat place.

2. Method of mimicking motion by image processing using internet

2-1. Turn on the Internet call mode.

2-2. Install the imitation camera holder correctly as described in the media or in separate instructions.

2-3. Make sure to record the video and sound at the same time.

2-4. Familiar sheet music is practiced at the same speed, and for the first sheet music or for not enough sheet music, practice using the adjustment function.

2-5. To prevent sound confusion, wear separate headphones to practice.

2-6. If there is no distinction between overlapping images, readjust brightness, brightness, or saturation, and especially optimize each transparency.

2-7. If you want to know the practice of the practice, you or your parents check the progress using the scorecard included in the program.

2-8. Half the overall playing speed in orchestra practice. Start with 1/3 and gradually practice at the same or faster pace.

2-9. The display device applies a product that is light and small in size and has sufficient visibility.

2-10. High resolution camera is recommended.

2-11. In order to prevent the camera from falling down or falling down, the device should be firmly mounted and the related device should be installed in a flat place.

As described above, according to the present invention, the exerciser is free from the burden of having to practice body movements or performances with the help of someone each time. In the field, there is an advantage in that the best education and training can be performed by having an excellent effect and especially imitating the best model. Especially in the field of piano playing or violin playing where many people are educated, it can have an excellent effect. The area is that it has the advantage of covering the playing field of all the instruments put into the orchestra. In addition, the model and the practitioner play at the same time through the Internet communication will be able to train the distance playing.

Claims (17)

Photographing the motion of the model with a camera and displaying the motion on a display device; And displaying, on the display apparatus, an image photographed by a camera of an exerciser's operation following an operation of a model displayed on the display apparatus. The method of claim 1, In displaying the image taken by the camera of the exerciser to follow the operation of the model on the display device, A method of mimicking motion by image processing, characterized in that each of the images are displayed with overlapping images of similar size. The method of claim 2, In the superimposed display as a video image of a similar size, A method of mimicking motion by image processing, wherein each image is semitransparently processed. Photographing the motion of the model with a camera and displaying the motion on a display device; And displaying the image taken by the camera on the display of the exerciser's motion following the operation of the model displayed on the display device at the same time. The method according to claim 1 or 4, Motion mimicking method by image processing, characterized in that the image having an identification means so as to know the position of the object hitting time of the model. Photographing means for photographing a body motion or a performance model; A display device for displaying an image photographed by the photographing means; Photographing means for photographing an exerciser who follows an operation of a model displayed on the display apparatus; And an image editing means for displaying the image taken by the photographing means for photographing the exerciser on the display device by overlapping the model image. An image medium photographed by a photographing means for photographing a body motion or a performance model, for an exerciser who follows an operation of a model displayed on a display device. An image medium edited by superimposing an image captured by a photographing means for photographing a body motion or a performance model, and an image photographed by a photographing means for photographing an exerciser following an operation of a model displayed when the image is displayed on a display device. . The method of claim 6, A cradle that mounts each camera so that each video can be the same size. Photographing the motion of the model with a camera; Mimicking the motion by image processing, comprising: displaying the image by a projector for an image in a practice part in which an exerciser's practice operation is performed and the gaze of the exerciser is focused, in a form similar to the image; Way. Photographing the motion of the model with a camera; Storing the photographed image on a medium; And displaying the image of the medium in a form similar to the image of the medium by the projector for the image on the exercise unit where the practice operation of the exerciser is made and the gaze of the exerciser is focused. Method of motion imitation by processing. The method according to claim 1 or 4 or 10 or 11, Method for mimicking motion by the Internet image processing, characterized in that the motion imitation methods by the image processing is implemented via the Internet. The method according to claim 10 or 11, wherein And an identification means for determining identification of a subject that changes during operation of the model. Photographing means for photographing the operation of the model; And a display means for displaying, in a form similar to the image, an exercise part of which a practice operation of the exerciser is made and the gaze of the exerciser is focused; Photographing means for photographing the operation of the model; Storage means for storing the photographed image on a medium; And display means for displaying the image of the medium in a form similar to the image of the medium, in which the exercise of the exerciser is practiced and the gaze of the exerciser is focused. Imitation device. Exercise means provided with a photographing means for photographing the movement of the model or the movement of the exerciser. The method of claim 16, The exercise means, In string instrument group (stringed instrument), Violin, Viola, Cello, Double Bass, As the Viol tribesviol, tenorbiol, basebiol, As a baritone, a baritone, a viola dimore, As a guitar, Kitara Batende, Guitar, Giton, As the lutes, the theorute, theorvo, the kitarones, the lute, As harp, harp, lira, As a cheaters, cheaters, spirits, clavicords, Harpsichord ver., Harpsichord, octave spinnet, In a group of wind instruments, As a wind instrument trumpet, trombone, French horn, tuba, sousaphone, As a woodwind record record tribly cord, tenory cord, bass record, As the flute, Piccolo, As oboe, oboe, bassoon, As a clarinet, clarinet, basset horn, As a family member, As organ organ, organ organ, legal organ, In the group of percussion instruments, Tambourine, triangle, cymbal, timpani, xylophone, In traditional instruments, As a string instrument, Agen, Haegeum using the bow, Lyre, Gayageum, Greater, Gold, Dew, Loquat, Mon, Fri Gold using a pole, As a wind instrument, Horizontally poured, heavy, salt, branch, Vertically blowing incense, sugar, sepiri, Taepyeongso, medicine, red, cow, ungso, danso, Other raw, hun, shell, naval, As a percussion instrument, Orthodontic instruments, scoops, slices, slices, direction, clouds, Musical instruments bellows, gongs, gongs, gourds, axes, fish, wealth, janggo (or janggu), grind, jingo, jingo, yonggo, leftgo, thunder, thunder, younggo, youngdo, nogo, nodo, In addition, the drum, record, harmonica, ocarina is a practice means.

Images