JP2000250401A - Method and device for learning language, and medium where program is recorded - Google Patents

Abstract

PROBLEM TO BE SOLVED: To accurately grasp intonation of a speech, how to take time intervals between words, etc., and facilitate comparison between a model speech and own speech. SOLUTION: A language data entry means 26 inputs a language data pre- stored in a storage device 21 and a language data outputted from a language data generating part 22 in memory 28. A language data display means 31 displays the language data inputted to the memory 28 on a display 32 so that the waveform of the word part of the speech data corresponds to the character. A data processing means 29 processes the language data inputted to the memory 28, and a reproducing means 33 outputs the speech data of the language data inputted to the memory 28 to a DA converter 34 to reproduce them.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for learning a foreign language or the like, and more particularly to a technique for enabling a language to be recognized not only by ear but also by eyes.

[0002]

2. Description of the Related Art As one of the methods for learning a foreign language, etc.,
Conventionally, there is a method in which a foreign language sound reproduced by a recording / reproducing device such as a tape recorder is heard by ear, or a sentence in a foreign language is uttered and recorded on the recording / reproducing device, and reproduced.

[0003]

However, in the language learning method using a recording / reproducing device such as a tape recorder as described above, since only the learner's hearing is relied upon, the inflection of the model voice and the inter-word It was difficult to grasp how to settle down accurately, and it was not easy to compare the model voice with one's own voice.

[0004] It is an object of the present invention to provide a language learning method, a language learning apparatus, and a medium in which a program is recorded, which solves this problem.

[0005]

In order to achieve the above object, a language learning method according to claim 1 of the present invention is characterized in that character data of a word, phrase or sentence and voice data of the word, phrase or sentence are converted. Inputting as a set of language data;
Displaying the input language data such that the waveform of the audio data corresponds to the character data; and converting the waveform-displayed audio data into an analog audio signal and reproducing the analog audio signal. .

According to a second aspect of the present invention, there is provided a language learning apparatus, comprising: a memory; character data of a word, phrase, or sentence; and voice data of the word, phrase, or sentence, as one set of language data. Data input means for inputting,
A display device; language data display means for displaying language data input to the memory on the display device so that character data corresponds to a waveform of the audio data;
A / A converter, and a reproducing unit for outputting the audio data waveform-displayed on the display device to the D / A converter and reproducing the audio data.

Further, according to a third aspect of the present invention, there is provided a language learning apparatus, comprising: character data of a word, a phrase or a sentence;
A storage device in which language data as a set of voice data of a phrase or a sentence is stored in advance, and an analog voice signal input from the outside is converted into digital voice data, and the voice data is converted into character data. A language data generating unit that converts and outputs the voice data and the character data as a set of language data; a memory; and language data stored in the storage device or language data output from the language data generating unit. Language data input means for inputting to the memory, a display device, and language data display means for displaying the language data input to the memory on the display device so that the waveform of the audio data corresponds to the character data. Data processing means for processing language data displayed on the display device, a D / A converter, Wherein D audio data form displayed
A reproducing unit that outputs the data to the / A converter and reproduces the data; and a language data storage unit that stores the language data displayed on the display device in the storage device.

[0008] Further, a medium on which the program according to claim 4 of the present invention is recorded is a computer which stores a computer as character data of a word, phrase or sentence and voice data of the word, phrase or sentence as a set of language data. Language data input means for inputting, and language data input to the memory,
Language data display means for displaying the character data corresponding to the waveform of the audio data on a display device; and reproduction means for outputting the waveform-displayed audio data to a D / A converter for reproduction. The program has been recorded.

[0009]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a language learning device 2 according to the embodiment.
0 is shown.

In FIG. 1, a storage device 21 comprises a storage medium such as a hard disk, a floppy disk, a CDROM, and an MO, and a drive for reading and writing information on the medium, and stores words, phrases or sentences in a foreign language or the like. Language data is stored as a set of a series of character data indicating the contents and a series of voice data obtained by digitizing a voice signal when the word, phrase or sentence is spoken orally. Note that the voice data and the character data are stored in advance in a state where they are associated with words and silent sections.

Further, in order to obtain language data from a student's raw voice, radio and video output signals, the language learning device 20 converts language data based on an analog voice signal input from the outside. Language data generator 2 to be generated
Two.

The language data generation unit 22 includes an A / D converter 23 for converting an analog audio signal input from outside via a microphone or the like into digital audio data,
Voice data from the D converter 23 is converted into a sound section (word section).
And a voice recognition section 25 for performing voice recognition on a voiced section of the voice data sectioned by the section classification section 24 and converting the voice data into character data. The voice data from the converter 23 and the character data from the voice recognition means 25 are output as a set of language data.

The section dividing means 24 extracts a signal pitch from a series of audio data output from the A / D converter 23 by using an autocorrelation method, a zero-crossing counting method, or the like.
Based on the extracted pitch, a series of voice data is divided into a voiceless section, a voiced section, and a voiceless section, and a continuous part of the combination of the voiceless section and the voiced section without interposing the voiceless section is defined as a voiced section.

Here, for example, in the audio signal shown in FIG. 2, the unvoiced section Va indicates a high frequency part (consonant part), and the voiced section Vb indicates a low frequency part (vowel part).
And a silent section N indicates a low-level portion (noise portion) from which a pitch cannot be extracted, and as shown in FIG.
A plurality of sections in which the voiced section Vb is continuous without interposing the silent section N is referred to as a voiced section V. The sound section V corresponds to a word portion of a sentence. The language data input means 26 inputs arbitrary language data from the language data stored in the storage device 21 and the language data from the language data generation unit 22 to the memory 28 in accordance with the operation of the operation unit 27. Note that the memory 28 can store a plurality of sets of language data.

The data processing means 29 edits the levels of words and silence sections in the language data input to the memory 28 in accordance with the operation of the operation unit 27, such as amplification, attenuation processing, deletion, copying, and movement. Processing and speech speed conversion processing are performed.

The language data storage means 30 stores the language data in the memory 28 in the storage device 21 in accordance with the operation of the operation section 27.

The language data display means 31 displays the language data input to the memory 28 on the screen of the display device 32 so that the character data corresponds to the voice data waveform.

The reproducing means 33 outputs the audio data of the language data in the memory 28 to the D / A converter 34 according to the operation of the operation unit 26.

The D / A converter 34 converts the audio data into an analog audio signal, outputs the analog audio signal to the amplifier 35,
Reference numeral 5 amplifies the audio signal and outputs it to a speaker or headphones (not shown).

The above-mentioned means 24 to 26, 29 to 31, and 33 out of the components of the language learning apparatus 20 are as follows:
It can be operated by computer.

In this case, the storage device 21, the A / D converter 2
3. A medium (floppy disk, CDROM, etc.) in which a program for causing a computer having a display device 32, a D / A converter 34, and the like to function as each of the units 24-26, 29-31, 33 is recorded. , Each program may be loaded into a computer and activated.

Next, a case where a foreign language is learned by the language learning apparatus 20 will be described. First, for example, when language data of a model voice is selected from the language data stored in the storage device 21 by the operation unit 27, the language data is input to the memory 28, and is shown in FIG. As described above, the language data display means 31 displays the waveform of the audio data of the language data in the first display area 32a of the display device 32, and associates the character data of the language data with the waveform of the audio data. Is displayed.

Here, when reproduction of language data in the first display area 32a is designated by the operation unit 27, the reproduction means 3
3, the audio data stored in the memory 28 is output to the D / A converter 34, converted into an analog audio signal and amplified by the amplifier 35, and a model foreign language audio is output from the speaker or the headphone. Is done.

In the state where the waveform of the voice data of the language data and the character data as the model are displayed, the learner specifies the external input by operating the operation unit 27, and the sample of the foreign language as the model is recorded in the microphone. (Not shown) and input this audio signal to the A / D converter 23, this audio signal is converted into audio data, and the audio data is divided into a sound section and a silent section, The data is converted into character data by the recognition means 25, and the series of voice data and character data are input to the memory 28 as a set of language data.

For this reason, as shown in FIG. 4, the language data input by the learner or the like is displayed in a display area 32b different from the first display area 32a, and the waveform of the voice data and the character data are displayed. Are displayed in a state where they are associated with each other.

As described above, the input language data to be learned is displayed so that the waveform of the voice data and the character data correspond to each other, and the voice data can be reproduced. You can check the sentences, and
In addition to hearing, it is possible to visually confirm the strength of the utterance of words and the spacing between words, etc., based on the waveform of audio data.

Further, since the waveform of the model voice and the waveform of the voice input by the user are displayed on the same screen together with the characters, the difference between the waveforms can be visually compared. You can check and correct your utterance status.

For example, as shown in FIG. 4, for the word "diffult", the level of the first peak is higher than the other peaks in the model voice, while the first peak and the second peak are in the own voice. It can be seen that the level of the peak is almost the same and the accent is unclear.
In addition, for the words “for”, “to”, and “the”, the level of the own voice is considerably higher than the level of the model voice, and it is understood that the level after “for” is slightly monotonous. .

If there is a significant error in the pronunciation or intonation of a word, speech recognition is not performed correctly, and a correct character is not displayed at a position corresponding to the waveform data of the word. I understand.

After performing such a comparison, when the operation unit 27 designates the reproduction of the language data in the second display area 32b in order to confirm the result of the comparison, the reproduction unit 3
3, the audio data stored in the memory 28 is output to the D / A converter 34, converted into an analog audio signal, amplified by the amplifier 35, and the audio input by the learner is output from the speakers or headphones. You.

Also, by alternately designating the language data of the first display area 32a and the language data of the second display area 32b, the voice inputted by the user and the model voice are alternately reproduced. Can be easily compared.

Further, as described above, the "for", "to",
For “the”, FIG.
The level can be reduced as follows. In addition, when the distance between words of the model voice is short and it is difficult to hear, it is possible to make it easier to hear by extending the silent section.

After the data has been processed in this way, the effect of lowering the level can be confirmed by replaying the voice input by the user.

After confirming the comparison result and the processed voice, the operation of correcting the utterance, inputting the voice again, and comparing with the model voice is repeated, so that the user's own voice is model voice. Can be approached.
It is to be noted that data processing of the model voice is also possible in the same manner as described above.

When audio data is deleted, copied, or moved during the processing, character data is also deleted, copied, or moved accordingly. When copying, moving, etc., the audio data is also deleted, copied, or moved accordingly.

As described above, for one sentence (which may be a word or a phrase), the user's own voice can be approximated to the model voice, and the language data in the memory 28 is stored in the storage device 21 by the language data storage means 30. The stored language data can be input to the memory 28 again for learning.

In the above description, the voice uttered by the learner is input to the language data generator 22. However, the voice of the foreign language output from the radio or the video is output to the language data generator 2.
2 and deletes unnecessary voiced and silent sections from the language data and stores them as model language data in the storage device 21.
And can be used for learning.

[0038]

As described above, according to the present invention, the language data to be learned input to the memory is displayed on the display device so that the waveform of the voice data and the character data correspond to each other.
The audio data can be reproduced.

For this reason, the language to be learned and its speech waveform can be confirmed on the display screen without looking at the text and the like, and the utterance of words and the method of spacing between words, etc., which were difficult only by listening, can be confirmed. Can be visually confirmed, and efficient language learning can be performed.

Further, language data stored in advance in the storage device or language data generated from an external voice signal can be input to the memory and displayed on the display device. It is possible to visually compare the voice with the voice on the screen, confirm and correct the utterance state of the user based on the comparison result, and further confirm the correction result one by one, so that more efficient language learning can be performed.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an embodiment of the present invention.

FIG. 2 is a diagram showing a correspondence between a signal and each section.

FIG. 3 is a view showing an example of a display screen according to the embodiment;

FIG. 4 is a view showing an example of a display screen according to the embodiment;

FIG. 5 is a view showing an example of a display screen according to the embodiment;

[Explanation of symbols]

 Reference Signs List 20 language learning device 21 storage device 22 language data generation unit 23 A / D converter 24 section dividing means 25 voice recognition means 26 language data input means 27 operation unit 28 memory 29 data processing means 30 language data storage means 31 language data display means 32 display device 33 reproducing means 34 D / A converter

[Procedure amendment]

[Submission date] April 8, 1999 (1999.4.8)

[Procedure amendment 1]

[Document name to be amended] Drawing

[Correction target item name] All figures

[Correction method] Change

[Correction contents]

FIG. 2

FIG. 3

FIG.

FIG. 4

FIG. 5

Claims (4)

[Claims] 1. A step of inputting character data of a word, phrase, or sentence and voice data of the word, phrase, or sentence as a set of language data, and converting the input language data into a waveform of the voice data. A language learning method comprising the steps of: displaying an audio signal corresponding to character data; and converting the waveform-displayed audio data into an analog audio signal and reproducing the analog audio signal. 2. A memory, character data of a word, phrase or sentence and said word, phrase,
Or, data input means for inputting voice data of a sentence into the memory as a set of language data, a display device, and converting the language data input to the memory into a character data corresponding to a waveform of the voice data. Language data display means for displaying the data on the display device, a D / A converter, and audio / data waveform-displayed on the display device.
A language learning device comprising: a reproducing unit that outputs the data to a converter and reproduces the data. 3. A storage device in which character data of a word, phrase, or sentence and speech data of the word, phrase, or sentence as a set are stored in advance, and an analog input from the outside. A language data generating means for converting the audio signal into digital audio data, converting the audio data into character data, and outputting the audio data and the character data as a set of language data; a memory; and a storage device. Language data input means for inputting language data which has been input or language data output from the language data generating means into the memory; a display device; A language data display means for displaying on the display device corresponding to the character data; and a language data displayed on the display device. A data processing means for processing the data, D / A converter and the audio data waveform displayed on the display device D / A
A language learning apparatus comprising: a reproducing unit that outputs to a converter to reproduce the language data; and a language data storage unit that stores language data displayed on the display device in the storage device. 4. A language data input means for inputting character data of a word, phrase, or sentence and voice data of the word, phrase, or sentence into a memory as a set of language data; Language data display means for displaying the displayed language data on a display device so that the character data corresponds to the waveform of the audio data, and reproduction means for outputting the waveform-displayed audio data to a D / A converter for reproduction. A medium on which a program for functioning as a computer is recorded.