CN101038703A - Intelligent interactive learning assistant device and method - Google Patents
Intelligent interactive learning assistant device and method Download PDFInfo
- Publication number
- CN101038703A CN101038703A CN 200610031366 CN200610031366A CN101038703A CN 101038703 A CN101038703 A CN 101038703A CN 200610031366 CN200610031366 CN 200610031366 CN 200610031366 A CN200610031366 A CN 200610031366A CN 101038703 A CN101038703 A CN 101038703A
- Authority
- CN
- China
- Prior art keywords
- data
- audio
- information collector
- digital signal
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
An intelligent interactive study assistant device and a method are provided, the device includes an optical information collector, an audio information collector, a handwriting information collector, and a corresponding A/D conversion unit connected to the information collectors, wherein the A/D conversion unit is connected with a digital signal processor DSP, a micro-processor MCU is connected with the digital signal processor DSP, a data storage assembly, a pattern video processing unit and an audio processing unit, the pattern video processing unit is connected with a pattern video replaying terminal, and the audio processing unit is connected with an audio replaying terminal. The device is mainly used for helping an user to study and search data and performing an intelligent interactive multimedia type teaching.
Description
[technical field]
The present invention relates to a kind of learning assistant device and method, particularly have the intelligent interactive multimedia assistant device and the method for optically detecting, audio collection, hand-written collection and recognition function.
[background technology]
The product and the technology of assiatant's class of auxiliary in the market student's study are many, from box-like electronic digital formula and the computer multi-media teaching type till now of the simple card deck of tradition, as student's treasured, language repeater, electronic dictionary, instant translator and intelligent interactive e-book system (CN03245337), multimedia optic disc reading machine (CN97102872) and powerful and professional multimedia computer and its software.
In the said goods and technology, picture student treasured, language repeater, electronic dictionary, these main functions of instant translator all show: data check, language is play, re-reading, on the character translation, strictness says that they also do not claim is intelligent interactive learning assistant device, and multimedia optic disc reading machine (CN97102872) is though can provide sound and assiatant's mode of these hommizations of image, but it only is the device of a selectable play multimedia teaching material, and and fail to embody intellectuality, mutualization, and the mode and the interface of operation are more loaded down with trivial details and abstract, because the code on the books that it is to use keyboard to key in will to learn, allow machine find out and play relevant audiovisual materials according to code, whether to be uniaxially carry out the knowledge perfusion to the user for this, whether the knowledge of being paid close attention to has been grasped and can be accepted and can not understand the user.
It is to grasp the some horizontal and vertical parity check code of gathering somewhere on the books and character, image information by an optical character recognition reader by the user for an intelligent interactive e-book system (CN03245337), only play out related data in the memory by Intelligent Recognition with the form of sound, same this also just uniaxially to learner's retrieval of giving information, can not understand the user and whether the knowledge of being paid close attention to has been grasped and whether can be accepted, and it is comparatively dull to transmit the mode of knowledge information to the user.
For powerful multimedia computer, though it can finely provide intelligentized interactive assiatant's mode with the multimedia form to the learner, but its operation will depend on operating system and run on the software of operating system, and operation is complicated and specialized, there is maloperation then may be directed at the collapse of system slightly, big very loaded down with trivial details owing to have many uses with operation, complicated and operator's thought is disperseed, difficult concentrating arrives in study, particularly computer has the function of recreation and online and the lower operator of some self-controls (as middle school student) is sitting in just be not in the mood for before the computer at all and learns, it has also just lost aided education ground meaning so, and it is also because individuality is portable more greatly and not.
[summary of the invention]
At defective that exists in the prior art and deficiency, the technical problem to be solved in the present invention is to provide a kind of portable intelligent interactive assistant device, it has multiple information acquisition device, can collect the character on the teaching material that the user will learn, image information and user's voice and hand-written information, has the integrated level height, fast operation and signal processor and microprocessor with embedded system, use the related text of the data that portable storage system medium storage and user will learn, picture and multimedia messages, and also to have figure on the device, the processing of video and sound and playback components; And, reach following technique effect for implementing the scheme method of this intelligent interactive assistant device:
1. intelligent retrieval data: the user is by the information acquisition device data searching; As when using the optical information collector, need only aim at this words and expressions on the teaching material that to learn with the optics information acquisition device, device is the form playback of available literal, image, voice or video and relevant explanation and the data of certain words and expressions on the teaching material, if use audio frequency or hand-written information collector data searching, as long as the user reads aloud or hand-writtenly goes out on the teaching material herein or near words and phrases.
2. intelligent interaction is led religion: realize that the operator according to the reaction of device to own voice or hand-written information input, comes cognitive own mastery of knowledge degree to being paid close attention to; Need only first certain words and expressions of aiming at the optics information acquisition device on the teaching material that will learn as the operator, device is then with this words and expressions on the form broadcast teaching material of voice, the operator follows and reads then, whether device will carry a tune by its voice of analysis and judgement, if next sentence correctly then read aloud in mistake then this words and expressions that repeats to broadcast.Use the hand-written information collector to write this words and expressions on the teaching material if do not read aloud, device will analysis and judgement its write whether correct, if mistake then next sentence correctly then read aloud in this words and expressions that repeats to broadcast is imparted knowledge to students thereby reach as teacher channeling conduct.
The technical scheme that the present invention openly can solve the problems of the technologies described above:
A kind of intelligent interactive learning assistant device includes:
Optical information collector: character on the teaching material that learn or figure are carried out information acquisition, and be translated into electric signal;
The audio-frequency information collector: the voice messaging to the operator is gathered, and is translated into electric signal;
Hand-written information collector: the hand-written of operator or Freehandhand-drawing information are gathered, and be translated into electric signal;
AD conversion unit: will gather the analog signal conversion of coming is digital signal;
Digital signal processor DSP: be responsible for digital signal is handled;
Microprocessor MCU: coordinate the each several part operate as normal of this device, the input and output of management data, and processing section information;
Data storage assembly: comprise that storage has the storage medium of the character relevant with learning teaching material, audio frequency, image, video data data and readable or read and write the functional part of this storage medium;
Graphics video processing unit: figure or video data are handled and synthesized;
Audio treatment unit: voice data is handled and synthesized;
Graphics video playback terminal: the mode playback that figure or video information can directly be accepted with people's sense organ is come out;
Voice reproducing terminal: the mode playback that audio-frequency information can directly be accepted with people's sense organ is come out;
Wherein optical information collector, audio-frequency information collector, hand-written information collector are connected with corresponding AD conversion unit or digital signal processor DSP respectively, AD conversion unit is connected with digital signal processor DSP or microprocessor MCU, microprocessor MCU is connected with digital signal processor DSP, data storage assembly, graphics video processing unit, audio treatment unit, the graphics video processing unit is connected with graphics video playback terminal, and audio treatment unit is connected with the voice reproducing terminal.
A kind of method of implementing intelligent interactive learning assistant device comprises following steps:
Optical information collector or audio-frequency information collector or hand-written information collector are gathered the knowledge information on the study teaching material, again the information that collects is carried out analog-to-digital conversion by corresponding AD conversion unit, by digital signal processor the digital signal after changing is screened, simplified then, be processed into the coding of representing its original analog information, undertaken after computing, analysis, the processing signal being reached graphics video processing unit, audio treatment unit by microprocessor again; Perhaps by microprocessor with Coded Analysis handle that teaching material knowledge source index item on the storage medium in back and the data storage assembly compares, identification and data locking, thereby find on the storage medium and coding corresponding character data, audio data, image document, video data, again the data that is found is reached corresponding graphics video processing unit and audio treatment unit about teaching material knowledge; Signal after by graphics video processing unit and audio treatment unit its data that receives or microprocessor analysis being handled is at last handled synthetic again, and finally the mode playback that can directly be accepted with people's sense organ by voice reproducing terminal or graphics video playback terminal is come out.
The beneficial effect that the present invention has:
The present invention can realize the function of most of assiatant's series products in the market, add this device and very big software arrangements space is arranged at hardware foundation, as data updating, functional mapping, function is improved, function restriction etc., thus can satisfy different textbook contents, mode of learning, functional requirement, realization finally can replace existing other kinds aided education device fully from the aided education requirement of the different demands of multistage of primary school to senior middle school even university.
The technique effect that the present invention produces can make traditional studying copy the conceptual unidirectional mode of learning of this pure words of word and obtain changing, become a kind of and intelligent interactive learning mode knowledge, this mode of learning can be according to acquisition operations person's feedack in the process of study, by installing accurately decision operation person to the degree of the understanding and the memory of knowledge, still whether can begin to learn new knowledge thereby decision will continue study, and the content of knowledge is changed into the figure of iconicity by simple concept nature character, image and sound, make learning process obtain the iconicity reinforcement, thereby make the light of study change knowledge, simple and easy.The learning assistant mode of this intelligent interactive is changed the unidirectional spoon-feed assiatant study of existing other assiatant's products, causes the change of assiatant's mode.
Owing to having omitted keyboard and complicated menu, this device used three kinds of information acquisition devices to be used as input to this device signal and instruction, it is very simple and easy that thereby the operation that makes this device becomes, to make the operator more can be absorbed in study like this, thinking can not disperse owing to understanding with conceptual operation device, thereby reaches better stronger knowledge learning effect.
[description of drawings]
Fig. 1 is intelligent interactive learning assistant device synoptic diagram among the present invention.
Fig. 2 is for implementing the method flow diagram of intelligent interactive learning assistant device among the present invention.
[embodiment]
Below in conjunction with the drawings and specific embodiments invention is described further:
Intelligent interactive learning assistant device synoptic diagram of the present invention as shown in Figure 1, optical information collector, audio-frequency information collector, hand-written information collector and corresponding AD conversion unit, digital signal processor DSP are connected respectively, microprocessor MCU is connected with digital signal processor DSP, data storage assembly, graphics video processing unit, audio treatment unit, the graphics video processing unit is connected with graphics video playback terminal, and audio treatment unit is connected with the voice reproducing terminal.
Optical information collector: character on the teaching material that learn or figure are carried out information acquisition, and be translated into electric signal;
The audio-frequency information collector: the voice messaging to the operator is gathered, and is translated into electric signal;
Hand-written information collector: the hand-written of operator or Freehandhand-drawing information are gathered, and be translated into electric signal;
AD conversion unit: will gather the analog signal conversion of coming is digital signal;
Digital signal processor DSP: be responsible for digital signal is handled;
Microprocessor MCU: coordinate the each several part operate as normal of this device, the input and output of management data, and processing section information;
Data storage assembly: comprise that storage has the storage medium of the character relevant with learning teaching material, audio frequency, image, video data data and readable or read and write the functional part of this storage medium;
Graphics video processing unit: figure or video data are handled and synthesized;
Audio treatment unit: voice data is handled and synthesized;
Graphics video playback terminal: the mode playback that figure or video information can directly be accepted with people's sense organ is come out;
Voice reproducing terminal: the mode playback that audio-frequency information can directly be accepted with people's sense organ is come out;
This intelligent interactive learning assistant device can be as required and flexible design, can use the image analyzer (Pen-shaped Graphics Sensor) of pen type or the camera of CCD as the optical information collector, graphics video playback terminal can be mounted in the LCDs on the crust of the device, the hand-written information collector can be to be positioned at the outer field pressure inductive writing screen of LCDs with the LCDs one, but audio-frequency information collector and voice reproducing terminal can be used the high-fidelity headset of plug, data storage assembly can be used card reading interface and flash card (Flash Card) or small form factor optical drive and CD, device can also add some interfaces flexibly in addition, as carrying out the universal interface of exchanges data transmission with computer or digital product, output interface with vision signal and sound signal, can distinguish the interface of external mouse and keyboard, to be suitable for stronger configuration and function.
Process flow diagram such as Fig. 2 of implementing the method for intelligent interactive learning assistant device show, optical information collector or audio-frequency information collector or hand-written information collector are gathered the knowledge information on the study teaching material, again the information that collects is carried out analog-to-digital conversion by corresponding AD conversion unit, by digital signal processor the digital signal after changing is screened, simplified then, be processed into the coding of representing its original analog information, undertaken after computing, analysis, the processing signal being reached graphics video processing unit, audio treatment unit by microprocessor again; Perhaps by microprocessor with Coded Analysis handle that teaching material knowledge source index item on the storage medium in back and the data storage assembly compares, identification and data locking, thereby find on the storage medium and coding corresponding character data, audio data, image document, video data, again the data that is found is reached corresponding graphics video processing unit and audio treatment unit about teaching material knowledge; Signal after by graphics video processing unit and audio treatment unit its data that receives or microprocessor analysis being handled is at last handled synthetic again, and finally the mode playback that can directly be accepted with people's sense organ by voice reproducing terminal or graphics video playback terminal is come out.
When implementing the method for this intelligent interactive learning assistant device, select only to store the relevant character data of certain part knowledge in the teaching material that the user need learn earlier, audio data, graphic documentation, in the data storage assembly on the storage medium charging apparatus of video data data, optical information collector or audio-frequency information collector or hand-written information collector are gathered the knowledge information on the study teaching material, again the information that collects is carried out analog-to-digital conversion by corresponding AD conversion unit, by digital signal processor the digital signal after changing is screened then, simplify, be processed into the coding of representing its original analog information, carry out computing by microprocessor again, analyze, after the processing signal reached the graphics video processing unit, audio treatment unit; Perhaps by microprocessor with Coded Analysis handle that teaching material knowledge source index item on the storage medium in back and the data storage assembly compares, identification and data locking, thereby find on the storage medium and coding corresponding character data, audio data, image document, video data, again the data that is found is reached corresponding graphics video processing unit and audio treatment unit about teaching material knowledge; Signal after by graphics video processing unit and audio treatment unit its data that receives or microprocessor analysis being handled is at last handled synthetic again, and finally the mode playback that can directly be accepted with people's sense organ by voice reproducing terminal or graphics video playback terminal is come out.
For example:
1. intelligent retrieval data: the user need only pass through the information acquisition device Information Monitoring, as when using the optical information collector, need only aim at certain words and expressions on the teaching material that will learn with the optics information acquisition device enters under the duty and begins Information Monitoring, then the information that collects is converted into electric signal, being transferred to AD conversion unit again, will to gather the analog signal conversion of coming be digital signal, by digital signal processor DSP digital signal is screened again, simplify, be processed into the coding of representing its original analog information, again by microprocessor MCU with its analyzing and processing after with data storage assembly in storage medium on the source index item compare, identification and data locking, thereby find on the storage medium and the corresponding character data of coding, audio data, image document, video data, again the data that is found is reached respective graphical video processing unit and audio treatment unit, last by graphics video processing unit and audio treatment unit its data that receives is handled syntheticly, finally the mode playback that can directly be accepted with people's sense organ by voice reproducing terminal or graphics video playback terminal is come out.If use audio frequency or hand-written information collector data searching, as long as continue to read aloud or hand-writtenly go out on the teaching material herein or near words and phrases, device will repeat above process.
2. intelligent interaction is led religion: realize that the operator according to the reaction of device to its voice or hand-written information input, comes cognitive own mastery of knowledge degree to being paid close attention to; Need only be earlier aim at certain words and expressions on the teaching material that to learn as the operator with the optics information acquisition device, device is just to retrieving in the data of storing in the storage assembly, and playback goes out to be stored in the voice data of this words and expressions on the teaching material in the storage medium movably, the operator uses the audio-frequency information collector to follow to read then, audio-frequency information collector acquisition operations person's voice messaging reaches microprocessor, microprocessor analysis is judged its sound pronunciation, and therewith whether the pronunciation of words and expressions voice data is close, and this words and expressions or read aloud next sentence of repeating to broadcast is imparted knowledge to students thereby reach as teacher channeling conduct.
Although with reference to embodiment disclosed a kind of intelligent interactive learning assistant device and method have been carried out special description, under the situation that does not break away from the present invention program and scope, all variations and modification are all within the scope of the present invention.
Claims (7)
1. intelligent interactive learning assistant device is characterized in that including:
Optical information collector: character on the teaching material that learn or figure are carried out information acquisition, and be translated into electric signal;
The audio-frequency information collector: the voice messaging to the operator is gathered, and is translated into electric signal;
Hand-written information collector: the hand-written of operator or Freehandhand-drawing information are gathered, and be translated into electric signal;
AD conversion unit: will gather the analog signal conversion of coming is digital signal;
Digital signal processor DSP: be responsible for digital signal is handled;
Microprocessor MCU: coordinate the each several part operate as normal of this device, the input and output of management data, and processing section information;
Data storage assembly: comprise that storage has the storage medium of the character relevant with learning teaching material, audio frequency, image, video data data and readable or read and write the functional part of this storage medium;
Graphics video processing unit: figure or video data are handled and synthesized;
Audio treatment unit: voice data is handled and synthesized;
Graphics video playback terminal: the mode playback that figure or video information can directly be accepted with people's sense organ is come out;
Voice reproducing terminal: the mode playback that audio-frequency information can directly be accepted with people's sense organ is come out;
Wherein optical information collector, audio-frequency information collector, hand-written information collector are connected with corresponding AD conversion unit or digital signal processor DSP respectively, AD conversion unit is connected with digital signal processor DSP or microprocessor MCU, microprocessor MCU is connected with digital signal processor DSP, data storage assembly, graphics video processing unit, audio treatment unit, the graphics video processing unit is connected with graphics video playback terminal, and audio treatment unit is connected with the voice reproducing terminal.
2. method of implementing the described device of claim 1 is characterized in that comprising following steps:
Optical information collector or audio-frequency information collector or hand-written information collector are gathered the knowledge information on the study teaching material, again the information that collects is carried out analog-to-digital conversion by corresponding AD conversion unit, by digital signal processor the digital signal after changing is screened, simplified then, be processed into the coding of representing its original analog information, undertaken after computing, analysis, the processing signal being reached graphics video processing unit, audio treatment unit by microprocessor again; Perhaps by microprocessor with Coded Analysis handle that teaching material knowledge source index item on the storage medium in back and the data storage assembly compares, identification and data locking, thereby find on the storage medium and coding corresponding character data, audio data, image document, video data, again the data that is found is reached corresponding graphics video processing unit and audio treatment unit about teaching material knowledge; Signal after by graphics video processing unit and audio treatment unit its data that receives or microprocessor analysis being handled is at last handled synthetic again, and finally the mode playback that can directly be accepted with people's sense organ by voice reproducing terminal or graphics video playback terminal is come out.
3. according to the described device of claim 1, it is characterized in that: data storage assembly comprises storage medium and readable or read and write the functional part of this storage medium, only stores a kind of in certain part knowledge is correlated with in the teaching material that the user need learn character data, audio data, image document, the video data or more than one in the storage medium when using this device.
4. according to the described device of claim 1, it is characterized in that: have the universal interface that can carry out the exchanges data transmission on the device with computer or digital product.
5. according to the described device of claim 1, it is characterized in that: have LCDs and the pressure inductive hand-written information collector that is positioned at display screen surface on the device.
6. according to the described device of claim 1, it is characterized in that: the output interface that has vision signal and sound signal on the device.
7. according to the described device of claim 1, it is characterized in that: have the interface that to distinguish external mouse and keyboard on the device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610031366 CN101038703A (en) | 2006-03-17 | 2006-03-17 | Intelligent interactive learning assistant device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200610031366 CN101038703A (en) | 2006-03-17 | 2006-03-17 | Intelligent interactive learning assistant device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101038703A true CN101038703A (en) | 2007-09-19 |
Family
ID=38889583
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200610031366 Pending CN101038703A (en) | 2006-03-17 | 2006-03-17 | Intelligent interactive learning assistant device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101038703A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102194213A (en) * | 2010-02-22 | 2011-09-21 | 卡西欧计算机株式会社 | Image processing apparatus |
| CN103680229A (en) * | 2012-09-26 | 2014-03-26 | 步步高教育电子有限公司 | Handwriting input method, handwriting input device and handwriting board |
| CN104952301A (en) * | 2015-06-24 | 2015-09-30 | 北京邮电大学 | Classroom interaction systems |
| CN106097810A (en) * | 2016-08-22 | 2016-11-09 | 王帅杰 | A kind of mathematics autonomous learning systems |
| CN106528751A (en) * | 2016-10-28 | 2017-03-22 | 北京光年无限科技有限公司 | Intelligent robot and image data acquisition processing method therefor |
| CN113658462A (en) * | 2021-08-17 | 2021-11-16 | 上海策鸿信息科技有限公司 | Innovative entrepreneurship teaching and practical training system and method |
-
2006
- 2006-03-17 CN CN 200610031366 patent/CN101038703A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102194213A (en) * | 2010-02-22 | 2011-09-21 | 卡西欧计算机株式会社 | Image processing apparatus |
| CN103680229A (en) * | 2012-09-26 | 2014-03-26 | 步步高教育电子有限公司 | Handwriting input method, handwriting input device and handwriting board |
| CN104952301A (en) * | 2015-06-24 | 2015-09-30 | 北京邮电大学 | Classroom interaction systems |
| CN106097810A (en) * | 2016-08-22 | 2016-11-09 | 王帅杰 | A kind of mathematics autonomous learning systems |
| CN106528751A (en) * | 2016-10-28 | 2017-03-22 | 北京光年无限科技有限公司 | Intelligent robot and image data acquisition processing method therefor |
| CN113658462A (en) * | 2021-08-17 | 2021-11-16 | 上海策鸿信息科技有限公司 | Innovative entrepreneurship teaching and practical training system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1079967C (en) | Electronic translation machine | |
| CN1369834B (en) | Voice converter | |
| CN106326640A (en) | Medical speech control system and control method thereof | |
| CN101038703A (en) | Intelligent interactive learning assistant device and method | |
| CN102282554A (en) | Electronic device and information processing method | |
| CN1423216A (en) | Alternative supporting device and method | |
| CN112528799B (en) | Teaching live broadcast method and device, computer equipment and storage medium | |
| Hussain et al. | PHTI: Pashto handwritten text imagebase for deep learning applications | |
| WO2023236253A1 (en) | Document retrieval method and apparatus, and electronic device | |
| CN201655057U (en) | Handheld learning device utilizing optical scanning for input | |
| CN1424665A (en) | Device and operation for dictation test and automatic | |
| CN1855091A (en) | Method for organizing command set of telecommunciation apparatus by navigation tree mode | |
| CN1495645A (en) | Chinese pen multinedia Chinese character teaching system | |
| CN1811778A (en) | Glossary learning method and system thereof | |
| CN1645356A (en) | Multiple dimensional Chinese studying systems | |
| Clavier | Knowledge organization, data and algorithms: the new era of visual representations | |
| CN113223339A (en) | English learning software based on comedy captions | |
| CN1584874A (en) | Intelligent collecting, linguistic intertranslation, speech synthetic method and apparatus | |
| CN1735883A (en) | Electronic dictionary with illustrative sentences | |
| CN1167999C (en) | Method for converting super medium document into speech sound | |
| CN118918601A (en) | English composition review control system and method of intelligent pen and intelligent pen | |
| CN1753481A (en) | Recording method of video frequency caption information and its system | |
| CN113821586B (en) | Text segmentation method and device and electronic equipment | |
| CN1841277A (en) | Method for displaying Chinese phonetic transcription in hand-writing input method | |
| US11734513B2 (en) | Data association and linking system and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |