WO2014189327A1 - Ultrasonic wave output system for treating brain-brain interface and method therefor - Google Patents

Abstract

An ultrasonic wave output system for controlling neural functions according to the present invention includes: a calculation part for calculating the mapping information of each neural function for N ultrasonic wave stimulus parameters based on a prescribed algorithm; a storage part for storing the mapping information per neural function; a search part for searching out the position of a target to output an ultrasonic wave and the mapping information corresponding to a neural function to control, based on prescribed search conditions; a coordinate matching part for matching the virtual focus coordinates of the ultrasonic wave with the coordinates of the target to actually receive the ultrasonic wave in a three-dimensional space; and an ultrasonic wave output part for outputting the ultrasonic wave based on the mapping information corresponding to the searched target position, wherein the ultrasonic wave output part includes an ultrasonic wave transmission part consisting of a non-fluid medium in order to transfer the outputted ultrasonic wave to the user. Also, the system is linked with an intention recognition device so as to achieve a wireless brain-brain interface for enabling the mental activity of a person to remotely control the neural functions of another person.

Description

Ultrasound Output System and Method for Processing Brain-brain Interface

The present invention relates to an ultrasonic output system and method for processing nerve function control, and to an ultrasonic output system and method for processing brain-brain interface (BBI) using brain waves and ultrasound.

Previous researches on the neural function can be controlled by conventional invasive or non-invasive methods, but there are many limitations in applying it to the regulation of brain dysfunction and treatment of brain diseases.

First, the conventional drug administration method may have side effects of the drug, and there is a problem that the selective treatment of a specific region is anatomically impossible. And invasive therapies may inevitably be exposed to infection risk by invasion and there is a risk of having to open the skull. Afterwards, some non-invasive neurological therapies have emerged, but there are limitations on the permeability to effectively transmit the energy into the skull and the limitations of spatial resolution.

In such a situation, a non-invasive, high-resolution focused ultrasound sound stimulation technique has emerged, and this technique has been proposed as an alternative to non-invasive and precise control of nerve function. In other words, focused ultrasound cranial nerve stimulation allows spatially accurate transmission of sound wave energy to the target point in mm (for example, in mm), and does not cause thermal or physical damage to cellular tissues by controlling the ultrasonic intensity. Can reversibly regulate brain function. Furthermore, by changing the combination of parameters of the ultrasound used in the treatment it is possible to treat various brain diseases and control the brain function. Accordingly, the above technique may be applied to the peripheral nervous system as well as the central nervous system, and thus may be used to treat various types of neurological diseases.

As such, when the ultrasound is used, various neural functions and cognitive functions may be adjusted, and the corresponding neural function may be adjusted in a desired direction by combining various ultrasound stimulation variables. That is, according to the combination of the ultrasonic stimulation parameters, the nerve function may be enhanced or alleviated. The ultrasonic stimulation parameters for controlling the ultrasonic stimulation are as follows.

1 and 2 are diagrams for explaining the ultrasonic stimulation parameters.

Ultrasonic stimulation parameters that can control ultrasonic stimulation include the central frequency (CF), tone burst duration (TBD), pulse repetition frequency (PRF), duty factor (DF), acoustic intensity (AI), and TST (ultrasound). Total Sonication Time). First, the center frequency of the ultrasonic wave is an intrinsic center frequency of a transducer, which is an ultrasonic wave generator, and is used as an ultrasonic frequency. In this case, the ultrasonic frequency in the range of 400 to 770 KHz is relatively well transmitted through the human skull. Next, as shown in FIG. 1, TBD means unit time of one ultrasonic stimulus in which ultrasonic waves are continuously progressed. The PRF represents the number of times the unit of which the ultrasonic stimulation has been advanced is repeated for one second, and the DF is the percentage of the ultrasonic wave split in the unit time, which is calculated as TBD x PRF. AI refers to the ultrasonic energy applied to the unit area of the site where the ultrasound is split, either 'space-peak pulse-averaged intensity' (Isppa) or 'space-peak time-average intensity (Ispta)'. spatial-peak temporal-averaged Intensity). The concept is shown schematically in FIG. 2. For reference, the relationship between Ispta and Isppa can be expressed as Ispta = Isppa × DF. TST refers to the total time the ultrasound is applied to the site.

Depending on the combination of the ultrasonic stimulation parameters, the type or degree of sensation caused by the nervous system to which the stimulus is transmitted is changed. Therefore, there is a need for an optimal combination of ultrasonic stimulation parameters to control various cognitive or neural functions in a desired direction (strengthening or relaxation) and to a desired degree, or to generate multiple sensations.

In this regard, Korean Patent Publication No. 2010-0004659 (name of the invention: ultrasonic stimulator and ultrasonic stimulation method) outputs a control signal by selecting an output period of ultrasonic waves, a frequency of ultrasonic waves, and a conductor to output ultrasonic waves according to a user signal. Then, a technique for outputting the ultrasonic wave of the output period and the frequency in response to a control signal in water is disclosed.

On the other hand, the conventional research on the way to control the brain-computer interface (Brain-computer Interface) according to the intention (intention) of the human using the EEG signal.

Specifically, a method of analyzing and using parameters according to cognitive properties of EEG has been proposed. EEG analysis can be divided into time axis analysis and frequency axis analysis. As an example of time-base analysis of EEG signals, EEG signals related to stimulus presentation are measured repeatedly, and the unit EEG fragments are aligned based on the time point at which the stimulus is presented, and then the average EEG potential is calculated based on the presentation time point. Accordingly, an event-related potential (ERP), which is a cumulative brain potential that appears at an average value associated with a given stimulus or event, can be calculated. This is based on the principle that only the EEG signals associated with the stimulus are valid at the mean value, and any EEG signals irrelevant to the stimulus are canceled by the mean.

Such components obtained by time-base analysis of EEG include Steady State Visual Evoked Potential (SSVEP), which is a representative EEG component. The steady state visual induced potential (SSVEP) component is an EEG signal using an EEG in response to repetitive visual stimuli. For example, if a person sees a flickering stimulus, the brainwave with the same frequency as the blinking stimulus is physically induced, and the vibrating brainwave with the same frequency as the stimulus is induced by the blinking visual stimulus. Is SSVEP.

In this regard, Korean Patent Laid-Open Publication No. 2013-0002590 (name of the invention: a character input interface device and a character input method of QWERTY type using the steady state visual oil generation level), a character display unit in which a plurality of characters are displayed in QWERTY style, EEG signal measuring unit for measuring the EEG signal of the user during the steady state visual genetic development induced by the visual stimulus due to the displayed character, EEG signal analysis unit for analyzing the measured EEG signal and the analyzed EEG signal A character input interface device including a character output unit for outputting a corresponding character is disclosed.

By the way, such a conventional brain-machine interface device only checks the keys selected by the subject on the keyboard keyboard, and even higher levels of information are associated with the subject without thinking about the actual pupil movement. (That is, information reflecting intention) has a disadvantage of not being able to be confirmed.

In addition, in the past, techniques for processing a brain-computer (or machine) interface or processing a computer (machine) -brain interface have been proposed, but studies on techniques for processing a brain-brain interface (BBI) have been insufficient. It is true. Moreover, computer (brain) -brain interface technology requires a non-invasive and accurate technology due to the risk of invasive methods.

The present invention is to solve the above-described problems of the prior art, an embodiment of the present invention is the mapping (mapping) to the optimal ultrasonic stimulation parameters that can be controlled in each direction of the desired direction and degree (that is, intensity) for each nerve function ) And by providing a non-invasive ultrasonic energy to the corresponding nervous system based on the calculated mapping information, providing an ultrasonic output system and method that can easily and non-invasively control the user's nerve function. The purpose.

In addition, another embodiment of the present invention is to provide an apparatus and method for providing an interface between the brain and the brain using the electroencephalogram and ultrasound, the focused ultrasound with excellent spatial resolution while penetrating the non-invasive skull ) Is applied to a computer-brain interface that can stimulate brain nerves by irradiating ultrasonic energy to a spatially precise (eg mm unit) target point, and a brain-computer interface using an electroencephalogram. The present invention aims to provide a brain-brain interface based on electroencephalogram-ultrasound.

However, the technical problem to be achieved by the embodiment of the present invention is not limited to the technical problem as described above, there may be another technical problem.

As a technical means for achieving the above-described technical problem, the ultrasonic output system for controlling the nerve function according to the first aspect of the present invention, the mapping information for the N ultrasound stimulation parameters for each nerve function based on a predetermined algorithm A calculation unit for calculating a neural function, a storage unit storing the mapping information for each neural function, a retrieval unit for retrieving mapping information corresponding to a target position for outputting ultrasound and a neural function to be controlled based on a preset search condition; A coordinate matching unit for matching the virtual focal coordinates of the ultrasound with the coordinates of the target to which the actual ultrasound is to be administered in a three-dimensional space and an ultrasound output unit for outputting an ultrasound based on mapping information corresponding to the searched target position, wherein the ultrasound output is performed. The blowing unit is a non-flowable medium to deliver the output ultrasound to the user And a transmission portion formed ultrasound.

The ultrasound output method for controlling nerve function according to the second aspect of the present invention may include calculating mapping information on a plurality of ultrasound stimulation variables preset for each nerve function based on a preset algorithm. Storing the neural function by neural function, retrieving mapping information corresponding to a target position for outputting ultrasound and neural function to be controlled based on a preset search condition, and administering the virtual focal coordinates of the ultrasound and the actual ultrasound Matching coordinates of a target to be performed in three-dimensional space and outputting ultrasonic waves onto a non-flowable medium for transmitting ultrasonic waves based on mapping information corresponding to the retrieved target positions.

The ultrasound output system for brain-brain interface according to the third aspect of the present invention includes a shape inference unit for inferring a shape reminiscent of the intention recognition object based on an EEG signal of the intention recognition object; A neural function information storage unit in which a combination of reference shapes and ultrasonic stimulation parameters are stored and stored for each of a plurality of preset brain nerve functions and corresponding nerve parts matched with the brain nerve functions; And detecting the reference shape corresponding to the inferred shape and outputting focused ultrasound based on a combination of the brain nerve function matched with the detected reference shape, a corresponding nerve region, and an ultrasonic stimulation parameter. It includes an ultrasonic output unit.

In addition, the ultrasonic output method for the brain-brain interface through the ultrasonic output device according to the fourth aspect of the present invention, measuring the EEG signal of the intention recognition object; Inferring a shape associated with the intention recognition object based on the EEG signal; Detecting a reference shape corresponding to the inferred shape among reference shapes matched by a plurality of preset brain nerve functions; Detecting a combination of the ultrasonic stimulation parameters matched to the detected reference shape among the preset combinations of the plurality of brain nerve functions and corresponding nerve regions corresponding to the brain nerve functions; And outputting focused ultrasound based on the detected combination of ultrasound stimulation parameters, wherein outputting the focused ultrasound includes irradiating the focused ultrasound to the brain of an ultrasound irradiation target. Output through the non-flowable ultrasonic transmission medium whenever possible.

According to any one of the above-described problem solving means of the present invention, by calculating the optimum ultrasonic stimulation parameter and outputting the ultrasonic wave using the mapping information for this, it is possible to remotely control various cognitive and neural functions in a non-invasive manner. That is, in order to control the cognitive or neural function to a desired direction and to a certain degree, by focusing the ultrasound on the target position and delivering ultrasound energy using a specific combination of ultrasound stimulation variables, the user can control the cognitive and neural function intended. have.

Further, according to any one of the problem solving means of the present invention, it is easy to form a shape reminiscent of the intention recognition object by only the EEG signal measured from the brain of the intention recognition object that observes the stimulus divided into a plurality of frequencies and blinks. There is an effect that can be reconstructed correctly.

In addition, according to any one of the problem solving means of the present invention, it is possible to control and control the specific brain neuron function of the brain neuron control target (ie, ultrasound irradiation target) according to the intended cognitive target, so that the interface between the brain and the brain Has the possible effect.

In addition, according to any one of the problem solving means of the present invention, it is possible to apply a combination of the ultrasound stimulation parameters optimized for each brain nerve function, the direction of intention for various brain cognitive functions and nerve functions (neural excitation or nerve suppression) And there is an effect that can adjust the degree of control. In addition, by irradiating the pulse in the form of ultrasound (pulse) at low intensity (intensity), there is an effect that can reversibly regulate the brain nerve function in a state that does not thermally or physically damage the tissue.

In addition, according to any one of the problem solving means of the present invention, the nerve region of the brain corresponding to each function of the brain is set, the exact brain to the target of the ultrasound irradiation through the brain imaging method such as fMRI (functional magnetic resonance imaging) The position of the magnetic pole on the image can be detected. In addition, by attaching an infrared marker to the ultrasound generator and tracking it through an infrared camera, the focal coordinates of the ultrasound generator can be tracked and understood in a three-dimensional space, and the ultrasound target generated using the ultrasound focal coordinates and the brain image will be used. By aligning the position coordinates with respect to the living body, there is an effect of increasing the output accuracy and precision of the target brain position during ultrasound output.

In addition, according to any one of the problem solving means of the present invention, it is possible to express the mental function of the brain generated as a function of time by converting it into an objective indicator called an EEG signal, and converts the EEG signal into a digital or analog data signal. / Wireless transmission is possible. Furthermore, the information generated in the brain can be received and decoded by a transmitter ('ultrasound output unit' in the embodiment of the present invention) acting on another brain, so that the data according to the mental action of the brain in the future is different. This can be the basis for a shift in action, ultimately enabling 'mental data' transmission.

1 and 2 are diagrams for explaining the ultrasonic stimulation parameters.

3 is a block diagram of an ultrasonic output system according to an exemplary embodiment of the present invention.

4 is a view illustrating an ultrasonic transmitting unit and an ultrasonic output unit.

5 is a diagram illustrating an example in which an ultrasonic output system is applied.

6 is a flowchart illustrating an ultrasonic output method according to an exemplary embodiment of the present invention.

7 is a view for explaining the concept of the brain-brain interface applied to another embodiment of the present invention.

8 is a block diagram illustrating a configuration of an ultrasound output system for a brain-brain interface according to another embodiment of the present invention.

9 is a block diagram illustrating a detailed configuration of a shape inference unit using an EEG according to another embodiment of the present invention.

10 is a view for explaining an example of the associative shape inference method using the control method and the light emitting device arrangement of the light emitting device arrangement according to another embodiment of the present invention.

FIG. 11 is a conceptual diagram illustrating an ultrasound irradiation position for each brain nerve function in another embodiment of the present invention. FIG.

12 is a block diagram illustrating a detailed configuration of an ultrasonic output unit according to another exemplary embodiment of the present invention.

FIG. 13 is a flowchart illustrating an ultrasound output method for a brain-brain interface according to another embodiment of the present invention. FIG.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated. As used throughout this specification, the term "step to" or "step of" does not mean "step for."

3 is a block diagram of an ultrasonic output system 300 according to an embodiment of the present invention.

The ultrasonic output system 300 according to the present invention includes a calculator 310, a storage 320, a searcher 330, a coordinate matching unit 340, and an ultrasonic output unit 350.

For reference, components shown in FIG. 3 according to an embodiment of the present invention mean software components or hardware components such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC), and perform predetermined roles. .

However, 'components' are not meant to be limited to software or hardware, and each component may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors.

Thus, as an example, a component may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, procedures, and subs. Routines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

Components and the functionality provided within those components may be combined into a smaller number of components or further separated into additional components.

The calculator 310 calculates mapping information about N ultrasound stimulation variables for each neural function based on a preset algorithm. In this case, the N ultrasonic stimulation variables include the center frequency (CF) of the ultrasonic waves, the unit time (TBD) applied without stopping the ultrasonic stimulus, the number of repetitions of the ultrasonic stimulation unit per unit time (PRF), and the duty factor (DF) that is a product of the TBD and the PRF. ), The percentage occupied by the ultrasonic time administered in unit time, the ultrasonic energy applied per unit area (AI), and the total administration time (TST) of the ultrasonic stimulus may be used.

For example, the combination of ultrasound stimulation parameters to control specific nerve function is set to CF = 690KHz, TBD = 0.5ms, PRF = 100Hz, Ispta = 130mW / cm2, TST = 180s, so that epilepsy (epilepsy) symptoms are different. If it is optimally relaxed compared to the ultrasonic stimulation parameter combination, such a combination of the ultrasonic stimulation parameters becomes the optimal epilepsy control information.

The mapping information on the optimal ultrasonic stimulation variable may be calculated based on a preset algorithm. In this case, as an example of a preset algorithm, assuming that N ultrasound stimulation variables are assumed to be one axis, a point for optimally adjusting and controlling neural function is found through a function of all axes. At this time, if a specific ultrasonic stimulation variable combination consisting of coordinate values of each dimension in N dimensions has caused an optimal nerve function control phenomenon, the information is the optimal combination stimulation parameter information of the corresponding nerve function control. By calculating this for each nerve function, it is possible to obtain mapping information on the ultrasound stimulation parameters for each nerve function.

As another example, mapping information on the ultrasonic stimulation parameter that causes the optimal tactile sensation may be calculated as follows. When the center frequency is 1MHz and the stimulus exposure time of the ultrasonic waves is 1 second in total, three conditions can be made as follows using the remaining three ultrasonic stimulation variables TBD, PRF, and AI.

First, we can consider three cases where TBD, DF is 30, 50, 70%, and secondly, we can consider three cases where PRF is 10, 100, 1000 Hz. Finally, ultrasonic energy intensity (Isppa) Three cases can be considered: 395, 792, 1500 mW / cm2. As a result of combining each of the three cases, a total of 27 ultrasonic stimulation parameter combinations may be formed. In such a situation, the optimal combination of ultrasonic stimulation parameters can be found as follows.

For example, ultrasonic stimulation is applied to a specific part of the user's body to determine the kind of stimuli that the user feels subjectively (eg, tactile, cold, warm, painful, numb) and the degree of stimulation. It can be calculated from the subjective reporting of the user as a numerical value from 0 to 10. That is, 10 times of measurement is repeated for each condition, and when the same stimulus is repeated more than 5 times, the response is adopted as a reliable response. I can make it.

Through this experiment, it can be seen that when the PRF is 100 Hz, it causes relatively warm sensation compared to the PRF conditions of the other two cases (10, 1000 Hz). By further dividing the steps of the ultrasonic stimulation parameters, a more optimal combination of stimulation parameters can be obtained.

In addition, the optimal combination of the ultrasonic stimulation parameters can be calculated by other methods besides the preset algorithm. For example, by simultaneously measuring electroencephalogram (EEG) at the time of ultrasound stimulation, a 'normal tactile sensation-induced potential detected near the primary somatosensory cortex of the user undergoing ultrasound stimulation ( Steady-state somatosensory evoked potential (SSSEP) 'and the ultrasound stimulus parameters, for example, whether they match the PRF, are inferred and the objective correlation between ultrasound and EEG can be inferred. It can be used as one of the approaches to objectively find the optimal combination of parameters of neural function control.

As such, by using various frequencies, the neural control effect may be systematically mapped by adjusting the time variable of the ultrasound presented in the form of pulse at the corresponding frequency. At the same time, the time difference between the presented ultrasonic pulses is also set as a parameter so that the ultrasonic core stimulation parameters can be systematically adjusted by obtaining a function involved in the neural control function. Accordingly, mapping information about the ultrasonic stimulation variables that cause optimal nerve function control can be obtained.

On the other hand, the ultrasonic stimulation parameters for controlling the nerve function should be calculated in a range in which the safety of the human body is recognized. At this time, the safety of the human body is a concept that includes information that the cells are not necrotic or physically damaged, the damage on the genome (DNA) in the cell nucleus. In addition, biosafety is verified using histological methods. In other words, the H & E staining method can be used to determine whether the tissue has been physically damaged, and the TUNEL staining method can be used to examine whether there is any damage on the DNA.

The storage unit 320 stores mapping information about the ultrasonic stimulation variables calculated by the calculator 310 by dividing each nerve function and the ultrasonic stimulation position. That is, the storage unit 320 separately stores mapping information about the ultrasonic stimulation variables calculated for each neural function for each of the neural function and the ultrasonic stimulation position.

The storage unit 320 may be a nonvolatile memory device such as a cache, a read only memory (ROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), and a flash memory. Alternatively, the present invention may be implemented as at least one of a volatile memory device such as a random access memory (RAM), or a storage medium such as a hard disk drive (HDD) or a CD-ROM.

The searcher 330 searches for mapping information corresponding to a target position for outputting an ultrasound and a nerve function to be controlled based on a preset search condition. In this case, a target position for imparting ultrasonic stimulation as a search condition and a neural function classified according to the target position may be set.

The coordinate matching unit 340 matches the virtual focal coordinates of the ultrasound and the coordinates of the target to which the actual ultrasound is to be administered in a three-dimensional space. That is, the target coordinates and the ultrasonic focus coordinates in the three-dimensional space are matched so that the virtual focus of the ultrasonic waves is matched to the searched target position so that the ultrasonic energy can be concentrated and delivered to the target.

The ultrasound output unit 350 outputs ultrasound based on the mapping information corresponding to the searched target position. The ultrasonic output unit 350 includes an ultrasonic transmission unit 355 formed of a non-flowable or flowable medium to deliver the output ultrasonic waves to the user. The ultrasonic transmission unit 355 will be described with reference to FIG. 4 as follows.

4 is a diagram illustrating the ultrasonic transmission unit 355 and the ultrasonic output unit 350.

The ultrasonic transmission unit 355 allows the ultrasonic energy generated by the ultrasonic output unit 350 to be optimally transmitted. The ultrasonic wave transmission unit 355 is a medium to which ultrasonic waves are delivered, in consideration of the portability side or the rigidity side to be attached to the device, instead of the conventional de-gassed water, the gel or rubber type It can be formed with a non-flowable medium of. However, the non-flowable medium of the ultrasonic transmitting part 355 is not limited thereto, and the ultrasonic transmitting part 355 may be formed using another type of non-flowing medium.

On the other hand, the ultrasonic transmission unit 355 may be formed in a spherical shape. When formed in a spherical shape, the shape of the focused ultrasound transducer may be matched to and closely adhered to the shape of a focused ultrasound transducer, thereby forming a structure capable of receiving and transmitting all of the generated ultrasounds. Thereby, ultrasonic energy can be transmitted to the position made into a target, without disperse | distributing an ultrasonic wave. However, the shape of the ultrasonic transmitting part 355 may be formed in a different shape as well as spherical.

Referring back to FIG. 3, the ultrasound output system 300 according to the present invention may further include a correction unit 360. The correction unit 360 may calculate a standard error of the mapping information based on the deviation according to the user. By correcting the mapping information based on the standard error calculated as described above, the user can use the user by personally performing an initial calibration step for each individual before using the apparatus to which the ultrasound output system 300 is applied.

5 is a diagram illustrating an example in which the ultrasound output system 300 is applied.

By mounting a small ultrasonic output system 300 in a real device can artificially and intentionally deliver a virtual sense to the user. That is, the ultrasonic output system 300 may be mounted on a home appliance remote control, a computer mouse, a smartphone, or a portable device. For example, referring to FIG. 5, an ultrasonic output system 300 may be mounted inside a computer mouse that is generally used. When holding the mouse on the right-handed basis, the spherical ultrasonic transmission part 355 protrudes from the part where the thumb of the mouse touches, and the ultrasonic energy is transmitted to the user. Therefore, during the mouse operation, the user can artificially induce a warm or cold sensation through the ultrasonic stimulation of the tip of the thumb.

As such, by using not only a computer mouse but also various IT devices such as a remote controller and a smart phone, the neural function of the user can be controlled remotely.

6 is a flowchart illustrating an ultrasonic output method according to an exemplary embodiment of the present invention.

First, mapping information about N ultrasound stimulation variables for each neural function is calculated based on a preset algorithm (S610). In this case, the N ultrasound stimulation variables include the center frequency (CF) of the ultrasound, the unit time (TBD) applied without stopping the ultrasound stimulus, the percentage of ultrasound stimuli administered during the unit time, the number of repetitions of the ultrasound stimulation per unit time (PRF), Ultrasonic energy applied per unit area (AI) and total administration time (TST) of ultrasonic stimulation may be used.

Mapping information may be calculated according to a predetermined algorithm using the ultrasonic stimulation variable. In this case, as an example of a preset algorithm, assuming that N ultrasound stimulation variables are assumed to be one axis, a point for optimally adjusting and controlling neural function is found through a function of all axes. At this time, the ultrasonic stimulation variable combination consisting of coordinate values of each dimension in N dimensions becomes the optimal combination stimulation parameter information of the corresponding nerve function control. By calculating this for each nerve function, it is possible to obtain mapping information on the ultrasound stimulation parameters for each nerve function. In addition, mapping information on the ultrasonic stimulation variables may be calculated by various methods, which are omitted in the following description as described in FIG. 3.

Next, the mapping information is classified and stored for each neural function (S620). That is, mapping information about ultrasonic stimulation variables calculated for each neural function is separately stored for each neural function.

Next, the mapping information corresponding to the target position for outputting the ultrasound and the nerve function to be controlled is searched based on a preset search condition (S630). In this case, a target position for imparting ultrasonic stimulation as a search condition and a neural function classified according to the target position may be set.

Next, the virtual focal coordinates of the ultrasound and the coordinates of the target to which the actual ultrasound is to be administered are matched in three-dimensional space (S640). For example, the position of the hippocampus responsible for the memory of the brain can be calculated using MRI to calculate three-dimensional position coordinates in any subject's brain, and based on the MRI three-dimensional image with the skull fixed. It is possible to know exactly the position of. At the same time, if the infrared marker is fixed and attached to the ultrasonic generator, the accurate position in the three-dimensional space of the ultrasonic generator can be tracked through the infrared camera. In addition, when the sum of the focal lengths of the ultrasonic generators already known to the position information is combined, the coordinate values of the ultrasonic focal points in the three-dimensional space can also be confirmed.

As described above, when the coordinate information of the ultrasound focus is matched while viewing the real-time image of the infrared camera with the acquired position information of the hippocampus, the ultrasound focus can be focused on the exact three-dimensional space desired by the user. Accordingly, ultrasonic energy can be concentrated and delivered.

Next, based on the mapping information corresponding to the searched target position, the ultrasonic wave is output on the flowable or non-flowing medium for transmitting the ultrasonic wave (S650). At this time, as an embodiment of the non-flowable medium for transmitting the ultrasonic waves may be formed of a gel or rubber. In addition, the non-flowable medium may be formed into a spherical shape. When using such a type and shape of the medium, it is possible to deliver the ultrasonic waves to the target position without receiving and dispersing the ultrasonic waves to the maximum. Meanwhile, the type and shape of the medium are not limited thereto, and may be formed in various media or shapes capable of optimally delivering ultrasonic energy.

In addition, the ultrasonic output method for controlling neural function according to the present invention comprises the steps of calculating the standard error of the mapping information for the ultrasound stimulation variable based on the deviation according to the user and correcting the mapping information based on the standard error It may further include. By applying such a correction step, it is possible to use the user personally after the initial correction step for each individual before using the device to which the ultrasonic output method is applied.

In the above, it has been described that the nerve function is controlled by outputting ultrasonic energy to be irradiated to various parts of the living body through the ultrasonic output system and method according to the exemplary embodiment of the present invention.

Meanwhile, the ultrasonic output system and method according to another exemplary embodiment of the present invention will be described below with reference to FIGS. 7 to 13. The ultrasonic output system and method according to another embodiment of the present invention, while outputting the ultrasonic energy to be irradiated to a specific portion (ie, brain) of various biological parts, the electroencephalogram (electroencephalography) of another target that is not the target of the ultrasonic energy output The brain-brain interface (BBI) can be processed by outputting ultrasonic energy based on the subject's judgment intention recognized by.

7 is a view for explaining the concept of the brain-brain interface applied to another embodiment of the present invention.

As shown in FIG. 7, the ultrasound output system 100 for a brain-brain interface according to another embodiment of the present invention processes an interface between brains of different objects.

Specifically, as shown in FIG. 7, the ultrasound output system 100 measures an EEG signal from a brain of an intention recognition object and recognizes an intention based on an electroencephalogram (EGE) according to the measured EEG signal. Infer a specific shape associated with the object. In addition, the ultrasound output system 100 detects and detects a combination of optimal ultrasound stimulation variables that will control a specific neural function of another brain (hereinafter referred to as a 'brain of an ultrasound object'), which is matched to the inferred shape. Based on the information, a focused ultrasound is outputted so as to be irradiated to a specific part of the brain of the ultrasound irradiation target. Accordingly, by stimulating a specific part of the brain to be irradiated with ultrasound, the regulation of the nerve function is controlled. In this case, the nerve part corresponding to the specific nerve function among the brain parts of the brain to be irradiated is set as a target nerve part to be irradiated with ultrasound.

As such, the ultrasound output system 100 according to another embodiment of the present invention includes a brain-computer interface (BCI) based on an electroencephalogram and a computer-brain interface (CBI) based on an ultrasound. Process the brain-brain interface (BBI) based on the electroencephalogram-ultrasound fusion.

On the other hand, the ultrasound output system 100 according to another embodiment of the present invention, as shown in Figure 7, not only people (ie, intention recognition object) vs. people (ie, ultrasound irradiation target), but also human-to-animal and animal-to-animal It is possible to interface between brains of various organisms.

Hereinafter, another ultrasonic output system 100 according to another embodiment of the present invention will be described in detail with reference to FIG. 8.

8 is a block diagram illustrating a configuration of an ultrasound output system for a brain-brain interface according to another embodiment of the present invention.

As shown in FIG. 8, the ultrasonic output system 100 according to another exemplary embodiment of the present invention may include a light emitting device arrangement 110, a shape inference unit 120, a neural function information storage unit 130, and an ultrasonic output unit. 140 and the MRI photographing unit 150 is configured.

In the light emitting device array 110, a plurality of light-emitting elements are arranged spaced apart from each other at regular intervals. For reference, intervals in which the plurality of light emitting elements are spaced apart may be psychophysically meaningful intervals, and may be set based on results of experiments in advance. That is, they are arranged to have sufficient visual separation resolution between each light emitting device array.

As shown in FIG. 10 to be described below, the light emitting device arranging unit 110 according to an embodiment of the present invention includes a plurality of light emitting devices arranged in a matrix form, and two or more light emitting devices are disposed at positions where each row and column cross each other. Can be arranged. Accordingly, each row and column may be configured independently of each other without sharing the light emitting elements at the crossing positions, such that the rows and columns may blink (ie, blink) at their own independent frequencies.

At this time, under the control of the light emitting device control module 121 included in the shape inference unit 120 to be described below, the light emitting devices of the light emitting device array 110 are blinked at different frequencies for each arrangement position. The object of recognition is to look at the light emitting device arrangement 110.

For reference, in FIG. 10, the symbols of the light emitting devices RD1 to RD25 and the light emitting devices CD1 to CD25 of the columns are different from each other. However, the light emitting devices of the matrix may be easily distinguished from each other. It may be of the same kind. For reference, in the exemplary embodiment of the present invention, the light emitting device may be a light emitting diode (LED), and may be any one of red, green, and white light emitting diodes.

Meanwhile, in the exemplary embodiment of the present invention, the object to be viewed by the intention recognition object is described as an example of the light emitting element array unit 110 to generate an EEG signal according to the intention. It may also be an output device such as a display. In this case, the pixel line of the output device may be configured to be the same as or similar to the form in which the light emitting elements are arranged in the light emitting element array and a method of controlling the light emitting elements.

8, the shape inference unit 120 infers the shape associated with the intention recognition object based on the EEG signal of the intention recognition object.

Specifically, the configuration and operation of the shape inference unit 120 will be described in detail with reference to FIGS. 9 and 10.

9 is a block diagram illustrating a detailed configuration of a shape inference unit according to another exemplary embodiment of the present invention. 10 is a view for explaining an example of an associative shape inference method using a control method and a light emitting device arrangement of a light emitting device arrangement according to another embodiment of the present invention.

First, as shown in FIG. 9, the shape inference unit 120 includes a light emitting device control module 121, an EEG measurement module 122, and a shape analysis module 123.

The light emitting device control module 121 controls the plurality of light emitting devices arranged in the light emitting device array unit 110 to blink at different frequencies for each array position. In addition, the light emitting device control module 121 may control various blinking operation conditions such as the total time of blinking, the brightness of blinking, and the selection of the light emitting device to be blinked.

In this case, the light emitting device control module 121 may classify the light emitting devices of the light emitting device array unit 110 into a plurality of groups, and control the light emitting devices to blink according to differently set frequencies for each group. For reference, the light emitting device control module 121 may reduce eye fatigue by setting the light emitting devices to be watched by the intention recognition object at high frequency.

In detail, the light emitting device control module 121 divides and groups a plurality of light emitting devices into a plurality of preset array position ranges, and includes one row or all of the light emitting devices arranged in a matrix form as shown in FIG. A plurality of light emitting elements arranged on the arrangement position of the columns can be grouped into one group.

The light emitting device control module 121 may set different frequencies for each of the plurality of groups, and control the light emitting devices in each group to flash at the same frequency. For example, in FIG. 10, 35 Hz, 15 Hz, 5 Hz, 25 Hz, and 45 Hz are set in five rows of the light emitting element array 110, and 49 Hz, 28 Hz, 7 Hz, 21 Hz, and 14 Hz are set in five columns, respectively. It was.

The light emitting device control module 121 may set a bandwidth difference between frequencies for each row or column so that the difference is greater than or equal to a preset threshold. In addition, the light emitting device control module 121 may allocate a frequency to each row and column such that the frequency sum between two or more rows and / or columns is different from the frequency sum between two or more rows and / or columns.

This is to increase the resolution and reliability of the measured value when detecting the frequency from the EEG signal of the intention recognition object measured through the EEG measurement module 122 which will be described later. In addition, in the EEG signal detected through the Steady State Visual Evoked Potential (SSVEP) measured by the EEG measurement module 122, a combination component of a blinking frequency between a specific row and a column is also detected. This is for ease of use.

For example, referring to FIG. 10 (b), when the intention recognition object gazes at the light emitting element array unit 110 in which all the matrices are blinking at their own frequencies while reminiscent of the letter “T”, detection is performed. The expected SSVEP is 7 Hz (column), 35 Hz (row), and 42 Hz which is the sum of the two frequencies. In comparison, when the intention recognition object gazes at the blinking light emitting element array, reminiscent of the character “+”, the expected SSVEP is 7 Hz (column), 5 Hz (row), and 12 Hz, which is the sum of the two frequencies. . As such, the frequencies can be set in each row and column such that the sum of the frequencies corresponding to the different shapes (ie, 42 Hz and 12 Hz described above) are different from each other.

On the other hand, in the ultrasonic output system 100 according to an embodiment of the present invention, the light emitting device arrangement 110 of FIG. 8 and the light emitting device control module 121 of FIG. 9 have been described in a separate configuration, yet another For example, the light emitting device arranging unit 110 and the light emitting device control module 121 may be combined and implemented in one configuration. In this case, the combined light emitting device arrangement 110 and the light emitting device control module 121 are connected to the EEG measurement module 122 and the shape analysis module 123 which will be described below to control the frequency information and the light emitting device set for each light emitting device. Information (e.g., information such as start and end of flashing control) can be provided.

The EEG measurement module 122 measures an EEG signal of an intention recognition object that looks at the light emitting device arrangement 110. For reference, the EEG measurement module 122 may be connected to the EEG measurement device (not shown) to control to measure the EEG signal, EEG measurement module of the configuration of the ultrasonic output system 100 according to an embodiment of the present invention At least one configuration, including 122, may be included as a configuration in the EEG measurement device. For example, in an embodiment of the present invention, a brain wave measuring device (not shown), such as a headset or a band type, which measures brain waves in a noninvasive manner may be applied for safety and convenience of an intention recognition object.

In this case, the EEG measurement module 122 may measure the EEG signal in various ways. In an embodiment of the present invention, physically induced in the visual cortex of the occipital lobe in accordance with the cognitive attention of the intended recognition object staring at the blinking light emitting device array 110. Steady state visually induced potential (SSVEP) can be measured.

The shape analysis module 123 detects at least one frequency included in the measured EEG signal, and has a shape reminiscent of an intention recognition object based on an arrangement of light emitting devices that blink at a frequency corresponding to the detected at least one frequency. Infer

Specifically, when the intention recognition object associates a specific shape (letters, numbers, symbols, etc.) according to the intention in the state of looking at the light emitting element of the light emitting element array unit 110, the shape in which the intention recognition object is associated with A frequency equal to the frequency at which the light emitting element on the light emitting element array unit 110 is blinking is detected in the EEG signal.

In this case, the frequency of the EEG signal detected by the shape analysis module 123 reflects the blinking frequency of the corresponding group of light emitting devices matching the shape (eg, geometry) of the specific shape intended by the subject. . That is, the frequency of the group of the group on the light emitting element array unit 110 corresponding to the shape association of the intended recognition object and the frequency of the corresponding group is detected.

For example, the shape analysis module 123 may select an accurate frequency based on a frequency that perfectly matches the frequency of each group set by the light emitting device control module 121 and its resonance frequency among the detected frequencies. . In addition, when the similarity frequency around the detected frequency is included, the shape analysis module 123 refers to a frequency related to the intention of the intention recognition target among the frequencies set on the light emitting element array unit 110 and the sum of the frequencies. The correct frequency can be selected.

Then, the shape analysis module 123 detects a group set to a frequency corresponding to the at least one detected frequency among the plurality of groups on the light emitting element array unit 110. In addition, the shape analysis module 123 infers a shape reminiscent of the intention recognition object based on the shape of the detected group of light emitting elements.

In this case, when two or more frequencies are detected from the measured EEG signal, the shape analysis module 123 recognizes the intention by combining the arrangement forms of the light emitting devices for each group of the light emitting device arrays 110 corresponding to the detected two or more frequencies. Infer the shape of the object.

For example, when the intention recognition object is associated with the letter “T”, as shown in FIG. 10B, the shape analysis module 123 of the letter “T” in the row and column on the light emitting device array 110 may be used. A frequency of 35 Hz and 7 Hz corresponding to the shape and 42 Hz of 35 Hz and 7 Hz can be detected.

In this case, the shape analysis module 123 determines the rows and columns on the light emitting element array 110 corresponding to 35 Hz, 7 Hz, and 42 Hz detected from the EEG signal, and according to the arrangement form of the light emitting elements corresponding to the determined rows and columns. Determine by inferring the shape (that is, the shape corresponding to the letter “T”).

The shape analysis module 123 may calculate the similarity between the plurality of previously stored reference shapes and the shape by the detected group, and infer the shape having the highest similarity as the shape reminiscent of the intention recognition object. In this case, the shape analysis module 123 may include a reference shape including various types of shapes such as letters (letters), numbers, and symbols in advance, and a group of light emitting device groups on the light emitting device arrangement 110 corresponding to each reference shape. The information can be matched and stored.

On the other hand, it has been described above that the shape analysis module 123 infers the shape calculated by the intention recognition object based on the frequency detected from the EEG signal and the sum of the corresponding frequencies. In addition, the shape analysis module 123 may decode the detected EEG signal through a predetermined method such as pattern recognition statistics and machine learning. have.

8, the nerve function information storage unit 130 matches and stores a combination of reference shapes and ultrasonic stimulation parameters for each of a plurality of predetermined brain nerve functions and nerve parts corresponding to each brain nerve function. In this case, the combination of the ultrasonic stimulation parameters is a combination that can optimally control the brain nerve function, the calculator 310, the storage 320, the searcher 330 described with reference to FIGS. And the same or similar method as that of the operation of at least one configuration of the corrector 360, or may be set through experiments in advance.

Specifically, each portion of the nerve portion of the brain of the ultrasound irradiation target that is responsible for a specific nerve function (or cognitive function, etc.) is set, the reference shape that can determine the degree of division and control of each brain nerve function, and the brain A combination of ultrasound stimulation parameters that can control the output of ultrasound suitable for regulation of neural function is matched. For reference, as an area to be irradiated with ultrasound, both the central nervous system including the brain and the nervous system including the peripheral nervous system may be included.

Specifically, FIG. 11 is a conceptual diagram for explaining an ultrasound irradiation position for each brain nerve function in another embodiment of the present invention.

For example, as shown in FIG. 11, the Broca region is responsible for the generation of language, the Wernicke region is responsible for understanding the language, and the frontal lobe among the various parts of the brain. It is responsible for decision making, the hippocampus is responsible for learning and memory, and the amygdala is responsible for emotion control. In addition, various sites such as extensive brain neural networks for attention concentration and suprachiasmatic nucleus for the biological clock can be preset. For reference, the nerve function region of the brain may be set as a position coordinate value in the three-dimensional space.

Accordingly, when irradiating a specific part of the brain to be focused on the ultrasound through the ultrasound output unit 140 to be described with reference to FIG. 8, a change in nerve function (or cognitive function, etc.) related to the part occurs.

Meanwhile, the neural function information storage unit 130 may store a combination of two or more ultrasonic stimulation parameters according to any one brain neural function, and accordingly, one brain neural function is different for each combination of the ultrasonic stimulation parameters. Can be controlled.

For reference, the ultrasonic stimulation parameter may include an ultrasonic center frequency for focused ultrasound output through the ultrasonic output unit 140 to be described below, a unit time for which the ultrasonic stimulation proceeds without interruption, and an ultrasonic stimulation unit (for example, pulse ') at least one of the number of repetitions per unit time (eg, 1 second), the percentage of ultrasonic time administered in the unit time, the ultrasonic intensity per unit area of ultrasonic irradiation, and the total ultrasonic irradiation time. At this time, the combination of parameters such as the intensity, frequency, and time of the focused ultrasound to be irradiated to the brain can be set to an optimal combination that can control the brain nerve function according to the purpose without damaging the biological tissue of the brain. have.

By adjusting the ultrasonic stimulation parameters, the nerve function may be enhanced or weakened.

For example, after selecting a specific brain neuron function, irradiation with ultrasound according to a combination of specific ultrasound stimulation parameters may improve learning ability, or use ultrasound for a combination of different ultrasound stimulation parameters for the same brain region. Doing so can weaken your learning skills. As such, cognitive or neural function can be controlled by controlling to a certain degree as desired.

In addition, it is possible to stimulate the central nervous system function of the brain so that the subjects of the ultrasound can feel tactile sensation, proprioception, thermal sensation, pain perception, sensation of movement, etc. By stimulating the specific nerve function of the brain, it is also possible to control motor skills through peripheral nerve control.

8, the ultrasound output unit 140 obtains the shape inferred by the shape inference unit 120 and corresponds to the inferred shape by referring to the plurality of reference shapes stored in the neural function information storage unit 130. Detected reference shape. In addition, the ultrasound output unit 140 refers to the combination of the ultrasound stimulation parameters for each reference shape stored in the nerve function information storage unit 130, and combines the brain nerve function and the ultrasound stimulation parameters matched to the detected reference shape. Is detected.

Thereafter, the ultrasound output unit 140 performs a matching process between the ultrasound focus and the target (that is, the target region to which the ultrasound is to be irradiated) coordinates in the 3D space. In addition, the ultrasound output unit 140 applies the result of the matching process so that focused ultrasound according to the combination of the detected ultrasound stimulation parameters is irradiated to the brain of the ultrasound irradiation target non-invasively. Output

On the other hand, the ultrasound output system 100 according to another embodiment of the present invention, the brain-machine (or computer) interface device based on the electroencephalography and the machine (or computer) -brain interface device based on the ultrasound can be configured The two interface devices may further include a wireless transmitter / receiver (not shown) for transmitting and receiving information wirelessly with each other.

Specifically, the electroencephalogram-based brain-machine (or computer) interface device in the ultrasound output system 100 according to another embodiment of the present invention, through the wireless communication to the information of the associative shape inferred through the shape inference unit 120 The apparatus may further include a wireless transmitter (not shown) for transmitting to the ultrasonic output unit 140. In addition, the ultrasound-based machine (or computer) -brain interface device in the ultrasound output system 100 according to another embodiment of the present invention, wirelessly receives the information of the associative shape from the wireless transmitter and transmits it to the ultrasound output unit 140. The apparatus may further include a wireless receiver (not shown). That is, in the ultrasonic output system 100 illustrated in FIG. 8, a wireless transmission / reception unit (not shown) may be further configured between the shape inference unit 120 and the ultrasonic output unit 140.

As such, the ultrasound output system 100 according to another embodiment of the present invention may wirelessly measure the brain waves of the intended recognition target, thereby greatly increasing the portability of the ultrasound output system 100 itself. In addition, the ultrasound output system 100 can quickly analyze the EEG information in real time and can be used for ongoing brain-machine (or computer) interface processing.

Hereinafter, the configuration and operation of the ultrasonic output unit according to the exemplary embodiment of the present invention will be described in detail with reference to FIG. 12.

12 is a block diagram illustrating a detailed configuration of an ultrasonic output unit according to another exemplary embodiment of the present invention.

As shown in FIG. 12, the ultrasound output unit 140 includes a brain position coordinate storage module 141, a 3D position tracking module 142, a position coordinate matching module 143, and an ultrasound output control module 144. It is configured by.

The brain position coordinate storage module 141 generates three-dimensional position coordinates by using a brain image obtained by photographing a magnetic resonance image of a brain of an ultrasound irradiation target, and stores a predetermined position on the brain for each of a plurality of brain nerve functions. The generated three-dimensional position coordinates are matched and stored. For reference, in order to accurately track and access 3D coordinates, the brain (ie, the brain of an ultrasound irradiation target) may be fixed and MRI or ultrasound focal coordinates may be set.

At this time, as shown in FIG. 8, in one embodiment of the present invention, the ultrasound output system 100 may include an MRI photographing unit 150 for MRI imaging a brain of an ultrasound irradiation target, and stores brain position coordinates. The module 141 may obtain a brain image from the MRI photographing unit 150. Meanwhile, in the exemplary embodiment of the present invention, the MRI photographing unit 150 may be configured as an ultrasound output system 100 and an external device, and the MRI photographing unit 150 and the brain position coordinate storage module 141 interoperate with each other. It is also possible to obtain a brain image from the MRI imaging unit 150.

12, the three-dimensional position tracking module 142 tracks coordinate values in three-dimensional space with respect to the focal point of the ultrasonic wave to be output from the ultrasonic transducer (not shown). That is, a virtual coordinate value for the ultrasound focus to be radiated on the 3D space of the ultrasound irradiation target brain is calculated. By using the virtual coordinate values of the ultrasound focal point to track and confirm the position to which the ultrasound is to be irradiated, the ultrasound may be accurately irradiated to a specific position set among the regions of the ultrasound irradiation target brain.

For example, the ultrasonic output system 100 uses an infrared marker (not shown) and an integrated infrared tracking camera (not shown) fixedly installed to a holder portion (not shown) that supports the ultrasonic generator. The ultrasound generator may calculate a virtual coordinate value on the three-dimensional space with respect to the ultrasound focus to be output. For reference, the ultrasonic generator is a device for generating ultrasonic waves under the control of the ultrasonic output control module 144, which will be described later, and the infrared tracking camera is a position coordinate on the three-dimensional space of the infrared marker (that is, the position coordinate of the ultrasonic generator). Provide tracking. In addition, at least one configuration of the ultrasonic generator and the infrared tracking camera may be integrally included in the ultrasonic output system 100, or may be separately included and interlocked with the ultrasonic output system 100.

In detail, the 3D location tracking module 142 obtains a location coordinate on the 3D space of the infrared marker provided from the infrared tracking camera, and uses the location coordinate of the infrared marker and the relative distance information from the infrared marker to the ultrasound focus. The virtual coordinate value on the three-dimensional space of the focal point is calculated. For reference, the focal length of the focused ultrasound to be output by the ultrasound generator is set in advance.

The position coordinate matching module 143 calculates output coordinates on the three-dimensional space of the ultrasound by aligning the three-dimensional position coordinates of the ultrasound irradiation target brain generated using the brain image and the virtual coordinates of the ultrasound focus. do. Accordingly, as the ultrasonic output position of the ultrasonic generator moves, the virtual position where the ultrasonic wave is to be output on the three-dimensional space inside the head of the ultrasonic irradiation target is interlocked and tracked in real time.

The ultrasonic output control module 144 detects the brain nerve function to be controlled based on the shape inferred by the shape inference unit 120 of FIG. 8, and uses the brain image to generate three-dimensional position coordinates for each nerve region. The 3D position coordinates of the corresponding nerve region according to the detected brain nerve function are detected.

When the output coordinates of the ultrasound focus calculated in real time correspond to the detected three-dimensional position coordinates of the corresponding nerve region, the ultrasound output control module 144 sets the output coordinates of the ultrasound focus as target coordinates. Thereafter, the ultrasound output control module 144 controls the focused ultrasound to be output based on a combination of the ultrasound stimulation parameters matched to the detected brain nerve function at the position of the brain on the set target coordinate.

For reference, the virtual coordinate value calculation method and the ultrasonic output method in the three-dimensional space with respect to the ultrasound focus of the ultrasonic output system 100 described above are the coordinate matching unit 340 and the ultrasonic output unit described with reference to FIGS. The configuration and operation of 350 may be set in the same or similar manner.

In addition, in the embodiment of the present invention, the ultrasonic output unit 140 outputs focused ultrasound through an ultrasonic generator (not shown), but the non-flowable ultrasonic transmission medium (for example, gel type) at the output terminal of the ultrasonic generator. And special rubber materials). Through such a non-flowable medium, the output focused ultrasound may be delivered to a contact portion (surface) of an ultrasound irradiation target. Accordingly, the ultrasonic energy can be transmitted deeply in the brain nerve region non-invasively. For reference, 'degassed water' may be used as a medium for ultrasonic energy transfer, but a non-flowable ultrasonic medium may be used because a fluid is not suitable for a portable ultrasonic generator.

Hereinafter, an ultrasonic output method for a brain-brain interface according to an embodiment of the present invention will be described in detail with reference to FIG. 13.

FIG. 13 is a flowchart illustrating an ultrasound output method for a brain-brain interface according to another embodiment of the present invention. FIG.

First, an EEG signal of an intention recognition object is measured (S710).

At this time, before the step S710, the plurality of light emitting elements arranged in the light emitting element array unit 110 is controlled to blink at different frequencies for each arrangement position, and whether the intention is to watch the light emitting element array unit 110. Measure the EEG signal of the subject. Accordingly, the steady state visual induced potential SSVEP reflecting the attentional shape according to the intention of the intention recognition object may be measured.

Next, on the basis of the measured EEG signal to infer the shape associated with the intention recognition object (S720).

Specifically, at least one frequency included in the measured EEG signal is detected, and a shape reminiscent of the intention recognition object is inferred based on an arrangement form of the light emitting device which blinks at a frequency corresponding to the detected at least one frequency. In this case, the degree of similarity between any one of the predetermined reference shapes and the shape based on the arrangement of the light emitting elements may be calculated, and the shape having the highest similarity may be inferred as the shape reminiscent of the intention recognition object.

Thereafter, a reference shape corresponding to the inferred shape is detected among reference shapes matched for each of a plurality of preset brain nerve functions (S730).

Then, a combination of the type of controlled brain nerve function matched with the detected reference shape, three-dimensional position coordinate information of the corresponding nerve region, and the ultrasound parameter matched as an optimal control condition of the nerve function is detected (S740).

In this case, the ultrasonic parameters include the ultrasonic center frequency, the minimum unit time for which the ultrasonic stimulus is maintained without interruption, the number of repetitions per unit time of the ultrasonic stimulation unit, the percentage of the ultrasonic time irradiated in the unit time, the ultrasonic intensity per unit area of the ultrasonic irradiation, and At least one of the total ultrasound irradiation time. In addition, before the step (S740), a combination of two or more ultrasonic stimulation parameters may be matched and stored for each brain neuron function, and the brain neuron function may be differently controlled and controlled according to the combination of the ultrasonic parameters. .

Thereafter, the focused ultrasound is output based on the detected combination of ultrasound parameters, and the focused ultrasound is output so as to irradiate the brain of the ultrasound irradiation target non-invasively (S750).

Specifically, step S750 may be processed by performing the following steps.

First, three-dimensional position coordinates are generated by using a brain image obtained by MRI of a brain of an ultrasound irradiation target, and positions (ie, nerve regions) preset in the brain for each of a plurality of brain nerve functions and the generated three-dimensional position coordinates are obtained. Matches.

Then, the position coordinate information on the three-dimensional space of the infrared marker attached to the ultrasonic generator is obtained from the linked infrared tracking camera.

The virtual position coordinate value on the three-dimensional space of the ultrasonic focus is calculated using the position information of the infrared marker and the relative distance information of the ultrasonic focus from the infrared marker.

Then, by aligning the three-dimensional position coordinates of the neural region of each brain nerve function generated by using the brain image and the virtual position coordinates of the ultrasound focus (ie the brain of the ultrasound irradiation target) Calculate the phase output coordinates.

Next, the target brain nerve function is detected based on the reference shape corresponding to the inference shape detected in step S730, and the three-dimensional position coordinates of the brain nerve region matched with the target brain nerve function are detected.

Then, when the calculated output coordinates of the ultrasound focal point correspond to the detected three-dimensional position coordinates of the brain nerve region, ultrasound irradiation is performed by outputting focused ultrasound according to a combination of ultrasound stimulation parameters matched to a desired brain nerve function. Allow non-invasive irradiation of the subject's brain.

Embodiments of the invention may also be implemented in the form of a recording medium containing instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims (22)

1. In the ultrasonic output system,

   A calculator configured to calculate mapping information of N ultrasound stimulation variables for each neural function based on a preset algorithm;

   A storage unit storing the mapping information by dividing each nerve function;

   A search unit for searching for mapping information corresponding to a target position for outputting an ultrasound and a nerve function to be controlled based on a preset search condition;

   A coordinate matching unit for matching the virtual focal coordinates of the ultrasonic waves with the coordinates of the target to which the actual ultrasonic waves are to be administered in three-dimensional space;

   And an ultrasonic output unit configured to output ultrasonic waves based on the mapping information corresponding to the searched target position.

   The ultrasonic output unit includes an ultrasonic transmission unit formed of a medium for transmitting the output ultrasonic waves to the user.
2. The method of claim 1,

   The ultrasonic stimulation parameters include the center frequency of ultrasonic waves, the unit time applied without interruption of the ultrasonic stimulus, the percentage of ultrasonic stimuli administered during the unit time, the number of repetitions of ultrasonic stimuli per unit time, the intensity of ultrasonic energy applied per unit area, and the total of ultrasonic stimuli. Ultrasound output system which is the time of administration.
3. The method of claim 1,

   And the medium of the ultrasonic transmitting part is gel or rubber.
4. The method of claim 1,

   The ultrasonic wave transmission system is formed in a sphere.
5. The method of claim 1,

   And a correction unit configured to calculate a standard error of the mapping information based on the deviation of each user, and to correct the mapping information based on the standard error.
6. The method of claim 1,

   The search condition is an ultrasound output system that is a neural function divided according to the target position and the target position.
7. In the ultrasonic output method through the ultrasonic output system,

   Calculating mapping information for a plurality of ultrasound stimulation variables preset for each nerve function based on a preset algorithm;

   Storing the mapping information for each neural function and storing the mapping information;

   Searching for mapping information corresponding to a target position for outputting an ultrasound and a nerve function to be controlled based on a preset search condition;

   Matching the virtual focal coordinates of the ultrasound with the coordinates of the target to which the actual ultrasound is to be administered in three-dimensional space; and

   And outputting ultrasonic waves onto a medium that transmits ultrasonic waves based on the mapping information corresponding to the retrieved target positions.
8. The method of claim 7, wherein

   The ultrasonic stimulation parameters include the center frequency of ultrasonic waves, the unit time applied without interruption of the ultrasonic stimulus, the percentage of ultrasonic stimulation time administered during the unit time, the number of repetitions of ultrasonic stimuli per unit time, the intensity of ultrasonic energy applied per unit area, and the Ultrasound output method which is the total administration time.
9. The method of claim 7, wherein

   Calculating a standard error of the mapping information based on the deviation of each user; and

   And correcting the mapping information based on the standard error.
10. The method of claim 7, wherein

    Ultrasound output method is a medium that transmits the ultrasonic wave is formed in a spherical shape.
11. In the ultrasonic output system for processing the brain-brain interface,

    A shape inference unit that infers a shape reminiscent of the intention recognition object based on an EEG signal of the intention recognition object;

    A neural function information storage unit in which a combination of reference shapes and ultrasonic stimulation parameters are stored and stored for each of a plurality of preset brain nerve functions and corresponding nerve parts matched with the brain nerve functions; And

    An ultrasonic wave that detects the reference shape corresponding to the inferred shape and outputs focused ultrasound based on a combination of the brain nerve function matched with the detected reference shape, a corresponding nerve region, and an ultrasonic stimulation parameter Including an output,

    The ultrasonic output unit,

    Ultrasonic output system for outputting through the ultrasonic transmission medium so that the focused ultrasound is irradiated to the brain of the ultrasound irradiation target.
12. The method of claim 11,

    The ultrasonic output unit,

    Generating a three-dimensional position coordinates using a brain image of the brain of the ultrasound irradiation target magnetic resonance image (Magnetic Resonance Image), and the position and the three-dimensional position of the corresponding nerve region predetermined for each of the plurality of brain nerve functions Brain position coordinate storage module for matching and storing the coordinates;

    Acquiring an ultrasound output position coordinate that tracks the position of the infrared marker attached to the ultrasound generator for outputting the focused ultrasound from the linked infrared camera, and based on the ultrasound output position coordinates and the output distance of the preset focused ultrasound A three-dimensional position tracking module for calculating virtual coordinates in three-dimensional space with respect to the focal point of the ultrasonic wave;

    A position coordinate matching module configured to calculate an output coordinate for the focus of the focused ultrasound by aligning a three-dimensional position coordinate generated using the brain image with a virtual coordinate for the focus of the focused ultrasound; And

    Detecting the three-dimensional position coordinate corresponding to the brain nerve function matched to the detected reference shape, and if the output coordinate corresponds to the detected three-dimensional position coordinate, the ultrasonic stimulation parameter matched to the detected brain nerve function And an ultrasonic output control module for controlling to output the focused ultrasonic waves according to a combination of the two.
13. The method of claim 11,

    The shape inference unit,

    A light emitting element control module configured to control a plurality of light emitting elements arranged in the light emitting element array unit to blink at different frequencies for each array position;

    An EEG measuring module for measuring an EEG signal of an intention recognition object that observes the light emitting device array; And

    Detecting at least one frequency included in the measured EEG signal, and inferring a shape reminiscent of the intention recognition object based on an arrangement of the light emitting devices that blink at a frequency corresponding to the detected at least one frequency. Ultrasonic output system comprising a shape analysis module.
14. The method of claim 13,

    The shape analysis module,

    And calculating a similarity between any one of the reference shapes and a shape based on the arrangement of the light emitting elements, and infers the shape having the highest similarity into a shape reminiscent of the intention recognition object.
15. The method of claim 11,

    The nerve function information storage unit,

    A combination of two or more ultrasonic stimulation parameters is matched for any one of the brain neuron functions,

    And one brain neuron function differently controlled for each combination of the ultrasonic stimulation parameters.
16. The method of claim 11,

    The shape inference unit,

    And a steady state visual induced potential (SSVEP) of the intended recognition object, and inferring the shape based on the steady state visual induced potential.
17. In the ultrasonic output method for processing the brain-brain interface through the ultrasonic output system,

    Measuring an EEG signal of the intention recognition object;

    Inferring a shape associated with the intention recognition object based on the EEG signal;

    Detecting a reference shape corresponding to the inferred shape among reference shapes matched by a plurality of preset brain nerve functions;

    Detecting a combination of the ultrasonic stimulation parameters matched to the detected reference shape among the preset combinations of the plurality of brain nerve functions and corresponding nerve regions corresponding to the brain nerve functions; And

    Outputting focused ultrasound based on the detected combination of ultrasonic stimulation parameters,

    Outputting the focused ultrasound,

    And outputting the focused ultrasound through an ultrasound transmission medium to irradiate the brain of an ultrasound irradiation target.
18. The method of claim 17,

    Before measuring the EEG signal of the intention recognition object,

    The method may further include controlling the plurality of light emitting elements arranged in the light emitting element array to blink at different frequencies for each arrangement position.

    Measuring the brain wave signal of the intention recognition object,

    Ultrasonic output method for measuring the EEG signal of the intention recognition object looking at the light emitting element array.
19. The method of claim 17,

    Inferring the shape reminiscent of the intention recognition object,

    Detecting at least one frequency included in the measured EEG signal, and inferring a shape reminiscent of the intention recognition object based on an arrangement of the light emitting devices that blink at a frequency corresponding to the detected at least one frequency. Ultrasonic output method.
20. The method of claim 19,

    Inferring the shape reminiscent of the intention recognition object,

    And calculating a similarity between any one of the reference shapes and a shape based on the arrangement of the light emitting elements, and inferring the shape having the highest similarity into a shape reminiscent of the intention recognition object.
21. The method of claim 17,

    Prior to the step of detecting a combination of ultrasonic stimulation parameters matched to the detected reference shape,

    The method may further include matching and storing a combination of two or more ultrasonic stimulation parameters for each one of the brain nerve functions.

    And one brain nerve function are controlled differently for each combination of the ultrasonic stimulation parameters.
22. The method of claim 17,

    Between the step of inferring the shape associated with the intention recognition object and the step of detecting the reference shape corresponding to the inferred shape,

    And wirelessly receiving information about the inferred shape by the computer-brain interface device detecting the reference shape from the brain-computer interface device processing the inference of the shape reminiscent of the intention recognition object. .

Images