JP2003173375A - Life management terminal device, life management method and life management system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a life management system capable of performing the delicate life management of a user without applying a load to the user by detecting the meal start of the user even if the user is not aware of it oneself. <P>SOLUTION: In this life management terminal device for detecting that the user takes a meal on the basis of the information measured from the user, when it is detected that the user starts to take the meal or ends the meal, the user is inquired for the meal content after a prescribed time from the detection, and the answer is acquired and analyzed, whereby the meal content of the user is returned to a manager, so that a delicate life management can be performed. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a home care person management system for performing health care and treatment of diseases of home care persons having a risk of lifestyle-related diseases via a network, and a service method using the same. In particular, it relates to life management systems and services.

[0002]

2. Description of the Related Art Heart diseases such as myocardial infarction and cerebrovascular diseases such as cerebral infarction, which are the main causes of death in modern times, are called lifestyle-related diseases, and most of them are hypertension, diabetes, dyslipidemia, obesity, smoking, etc. It is caused by arteriosclerosis caused by. If a high-risk condition such as high blood pressure, diabetes, or abnormal lipid metabolism is diagnosed by a physical examination, no particular symptoms will occur.Therefore, we will measure and prescribe biological information such as blood glucose at the frequency and time instructed during our daily lives. Often, he / she manages daily life such as taking medications, exercising as directed, and eating. Lifestyle management is the most important treatment for lifestyle-related diseases. However, in reality, busyness and negligence in daily life often exacerbate the symptoms due to inability to manage this sufficiently.

With respect to exercise management, pedometers have been sold by various companies for some time, and by using this, some management can be realized without the user having to be aware of it.
However, as for life management, since it is based on self-management and management service based on self-input, the current situation is that it is not sufficiently managed.

[0004] Before now, there have already been provided systems and services for health management by placing a health management terminal at the patient's home. For example, Secom Co., Ltd. mediaData (registered trademark), Nasa Corporation Co., Ltd. "U la la"
(Registered trademark) corresponds to this. This terminal has a sensor for measuring vital signs of a patient's body temperature, pulse, blood pressure, blood sugar, etc., and transmits data measured using these to a contract doctor via a network. It also has a touch panel screen and a simple inquiry menu is displayed. Input "Yes" and "No" to this and send these data to the doctor as well. The doctor diagnoses the sent data and gives life guidance. In these systems, there is no life management menu, and it is easy to check the appetite in the interview.

There are also several diabetes management services. For example, in the “e-SMBG (registered trademark)” service of Arkray Co., Ltd., a mobile phone (i-mode) and a portable blood glucose sensor are combined,
It is a system that can measure your blood glucose level and send it to the management service at any time even when you are out.

[0006] As a system for managing life, there is a system in which a meal input function is added to a portable pedometer so that health management for both exercise and meal can be performed. However, since the input is self-managed, I often forget the input, especially when I am out. In addition, it is a format to input the eaten menu, and there is a case where there is no corresponding menu correctly, or there is no structure that allows you to enter and manage the details such as garnishing, etc. Absent. On the other hand, at present, there are many hundreds of menus, and it is possible to enter additives such as sauces and dressings.
On the contrary, it is very complicated to select and input this one by one. Currently, input is made in a hierarchical structure of three layers, but since it is not known which menu belongs to which category, if you can not follow the category, go back to the upper layer and select another category. Since the work such as, is repeated, the complexity is promoted.

[0007] As another approach, a service for controlling the contents of a meal is also provided by a meal delivery service. However, this is effective for patients who only eat at home such as home care patients, but when eating out, such as when managing while working, the management of eating out becomes incomplete.

A device for measuring and managing the number of mastications in relation to meals is disclosed in Japanese Patent Laid-Open No. 11-318862,
JP-A-11-206740, JP-A-11-123
No. 185 gazette discloses that earphone type pressure sensor measures pressure change in the ear canal associated with mastication, displacement of human body surface caused by mastication is measured by pressure sensor and potentiometer, and voice during mastication is earphone. Various mastication measurement methods such as those measured with a microphone have been considered. However, all of these measures and manages the number of times of mastication, and it has not been possible to manage the content of meals using them.

[0009]

Although the management of meal contents is a very important factor in health management as described above, it is necessary for the user to manage the contents of a lifestyle-related disease. There is no other way than management such as those who frequently record meal content, and the work is very complicated, and as a result, life management is not sufficiently managed. In order for not only medical treatment persons but also healthy persons who are at high risk of lifestyle-related diseases to manage their meal contents in their daily lives, the user needs to be able to record and manage their meal contents unconsciously.

In order to solve the above problems, the present invention provides
An object of the present invention is to provide a life management terminal device that can detect management data such as the start of a meal of a user without the user being aware of it.

[0011] In addition, the present invention provides a life management method and a life management system using each of them, which allows the user to send the user's meal contents to the administrator without any burden on the user for detailed life management. To aim.

[0012]

The present invention has taken the following means in order to solve the above problems. First of the present invention
A life management system according to an aspect, a life management terminal device that detects that the user is eating based on information measured by the user, and that the user starts or ends the meal by the life management terminal device. When is detected, a means for inquiring the user about a meal content after a predetermined time after the detection and a means for obtaining an answer from the user to the inquiry are provided. In the life management method corresponding to the first aspect, the life management terminal device that detects that the user is eating based on information measured by the user detects that the user has started or finished eating. At this time, the user is inquired about the meal content after a predetermined time after the detection, and the answer is acquired. Based on the answer to the user's meal content inquiry, the result of analyzing the user's meal content is presented to the user, so that the user's meal content can be transmitted to the administrator without burdening the user. You can manage your life.

A life management system according to a second aspect of the present invention is a life management terminal device for detecting that the user is eating based on information measured by the user, and the life management terminal device for the user. When it is detected that the person has started eating, it is characterized by comprising means for acquiring the image and means for transferring the acquired image to a server managing data. The life management method corresponding to the second aspect is such that when the life management terminal device that detects that the user is eating based on information measured by the user is detected that the user has started eating,
It is characterized in that the user is urged to send an image of a meal content photographed to acquire the image, and based on the acquired image, the meal content of the user is transferred to a management server for analysis. In this way, by acquiring the image and presenting to the user the result of analyzing the meal content of the user based on the acquired image, the administrator can monitor the meal content of the user without burdening the user. You can send it to and manage your life in detail.

Preferred embodiments of the above life management systems and life management methods are as follows. The following embodiments may be applied individually or in appropriate combination.

(1) When the life management terminal device detects that the user has finished eating or after a predetermined time after the life management terminal device detects that the user has started eating Presenting information about a drug that the user should take after eating to encourage the user to take the drug. Medication can be managed without burdening the user.

(2) The calorie intake of the user is recorded for each meal, and information on the amount of exercise of the user is collected, and when it is detected by the life management terminal device that the user has started eating, the Presenting a message for giving advice corresponding to the current situation of the user's meal, based on the user's exercise amount up to the present time, the calorie intake, and the target calorie intake predetermined by the user. It is possible to manage the exercise amount and the calorie intake without burdening the user.

(3) The calorie intake and meal time of the user are recorded for each meal, and the drug name, the intake time and the intake amount of the drug taken to control the user's exercise amount and the blood glucose level are recorded. Collected, periodically predicting a change in the blood sugar level of the user based on the collected information, ingested calories and meal time, and presenting a message corresponding to the state of the user determined based on the predicted value To do. The blood sugar level can be managed without burdening the user.

(4) The life management terminal device for detecting that the user is eating based on the generation timing of the chewing sound generated when the user eats a meal, further, based on the generation timing. The chewing frequency and the chewing interval during the user's meal are measured, and the user is judged based on the chewing frequency and the chewing interval measured during the user's meal and the time from the start to the end of the meal Present a message to give advice on how to eat your diet. The user's meal contents can be transmitted to the administrator without burdening the user, and fine-grained life management can be performed.

(5) The life management terminal device for detecting that the user is eating, based on the biometric information measured by the user, is further measured when the user is eating. Obtaining the degree of relaxation of the user from biometric information, and when the degree of relaxation does not reach a predetermined level, information for relaxing the user is delivered. It is possible to manage the degree of relaxation during meals without burdening the user.

A life management system according to a third aspect of the present invention is a means for collecting information on a user's operation in the life management terminal device, a means for judging a user's operation status in the life management terminal device, and a user. It is characterized by comprising means for collecting information on the environment and means for generating and presenting a message using such information to cause the user to take an action that leads to health. A life management method corresponding to the third aspect collects information on a user's motion with a life management terminal device, determines a user's motion status, collects environment information, and uses this information to make the user healthier. It is characterized by generating and presenting a message that causes a connected action. The user's meal intake method can be managed without burdening the user.

The life management terminal device according to the fourth aspect of the present invention comprises at least a measuring means for measuring the pulse and the skin conductivity of the user, and when the pulse rises and there is no sudden increase in the skin conductivity, And a means for determining that the user is eating a meal.

A life management terminal device according to a fifth aspect of the present invention is a device for measuring at least a user's pulse and skin temperature, and when the pulse rises and the skin temperature does not fall sharply below a set inclination. And a means for determining that the user is eating a meal.

A life management terminal device according to a sixth aspect of the present invention is a means for collecting a voice including a chewing sound generated by a user eating a meal, and an extracting means for extracting a voice band of the chewing sound from the voice. A means for detecting the generation timing of the voice signal in the extracted voice band; and when the voice signal is continuously generated at a predetermined interval and a predetermined number of times based on the detected generation timing, the user of the previous term has a meal. And a means for judging that it is inside.

According to the fourth to sixth aspects of the present invention, it is possible to detect the start of a meal of the user without the user having to be aware of it.

[0025]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram showing an example of the overall configuration of a living management system according to the first embodiment.

The life management system shown in FIG. 1 is roughly divided into a life management terminal device 1 and a mobile phone 2 worn by a user who needs to manage life, and a life management terminal device via a predetermined network. 1 and a server device 3 that communicates by connecting to the mobile phone 2. The mobile phone 2 preferably has a built-in camera, and unless otherwise specified in this specification, the mobile phone 2 has a built-in camera.

The life management terminal device 1 comprises a biological information measuring device 11 and a diet / exercise detecting device 12.

The biological information measuring device 11 is, for example, a photoelectric pulse wave, GSR (Galvanic Skin Reflect).
x; skin electrical reflection), measuring biological information such as skin temperature,
The diet / exercise detection device 12 determines whether the change in the biological information accompanying the meal measured by the biological information measurement device 11 is in the middle of a meal (or
It is to detect (determine) whether or not the user is exercising.
In the present embodiment, the biological information measuring device 11 uses, as biological information, for example, a photoelectric pulse wave sensor 111, a GSR electrode 112 for measuring a photoelectric pulse wave, GSR, and skin temperature,
The temperature sensor 113 is provided.

FIG. 2 shows the appearance of the life management terminal device 1, which is a biological information measuring device 11 to be worn on the user's finger.
And the meal / exercise detection device 12 to be worn on the arm of the user. The biological information measuring device 11 is connected to the meal / exercise detecting device 12 by a predetermined lead wire. The diet / exercise detection device 12 has a wearing belt 71 so that it can be worn on the arm.

The meal / motion detecting device 12 inputs the measurement signals corresponding to the photoelectric pulse wave, GSR, and skin temperature measured by the biological information measuring device 11, and performs predetermined analog processing such as amplification on the analog processing. The unit 122, a CPU 123 for converting various signals subjected to analog processing into digital signals, and then determining whether or not the user is eating based on the biometric information, and for communicating with the mobile phone 2. The communication unit 124 is included. The communication between the meal / exercise detecting device 12 and the mobile phone 2 may be Bl communication.
It may be short-range wireless communication such as Bluetooth (TM., not otherwise specified).

The photoelectric pulse wave sensor 111 measures a pulse wave as shown in FIG. 3 from a finger attached to it, and a pulse can be obtained by detecting the peak point of this pulse wave.
It is known that the pulse increases during a meal due to masticatory exercise.

GSR is a conductivity (conductance) between two GSR electrodes 112 in contact with two places of the finger, which is measured by mounting the biological information measuring device 11 on the finger. It has been confirmed that this electric conductivity (skin electric conductivity) instantaneously rises in a spike shape with sweating. As shown in FIG. 4, since it is in a mentally stable state during meals, it is confirmed that an instantaneous increase is not seen and monotonically decreases.

The temperature sensor 113 is the biological information measuring device 1
The temperature of the skin of the finger is measured by mounting 1 on the finger, and it has been confirmed that the skin temperature of the finger does not decrease during meal, as shown in FIG.

The meal / exercise detecting device 12 is adapted to judge whether or not the user is eating, based on the measurement result as shown in FIG. 4, according to the flowchart shown in FIG. For example, (1) the pulse rises for a predetermined time or longer and the GSR does not rise sharply, and (2) the pulse rises for a predetermined time or longer and the skin temperature does not fall sharply. When either one of the conditions is satisfied, the user determines that he is eating.

Therefore, in the meal / motion detecting device 12,
Periodically check the pulse and GSR values or the pulse and skin temperature values. Which is to be regularly checked may be set in advance. In addition, the biological information measuring device 11 may have only a pulse (pulse wave) and GSR measurement function or a pulse (pulse wave) and skin temperature measurement function.

In FIG. 5, the meal / exercise detecting device 12 periodically checks the values of pulse and GSR or the values of pulse and skin temperature, and the pulse rises for a predetermined time or longer (step S1). Moreover, when there is no sudden increase in GSR at that time (step S2), or when the pulse rises for a predetermined time or longer (step S1) and the skin temperature does not fall at that time (step S2), the user It is determined that a meal is in progress (step S3).

As described above, according to the first embodiment,
Since it is possible to detect that the user is eating based on the biometric information measured by the user, when the state is regularly checked and the previous state is other than meal, and this time is recognized as the meal state. You can get a meal start event.

(Second Embodiment) FIG. 6 is a block diagram showing an example of the overall configuration of a living management system according to the second embodiment. 6, the same parts as those in FIG. 1 are designated by the same reference numerals.

The life management system shown in FIG. 6 is roughly divided into a life management terminal device 1 and a mobile phone 2 worn by a user who needs to manage life, and a life management terminal device via a predetermined network. 1 and a server device 3 that communicates by connecting to the mobile phone 2. The life management terminal device 1 shown in FIG.
14 and a meal detection device 13.

The user attaches the bone conduction microphone 114 to the ear, for example, and connects it to the meal detection device 13. The user also lives with the meal detection device 13 and the mobile phone 2.

The bone conduction microphone 114 is for receiving bone conduction sound.

The meal detection device 13 includes a bone conduction microphone 114.
Microphone amplifier 1221 that amplifies the analog signal obtained in
And a bandpass filter 1222 that extracts only the frequency band of mastication from the amplified audio signal, and a rising edge of the audio signal of the extracted frequency band is detected,
A comparator 1223 that outputs a pulse signal corresponding to this edge, a CPU 123 that performs processing for determining whether or not the user is eating from the pulse appearance interval of this pulse signal, and communicates with the mobile phone 2. And a communication unit 124 for.

For example, when it is detected that the user is eating, the management server 3 is notified from the meal detecting device 13 through the communication section 124 (without any operation by the user). As a result, the management server 3 can provide various services using the fact that the user is eating.

The communication between the meal detection device 13 and the mobile phone 2 may be wired communication, but may be Bluetooth.
Short-range wireless communication such as.

Although the mobile phone is used here, a mobile information terminal (PDA) having a built-in communication function such as a mobile phone or PHS or a connectable personal digital assistant (PDA) may be used instead.

FIG. 7 is for explaining the operation of the meal detection device 13 for determining whether or not the user is eating. The analog signal of the sound including the bone conduction sound obtained by the bone conduction microphone 114 is amplified by the microphone amplifier 1221 (see FIG. 7A). As shown in FIG. 7A, the masticatory sound waveform is a burst wave with an interval of about 0.5 seconds. The filter 1222 extracts only the frequency band of mastication from the amplified audio signal as shown in FIG. 7B. The comparator 1223 detects the rising edge of the audio signal in the extracted frequency band,
As shown in (c), a pulse signal corresponding to this edge is output. The pulse signal includes a bone conduction sound at the time of mastication and a bone conduction sound at the time of conversation. However, in the case of the pulse signal corresponding to the mastication, a predetermined interval (for example, 0.4 to
It is characterized in that the pulse appears repeatedly a plurality of times (for example, at least three times or more) in 0.6 seconds. Paying attention to this point, in the CPU 123, for example, a predetermined interval (for example, 0.4
When the pulse appears three times in succession (~ 0.6 seconds), it is recognized as chewing (meal). After that, at a predetermined interval (for example, 0.
It is recognized that the meal is finished when the pulse signal which is continuous three times or more in 4 to 0.6 seconds) is not detected.

When the CPU 123 thus detects that the user has started eating from a state in which he / she is not eating, and when it has detected that the user has finished eating, the CPU 123 and the time at the time of the detection. Along with storing
The management server 3 is also notified through the communication unit 124 and the mobile phone 2.

In FIG. 6, the bone conduction microphone 114 that collects the bone conduction sound is used to measure the masticatory sound, but the invention is not limited to this. A microphone (pharyngeal microphone) that collects the sound generated from the pharynx during mastication is used. May be. Also in this case, FIG.
Since the voice as shown in (a) can be collected, it is possible to detect whether or not the user is having a meal in the same manner as described above.

As described above, according to the second embodiment,
Since it is possible to detect that a user is eating based on the generation timing of the sound signal of the chewing sound generated by the user eating, it is possible to detect the start of the user's meal without the user being aware of it. You can

(Third Embodiment) Next, as a third embodiment, a life by a life management system using any of the life management terminal devices 1 described in the first embodiment and the second embodiment. Management will be explained. In addition, here
Although the life management terminal device can obtain the same effect regardless of whether it is the device according to the first embodiment or the device according to the second embodiment, in the third embodiment, the life management according to the second embodiment is performed. A case of a life management system using the terminal device 1 will be described as an example. The description is almost the same even if the life management terminal device 1 according to the second embodiment is replaced with the life management terminal device 1 according to the first embodiment.

(A) A case where life management is performed using images will be described with reference to FIG.

When the user detects that the user is eating for the first time after the meal detecting device 13 does not detect that the user is eating, the user starts eating (step S11). Is first notified to the mobile phone 2 (step S12). The detection of the start of meal is
It is a trigger to start a series of subsequent operations,
This is called a "meal start event".

Upon receiving the notification of the meal start event, the mobile phone 2 outputs an alarm (for example, vibration or a predetermined voice message) (step S1).
3), "You are eating. Please take a picture of what you eat." Is displayed on the screen (step S1).
4). A preview screen of the camera is also displayed in the screen. The user looks at this display and, preferably,
You can shoot with the camera so that you can shoot all the foods you are going to eat on the table. Camera photographing is performed by selecting the shutter button arranged on the screen or by pressing the shutter button of the mobile phone 2 (step S15). Since the photograph of the taken meal is displayed on the confirmation window on the screen (step S16), the user confirms the displayed photograph (re-takes it if necessary) and arranges it under this. The photograph of the meal is transmitted to the management server 3 by selecting the transmission button or pressing the transmission button assigned to the button of the mobile phone (step S17).

The meal photograph sent to the server is stored and managed in the management server 3 (step S18), and the diet content is analyzed by a dietitian who analyzes the diet content (step S18).
19), the nutritionist inputs the analysis result to the server (step S20). The server performs detailed analysis of nutritional components based on the input meal content (step S21), and the results and the comments of the dietitian are summarized as a report for, for example, one day, and the destinations preset by the user ( For example, it is sent to a mobile phone or a personal computer (PC) by mail (steps S22 to S24). The user can look at the report for one's meal for one day included in the email received by the mobile phone or the PC, and can reflect on the meal for that day (step S2).
5).

Although the camera of the mobile phone 2 is used for the picture of the meal, the present invention is not limited to this case, and a digital camera or the like separate from the mobile phone 2 may be used (the mobile phone 2).
Does not have to be a mobile phone with a built-in camera). In this case, once the image data taken by the digital camera is temporarily transferred to the Bluetooth built into the digital camera,
After being transferred to the mobile phone 2 at th, the mobile phone 2 transmits it to the management server 3.

Living with the camera worn on the body (for example, built-in glasses), there is no need for inquiries or operations for photographing or transmission, and the face-to-face image during meal may be recorded as it is and automatically transmitted. .

FIG. 9 shows a configuration example of the life management system in this case. In FIG. 9, the same parts as those in FIG. 6 are designated by the same reference numerals. That is, in FIG. 9, the life management terminal device 1 has the wearable camera 20.
The wearable camera 20 includes a CCD camera 201, a memory 202, and a communication unit 203, and is a camera with a built-in communication function that is worn on the shoulder, or a camera with a built-in communication function that is built into glasses.

The image photographed by the CCD camera 201 of the wearable camera 20 is temporarily stored in the memory 202 and transmitted from the communication section 203 to the mobile phone 2. The communication between the communication unit 203 and the mobile phone 2 is, for example, Blue.
Tooth is used.

Next, the operation of the life management system shown in FIG. 9 will be described with reference to FIG. 10, the same parts as those in FIG. 8 are designated by the same reference numerals, and different parts will be described.

When the mobile phone 2 receives the notification of the meal event from the meal detection device 13 (step S12), for example, the wearable camera 20 using Bluetooth is used.
The imaging command is transmitted to (step S201). When the wearable camera 20 receives the image capturing command via the communication unit 203, the wearable camera 20 captures an image of the target (step S202), and transmits the captured image data to the mobile phone 2 from the communication unit 203 (for example, via Bluetooth). (Step S203).

Upon receipt of this image data, the mobile phone 2 transmits it together with other data such as biometric information to the management server 3 (step S205). The subsequent operation is the same as in FIG.

Further, a camera is installed at the user's meal place (for example, the ceiling of the dining room) at a position and direction where the meal content can be captured as an image, and the meal content is automatically photographed when the start of the meal is recognized. You may

FIG. 11 shows a configuration example of the life management system in this case. In FIG. 11, the same parts as those in FIG. 9 are designated by the same reference numerals. That is, in FIG. 11, the life management terminal device 1 includes the camera 2 installed at the user's eating place.
Have one. The configuration of this camera 21 is the same as that of the wearable camera 20 shown in FIG.

Next, the operation of the life management system shown in FIG. 11 will be described with reference to FIG.

When the mobile phone 2 receives a notification of a meal event from the meal detection device 13 (step S12), it sends an image pickup command to the camera 21 by Bluetooth, for example (step S201). When the camera 21 receives the imaging command via the communication unit 203,
An image of the target is captured (step S202), and the captured image data is transmitted from the communication unit 203 (for example, Bluetooth).
Then, the data is transmitted to the mobile phone 2 (step S203).

When the mobile phone 2 receives this image data, it sends it together with other data such as biometric information to the management server 3 (step S205). The subsequent operation is the same as in FIG.

(B) A case of performing life management using voice will be described with reference to FIG. 12, the same parts as those in FIG. 8 are designated by the same reference numerals.

When the meal detection device 13 detects that the user has started eating (step S11), the meal start event is notified to the mobile phone 2 (step S12).
The mobile phone 2 that receives the meal start event receives it and uses the telephone number stored in advance to manage the server 3.
To notify the meal start event (step S
31). In response to the meal start event, the management server 3 makes a call to the mobile phone 2 that is the sender of the meal start event in order to transmit a predetermined voice message (step S32). In response to this, a ring tone is generated in the mobile phone 2 (step S33), and the communication (call) between the user who notices the ring tone and the management server 3 is started. First, the predetermined voice message "I'm eating. What are you eating?" Generated by voice synthesis in the management server 3 is displayed on the mobile phone 2 (step S34). ). In response to this inquiry, the mobile phone 2 records a voice explained by the user (step S35), and transmits the recorded voice data to the management server 3 (step S36). The management server 3 stores and manages the received voice data (step S3).
7). The dietary content is analyzed by the dietitian who analyzes the dietary content from the voice data (step S19).
It is similar to FIG.

It should be noted that the management server 3 may collect and store the information on the user's meal content based on the photograph of the meal and the response from the user's voice by combining FIG. 8 and FIG. .

Further, in step S34 of FIG.
In the call between the user and the management server 3, the meal content may be inquired in order for each classification. For example, "What is your staple food?""What was the side dish main?""What was the submenu?""Drink?"
Inquire in order and record each voice.

Although the voice waveform data is stored as it is for the meal contents explained by the patient here, it is possible to voice-recognize it by the mobile phone or the server and convert the meal contents into data. Good.

(C) A case where a mobile phone is equipped with a voice recognition function and life management is performed using this voice recognition function will be described with reference to FIG. In FIG. 13, the same parts as those in FIG. 12 are designated by the same reference numerals, and the description thereof will be omitted. That is, in step S34, the content of the user's reply to the voice message from the management server 3 is
On the spot, voice recognition is performed by the mobile phone 2, and the recognition result is transmitted to the management server 3 (step S41,
Step S42). The management server 3 stores and manages the received data (step S43). A dietitian who analyzes the meal content from the data analyzes the meal content (step S44). At this time, the management server 3 automatically interpolates the missing information and the information to be confirmed, and then the inquiry message is issued again. May be transmitted to the mobile phone 2 (step S45). For example, "How much rice did you eat?" Is displayed on the mobile phone 2 (step S46). The answer from the user to such an inquiry is also voice-recognized as above, and the result is transmitted to the management server 3 (steps S47 to S4).
9). After that, it is similar to FIG.

(D) Other Input Method of Meal Content In the above (A) to (C), the case where the meal content is input by image or voice has been described.
Alternatively, a meal content input screen may be displayed, and a menu may be searched and input on the input screen in the Japanese syllabary using, for example, the dial keys (numeric keys) of the mobile phone 2. In this case, you may use the screen which prepares and inputs a hierarchy for every classification of a menu. For these, the initial screen can be set in advance according to personal preference.

Instead of the mobile phone 2, a mobile information terminal (PD
The same applies when A) is used. The configuration example in this case is the same except that the mobile phone in FIG. 6 is replaced with a mobile information terminal. The portable information terminal includes, for example, Bluetooth for communicating with the communication unit of the meal / exercise detection device.
It has a built-in communication function such as OOTH and a built-in communication function such as PHS for communicating with the management server. Even if it is not built-in, it may be connected with a card slot or a connector. In the life management terminal device 1, when the meal start event is recognized by using the algorithm as in the first embodiment, an alarm is generated in the mobile information terminal and the classification selection shown in FIG. 14 is displayed on the screen of the mobile information terminal. The screen is displayed. The user notices the alarm, takes out the portable information terminal, and selects and inputs the content of the meal according to the screen. For example, when Japanese food is selected, a Japanese food selection screen opens as shown in FIG. Here, the category of Japanese food is selected, and the individual name included in each is selected. With respect to the selected menu, the amount of the menu is input by pressing the up / down keys or the ten-key screen on the screen as shown in FIG. Once determined, the calorie intake is calculated from the amount and displayed along with the menu name in the lower part of FIG.

In the above (A) to (D), there are cases where an alarm is displayed at the start of a meal and the user is prompted to perform an operation or interact with the user. Since it is thought that there are many cases where people are reluctant to do such work during meals, it recognizes a meal event and predicts when meals will end, and performs processing such as alarm display and operates after meals. May be adjusted so that In this case, for example, register the expected meal time for each individual in the initial setting,
Control based on this.

(E) FIG. 1 shows the case of drug administration.
This will be described with reference to FIG.

After the meal detection device 13 detects that the user has started eating (step S11), the state of having a meal continues for a predetermined time or longer, but thereafter, it is detected that the user is eating a predetermined time. Meal detection device 1 when it disappears
The CPU 123 of No. 3 determines that the meal is finished. The detection of the end of meal serves as a trigger for starting a series of operations thereafter, and this is called a meal end event.
The meal end event is notified to the mobile phone 2 (step S61). The mobile phone 2 that has received the meal end event
In response to this, the telephone number stored in advance is used to connect to the management server 3 to notify the meal end event (step S62). The server device 3 searches the database in which such information is registered in advance for whether the user of the mobile phone 2 that is the transmission source of the meal end event has a drug to take after meals. When the information on the drug to be taken after meal (the information including the name and amount of the drug, the time of taking the drug, etc., which is called medication information) is searched (step S63), a voice message for notifying the content is generated. At the same time (step S64), preferably, the image of the drug to be taken is acquired from the database (step S65), and the mobile phone 2 that is the transmission source of the meal end event transmits the voice message and the image. A call is made (step S66). In response to this, a ring tone is generated in the mobile phone 2 (step S67), and the user who notices the ring tone displays the voice message and the image transmitted from the management server 3 on the mobile phone 2. (Step S68, step S69).

As described above, after the meal, the message or the image notifying the medicine to be taken is always delivered after the meal, so that the user can prevent forgetting to take the medicine.

The above embodiment (E) is preferably used in combination with the life management explained in (A) to (C) of the above-mentioned third embodiment.

As described above, according to the third embodiment,
The life management terminal device 1 detects that the user is eating based on the generation timing of the audio signal of the mastication sound generated by the user eating or the biological information measured by the user. When it is detected that the meal is started, the user is urged to transmit an image of the meal content photographed and the image is acquired, based on the acquired image, or the user is inquired about the meal content, Based on the answer, by presenting the result of analyzing the user's meal content to the user, the user's meal content can be transmitted to the administrator without burdening the user, and fine-grained life management can be performed.

Further, when the life management terminal device 1 determines that the user has finished eating, the user is presented with information on the drug to be taken after eating to encourage the user to take the drug. Drug administration can be performed without burdening the user.

(Fourth Embodiment) Next, as a fourth embodiment, using the meal detection device 13 described in the second embodiment, for example, when the user is a diabetic patient, real-time life management. A case will be described.

FIG. 18 shows an example of the structure of a life management system according to the fourth embodiment. In order to feedback information in real time and interactively, and manage food intake and exercise in real time, life management is performed. The terminal device 1 further includes a momentum detection device 14. 18, the same parts as those in FIG. 6 are designated by the same reference numerals, and different parts will be described.

The exercise amount detecting device 14 is used by being attached to, for example, a waist or an arm, and is used as an acceleration sensor 121 for detecting an acceleration related to a user's movement and an acceleration sensor 121.
CPU 123 that performs a predetermined process on the signal obtained in
And a communication unit 124 for communicating with the mobile phone 2. Note that the communication between the exercise amount detection device 14 and the mobile phone 2 is not limited to Bluetooth, even if wired communication is used.
It may be short-range wireless communication such as h.

In the case of diabetic patients, not only management of blood glucose level but also management of exercise and diet are necessary. As for exercise, the exercise amount detection device 14 attached to the waist or the arm 14
The whole body movement and its degree (whether walking slowly, walking fast, or running) are measured by the acceleration sensor 121, and the CPU 123 calculates the calorie consumption together with the basal metabolism based on the measurement result. The data about the calorie consumption is transmitted from the exercise detection device 14 to the management server 3 via the mobile phone 2 at any time (when the situation changes) without the user's operation.

On the other hand, regarding the meal content, as described in the third embodiment, the management server 3 analyzes the meal content to obtain the calorie intake of the user for each meal, and the database (Fig. Record (not shown).

In the database of the management server 3, the target calorie intake of each user, the meal time and the meal content at that time, the nutrition component ingested, its intake amount, the calorie intake,
Data such as the amount of exercise (calorie consumption) is recorded.

The management server 3 determines the current situation based on the data recorded in this database, and gives advice to a user who is about to eat a meal according to the situation of the user.

With reference to FIG. 19, the case where the life management system shown in FIG. 18 is used to manage the life based on the content of the meal and the calories burned up to that point will be described in more detail.

For example, when the user starts the dinner, the meal detection device 13 detects that the user has started the meal (step S11), and the meal start event is notified to the mobile phone 2 (step S12). .

The management server 3 reads out the data recording the target calorie intake predetermined by the user and the data recording the calorie intake up to the present day from the database, and further reads the data from the exercise amount detecting unit 101 today. From the information about calorie consumption sent up to the present time, for example, find the calorie consumption up to the present time,
From the calorie intake and the amount of exercise (calorie consumption) up to the present time, 200 kca left for the target calorie intake
When the answer is 1, the voice message “If you exceed 200 kcal, you will exceed the target. Try to reduce the intake as much as possible.” and to inquire about the meal content as described in the third embodiment. The message "What are you eating?" Is generated (step S102).

In order to send this voice message, a call is made to the mobile phone 2 which is the sender of the meal start event (step S103). In response to this, a ring tone is generated in the mobile phone 2 (step S104), and communication (call) is started between the user who notices the ring tone and the management server 3. The message generated by voice synthesis in the management server 3 is displayed on the mobile phone 2 (step S105). In response to this inquiry, the mobile phone 2 recognizes the voice explained by the user,
The recognition result is transmitted to the management server 3 (step S1)
06, step S107). The management server 3 stores and manages the received data (step S10).
8), analyze the meal content from the data (step S
109). The management server 3 analyzes the meal content in real time based on the received data. By this analysis,
If it is found that the inoculated calorie of the user who is currently eating exceeds the target calorie intake, for example,
A message such as "You have exceeded 200 kcal. Let's walk 30 distributed" may be generated and sent to the mobile phone 2 (step S1).
10).

As described above, the management server 3 performs real-time analysis based on the data transmitted from the life management terminal device 1, thereby allowing the user to perform calorie control each time. be able to.

Further, a message is displayed based on the recognized operation state. For example, if you are on a holiday, you can constantly monitor the operating state, and if the rest state lasts for 1 hour, determine the weekday or the holiday from the system date. It will be. How about taking a walk for about 30 minutes? "And so on. At this time, the current weather information is acquired from the information on the weather forecast site, and it is displayed that "It's a nice weather. It's nice to walk outside for about 30 minutes." From "I am doing a sale at the ○○ supermarket.
How about a walk? A message that the user is interested in may be displayed to guide the user to exercise.

FIG. 20 shows another configuration example of the life management system according to the fourth embodiment. A life management terminal device 1 similar to that shown in FIG. 6 and a personal digital assistant 4 (PDA)
Composed of and. In this configuration example, the case where all the processes are performed by the mobile information terminal without performing online communication with the management server so that the mobile phone can be used even in an environment where communication is not possible is described.

In FIG. 20, the same parts as those in FIG. 6 are designated by the same reference numerals, and different parts will be described.

The portable information terminal 4 can have a built-in or connectable short-distance wireless communication such as Bluetooth which can communicate with the communication section of the life management terminal device 1.

Regarding exercise, the meal / exercise detecting device 12 is used.
Operates with built-in acceleration sensor 121 (rest / work /
(Walking / running) is recognized, and the calorie consumption in each operation mode is calculated. For example, in the case of walking, the walking distance is calculated from the number of steps, and the calorie consumption by walking is calculated from the following formula 0.5 × body weight × distance km = calorie consumption. The measurement results are transmitted from the communication unit to the mobile information terminal 4.

The portable information terminal 4 acquires the total calorie consumption together with the basal metabolism based on these information. The basal metabolism is Harris Benedict's official daily basal metabolism (male) = 66.5 + weight x 13.8 + height x
5.0- Age x 6.8 Basal metabolic rate per day (female) = 66.5 + weight x 9.6 + height x
1.9-Calculate using Age x 4.7. Alternatively, a standard basal metabolic rate table for each age, sex, height, and weight may be prepared and calculated from here.

The portable information terminal 4 records data such as target calorie intake of each user, meal time and meal content at that time, ingested nutritional component and its intake amount, calorie intake, exercise amount (calorie consumption). ing.

On the screen of the portable information terminal 4, a display as shown in FIG. 21 is displayed as a basic screen. Steps and exercise amount calculated from the steps (calories burned by exercise), basal metabolism, total consumption by adding exercise and basal metabolism (total calories burned)
Is displayed. Also, using the meal input method from the screen as in the third embodiment (D), the meal menu is input, the calorie intake is calculated, and displayed as the intake amount. In addition, the balance between the intake amount and the total consumption amount is graphically displayed as a calorie balance, so that the user can always be intuitively aware of his or her state.

Further, in the present embodiment, the portable information terminal 4 is equipped with the processing such as message display performed by the management server. FIG. 22 shows an example related to a meal event as an example of the processing. Biological information of pulse, GSR, skin temperature measured by the life management terminal device 1, and acceleration sensor 1
The data of the operating state and the number of steps recognized in 21 are periodically transferred to the mobile information terminal 4 (step S41). For example, when dinner is started, the start of meal is recognized in the mobile information terminal 4 by the same algorithm as in the first embodiment from the pulse and GSR data transferred to the mobile information terminal 4 (step S42). At that time, the calorie intake and the exercise amount up to that time held in the mobile information terminal 4 are compared with the target daily calorie intake similarly held in the mobile information terminal 4 (step S43). At this time, the calorie intake amount database 41 is used to convert the calorie consumption to the exercise amount. Here, when the calorie that can be ingested with respect to the target calorie is 200 kcal,
"If it exceeds 200 kcal, it will exceed the target.
Try to reduce your intake as much as possible. Message is displayed on the screen and the user is instructed to enter the meal content (step S44). The input meal content data is saved, and the calorie intake is calculated from these data and analyzed (steps S45 to S47). As a result, for example, when the excess calorie intake exceeds 200 kcal, the message "You are over 200 kcal. Let's take 30 distributed steps." Is displayed, and calorie control can be performed each time (step S4).
8).

FIG. 23 shows an example of displaying a message based on the recognized operation state. For example, in the case of being idle on a holiday, the operating state is constantly monitored (step S51), and when the resting state continues for one hour (step S51).
52), determine weekdays and holidays from the system date (steps S53 and S54), and confirm schedule data by referring to the schedule database 43 in the PDA (step S55). (Step S56), and displays, for example, as shown in FIG. 24 (Step S57), such as "You will be deficient in your exercise. What about walking for about 30 minutes?"

Alternatively, the life management terminal device 1 according to this embodiment can recognize a work such as a desktop as a user's action. Therefore, if this work continues for a long time, for example, if it continues for two hours, A message is displayed as shown in Fig. 25, "If you work without rest, it will be more discipline. Let's take a rest for 5 minutes and refresh."

Further, when the life management terminal device 1 recognizes the meal start event, the meal time set for each user elapses, and 20 minutes later, an alarm is generated together with the alarm shown in FIG.
A screen like that is displayed and instructions for taking medication are given. On this screen, the picture, name and prescription content (how many tablets, etc.) of the medicine after meal prescribed by the user are displayed. The alarm at this time may output a voice such as "Let's take medicine".

In addition, a measurement instruction of biometric information related to a meal is also given. For example, in the case of a user (patient) who is instructed to measure the postprandial blood glucose level at 60 minutes and 120 minutes after the meal, when the meal start event is recognized by the life management terminal device 1, the meal time set for each user is set. After 60 minutes and 120 minutes have passed, the screen as shown in FIG. 27 is displayed together with the alarm, the measurement instruction is given, and the input of the measured data is instructed. Separately, the measurement is performed by using a commercially available self-blood glucose measuring device owned by the user, and the measurement result is input using the 10 keys on the screen. Here, the manual input is taken as an example, but when the user measures according to the alarm, the measurement data is wired or wirelessly (Bluetooth) from the self blood glucose measuring device.
May be transmitted to the mobile information terminal 4 and automatically recorded.

Management of hypoglycemia is also required if insulin is being administered. In this case, the insulin intake amount is notified to the management server 3 via the mobile phone 2 or the like (for example, by the attending physician) each time the insulin intake amount is taken. The management server 3 stores in a predetermined database the time and amount of insulin taken, the calorie intake and the meal time obtained as a result of analyzing the meal contents up to now, the calorie consumed by exercise, and the like. Therefore, the management server 3 periodically estimates and predicts the blood glucose level based on the data in these databases (step S121), and the predicted value is calculated from a predetermined value. When it becomes low, it is judged that there is a risk of falling into hypoglycemia (step S122) and, for example, “If you do not eat anything as it is, you may get hypoglycemia. Drinks containing sugar immediately, or candy Please take a call to the mobile phone 2 of the corresponding user to generate a message such as "Please ingest." (Step S12
4). In response to this, a ring tone is generated in the mobile phone 2 (step S125), and the user who notices this ring tone can receive the above message by displaying the received mail (step S12).
6), the user can take preventive measures before the symptoms of hypoglycemia occur.

The fourth embodiment is preferably used in combination with the life management described in the third embodiment.

As described above, according to the fourth embodiment,
The management server records the calorie intake of the user for each meal as a result of analyzing the content of the meal, and
When the life management terminal device 1 detects that the user has started eating, the information regarding the amount of exercise of the user is detected, and the amount of exercise and the calorie intake of the user up to the present time and the target intake predetermined by the user. By presenting a message for giving advice corresponding to the current situation of the user's meal based on the calorie, it is possible to manage the exercise amount and the calorie intake without burdening the user.

As a result of analyzing the meal contents, the calorie intake and the meal time of the user are recorded for each meal, and the information on the exercise amount of the user and the intake time and the intake amount of insulin are collected. By periodically predicting a change in the blood glucose level of the user based on the collected information, ingested calories, and meal time, and presenting a message corresponding to the state of the user determined based on the predicted value, The blood sugar level can be managed without burdening the user.

(Fifth Embodiment) As described in the second embodiment, when detecting whether or not a user is eating, it is possible to evaluate the number of times of chewing, the speed of eating, etc. Therefore, by feeding this back to the user during the meal, it is possible to give an instruction to improve the eating method of the user in real time. The operation procedure of the life management system in this case will be described with reference to FIG.

When the meal detection device 13 detects that the user has started eating (step S11), it notifies the mobile phone 2 of a meal start event (step S12).
The mobile phone 2 that receives the meal start event receives it and uses the telephone number stored in advance to manage the server 3.
To notify the meal start event (step S
131). The management server 3 records the meal start time of the user (step S132).

The CPU 123 of the meal detection device 13 obtains the number of times of mastication by detecting the start of a meal and then counting the pulses shown in FIG. 7 (c) which are generated at predetermined intervals. During a meal, chewing continues for a while to chew one bite of food, then pauses chewing, and then chews one bite again, so the interval at which food is taken into the mouth, that is, the intake interval Is determined by measuring the time from when mastication is paused until it is restarted.

In order to transmit the measured number of times of chewing and the ingestion interval to the management server 3 every predetermined time, the meal detection device 13
Connects to the management server 3 using the mobile phone 2 and transmits the measured number of times of chewing and the ingestion interval (step S135).

In the management server 3, when the intake interval is shorter than the predetermined time interval, or when the number of times of chewing is smaller than the predetermined number of times, a message (whether voice or text, notifying that) is given. In order to send a mail including this message, the mobile phone 2 of the user is called (step S137).
In response to this, a ring tone is generated in the mobile phone 2, and the user who notices the ring tone can receive the message by displaying the received mail (step S138).

After that, when the meal detecting device 13 detects that the meal is finished, in the same manner as described with reference to FIG. 17,
The meal end event is notified to the mobile phone 2 (step S142). Mobile phone 2 that received the meal end event
Receiving this, connects to the management server 3 using the telephone number stored in advance and notifies the meal end event (step S144). The management server 3 obtains the meal time from the time when the meal end event occurs and the meal start time recorded in step S132 (steps S144 and S145). If this time is shorter than the specified time, a message (voice, advice to advise the user to eat more slowly)
Alternatively, it may be text), and a call is made to the mobile phone 2 of the user to send a mail including this message (step S146). In response to this, a ring tone is generated in the mobile phone 2, and the user who notices the ring tone can receive the message by displaying the received mail (step S147).

As described above, according to the fifth embodiment,
The life management terminal device 1 that detects that the user is eating based on the generation timing of the chewing sound generated when the user eats a meal is further based on the generation timing of the chewing sound of the user. Ingestion of the user's meal determined by measuring the number of times of chewing during the meal and the chewing interval, and the number of times of chewing and the chewing interval measured during the meal of the user and the time from the start to the end of the meal By presenting a message for giving advice on the method, it is possible to manage the user's meal intake method without burdening the user.

(Sixth Embodiment) As described in the first embodiment, when biometric information is measured to detect whether or not a user is eating, at the same time, changes in GSR and finger Since the degree of relaxation can be measured from changes in skin temperature, it can also be used to evaluate whether or not a person is relaxing.

The degree of relaxation can be measured by the following two methods.

One is the value of GSR (conductance).
Frequency of spike-like rises (eg, every 30 seconds)
It is possible to determine that the person is relaxed when a certain set value or less or a change rate of the section average value of the GSR value is a certain set value or less. Alternatively, the frequency of the spike-like rise or the interval average value may be used as the degree of relaxation. Alternatively, skin temperature can be used. In particular, it is known that the skin temperature of the finger or nose changes in response to mental changes.
Since the skin temperature decreases when stress is applied, it can be determined that the skin temperature is relaxed when the change (slope) of the skin temperature is above a certain set value. Alternatively, this inclination may be used as the degree of relaxation. Alternatively, a combination of these may be used.

If the degree of relaxation is low, there is a risk of indigestion. Therefore, for example, a request is made to the surrounding image or music distribution service for content that promotes relaxation, and this is requested by a television receiver near the user. For example, deliver it here. An operation procedure of the life management system in that case will be described with reference to FIG. Note that FIG. 30 shows a case where music is distributed to the mobile phone 2 to make the user relax.

When the meal detection device 13 detects that the user has started eating (step S11), the meal start event is notified to the mobile phone 2 (step S12).
The mobile phone 2 that receives the meal start event receives it and uses the telephone number stored in advance to manage the server 3.
To notify the meal start event (step S
131). The management server 3 records the meal start time of the user (step S132).

During the meal of the user, the CP of the meal detecting unit 52
In U123, the degree of relaxation is also measured at the same time (step S153), and when this falls below a predetermined level (value), the mobile phone is used to request the content distributor to request music for promoting relaxation from the management server 3. 2 to connect to the management server 3 and make a request to that effect (steps S154 to S15).
5).

The management server 3 receives this request and
Request a predetermined content distributor to distribute the content to the user. When making a request, you may make a request for distribution to a content distributor by listing the specific song name,
Make a request as "music that promotes relaxation",
The content distributor may select recommended music and distribute it.

When music is distributed from the content distributor to the mobile phone 2 and is received by the mobile phone 2, it is desirable that the music is automatically reproduced at the same time as the mobile phone 2 receives the music (step S157). When the content distributor prints the music, it may be confirmed to the user whether the music can be downloaded and reproduced. In that case, when the content distributor calls the mobile phone 2, a ring tone is generated in the mobile phone 2 and a confirmation message is displayed on the screen. When the user inputs an instruction of "OK", music is downloaded and reproduced. Further, although the reproduction is performed after the download here, the same applies to the stream reproduction.

The sixth embodiment is preferably used in combination with the life management explained in the third embodiment.

As described above, according to the sixth embodiment,
The life management terminal device 1 that detects that the user is eating, based on the biometric information measured by the user, further detects the biometric information of the user from the biometric information measured when the user is eating. The degree of relaxation is calculated, and when the degree of relaxation is less than a predetermined level, information for relaxing the user is distributed, so that the degree of relaxation at meal time can be managed without burdening the user.

The present invention is not limited to the above embodiments of the invention. Of course, various modifications can be made without departing from the scope of the invention.

[0130]

As described above, according to the present invention, the user's meal start / end can be detected without the user being aware of it. In addition, the user's meal content can be transmitted to the administrator without burdening the user, so that fine-grained life management can be performed.

[Brief description of drawings]

FIG. 1 is a diagram showing an example of the overall configuration of a life management terminal device and a life management system using the same according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an appearance of the life management terminal device of FIG.

FIG. 3 is a diagram illustrating a relationship between a pulse wave and a pulse.

FIG. 4 is a diagram showing an example of biological information (pulse wave, GSR, skin temperature) measured by a biological information measuring device.

FIG. 5 is a flowchart showing a determination procedure for determining that a person is eating from biometric information.

FIG. 6 is a diagram showing an example of the overall configuration of a life management terminal device and a life management system using the same according to a second embodiment of the present invention.

FIG. 7 is a diagram for explaining an operation of the meal detection device 13 for determining whether or not a user is eating.

FIG. 8 is a diagram for explaining the operation of a life management system that manages life using images.

FIG. 9 is a diagram showing a configuration example of a life management system when the camera is worn on the body.

10 is a diagram for explaining the operation of the life management system shown in FIG.

FIG. 11 is a configuration example of a life management system in a case where a camera is installed at a position and a direction where the user can understand the meal content as an image at the user's meal place and the meal content is automatically photographed when the start of the meal is recognized. The figure shown.

FIG. 12 is a diagram for explaining the operation of a life management system that manages life using voice.

FIG. 13 is a diagram for explaining the operation of a life management system that manages life using voice.

FIG. 14 is a diagram showing a basic screen for selectively inputting meal content on a mobile information terminal.

FIG. 15 is a diagram showing a selection screen for selectively inputting meal content on the portable information terminal.

FIG. 16 is a diagram showing a screen for inputting an amount after selecting meal content on the portable information terminal.

FIG. 17 is a diagram for explaining the operation of a life management system that manages medication.

FIG. 18 is a diagram showing a configuration example of a life management system further including an exercise amount detection device.

FIG. 19 is a diagram for explaining the operation of a life management system that manages exercise amount and calorie intake.

FIG. 20 is a configuration diagram of a life management system including a life management terminal device and a mobile information terminal.

FIG. 21 is a diagram showing an example of a basic screen of a mobile information terminal of a life management system.

FIG. 22 is a diagram showing a flow of meal content input of a life management system including a life management terminal device and a mobile information terminal.

FIG. 23 is a diagram illustrating a system operation for displaying a message urging exercise based on the user's operation recognized by the life management terminal device.

FIG. 24 is a diagram showing an example of a screen displaying a message prompting exercise based on a user's motion recognized by the life management terminal device.

FIG. 25 is a diagram showing an example of a screen displaying a message prompting a work break based on the user's motion recognized by the life management terminal device.

FIG. 26 is a diagram showing an example of a screen for displaying a medication instruction on a mobile information terminal.

FIG. 27 is a diagram showing an example of a screen for displaying blood glucose measurement and input instructions on a mobile information terminal.

FIG. 28 is a diagram for explaining the operation of the life management system that manages the blood sugar level of the user.

FIG. 29 is a diagram for explaining the operation of the life management system that manages the user's meal intake method.

FIG. 30 is a diagram for explaining the operation of the lifestyle management system that manages the degree of relaxation of the user.

[Explanation of symbols]

1 ... Life management terminal device 2 ... Mobile phone 3 ... Server device (management server) 4 ... Portable information terminal 11 ... Biological information measuring device 12 ... Meal / motion detector 13 ... Meal detection device 14 ... Momentum detecting device 20 ... Wearable camera 21 ... Camera 41 ... Intake calorie exercise amount database 43 ... Schedule database 52 ... Meal detection unit 60 ... after meal 71 ... Wearing belt 101 ... Momentum detection unit 111 ... Photoelectric pulse wave sensor 112 ... GSR electrode 113 ... Temperature sensor 114 ... Bone conduction microphone 121 ... Acceleration sensor 122 ... Analog processing unit 123 ... CPU 124 ... Communication unit 201 ... CCD camera 202 ... Memory 203 ... Communication unit 1221 ... Microphone amplifier 1222 ... bandpass filter 1223 ... Comparator

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Hiroshi Sugiyama             1st Komukai Toshiba-cho, Sachi-ku, Kawasaki-shi, Kanagawa             Inside the Toshiba Research and Development Center (72) Inventor Miwako Doi             1st Komukai Toshiba-cho, Sachi-ku, Kawasaki-shi, Kanagawa             Inside the Toshiba Research and Development Center F-term (reference) 4C341 LL30

Claims (19)

[Claims] 1. A life management terminal device that detects that the user is eating based on information measured by the user, and the life management terminal device that detects that the user has started or finished eating. And a means for inquiring the user about meal content after a predetermined time after the detection, and a means for obtaining an answer from the user to the inquiry. 2. A life management terminal device that detects that the user is eating based on information measured by the user, and when the life management terminal device detects that the user has started eating. A life management system comprising: a means for acquiring the image; and a means for transferring the acquired image to a server that manages data. 3. The life management system according to claim 1, wherein when the life management terminal device detects that the user has finished eating, or when the user starts meal in the life management terminal device. After a predetermined time after it is detected, the user is further provided with information regarding a drug to be taken after meals, and a presentation unit for prompting the user to take the drug. Life management system characterized by. 4. The life management system according to claim 1 or 2, wherein the calorie intake of the user is recorded for each meal, and the information about the exercise amount of the user is collected, and the life management terminal. Then, when it is detected that the user has started eating, the amount of exercise of the user up to the present time,
Based on the calorie intake of the user obtained as a result of analyzing the content of the meal at each meal, and the target calorie intake predetermined by the user, advice corresponding to the current situation of the user's meal is provided. A means for presenting a message for giving, further comprising a living management system. 5. The life management system according to claim 1, wherein the means for collecting information on the amount of exercise of the user, and the drug name and ingestion of the drug taken to control the blood glucose level of the user. A means for collecting time and intake amount, the exercise amount, the drug name of the drug taken to control the blood glucose level, the intake time and the intake amount, and obtained as a result of analyzing the meal content for each meal. And means for periodically predicting a change in the blood sugar level of the user based on the calorie intake and meal time of the user, and presenting a message corresponding to the state of the user determined based on the predicted value. A life management system that is further equipped. 6. The life management system according to claim 1, wherein the life management terminal device further includes means for measuring the number of times of chewing and the chewing interval during meal of the user based on the occurrence timing. Having the number of mastications measured during the meal of the user with the life management terminal device, the masticatory interval, and the meal of the user determined based on the time from the start to the end of the meal The life management system further comprising means for presenting a message for giving advice on an intake method. 7. The life management system according to claim 1 or 2, wherein the life management terminal device determines the degree of relaxation of the user from the biological information measured when the user is eating. Life management, further comprising means for requesting, and means for delivering information for relaxing the user when the degree of relaxation requested by the life management terminal device does not reach a predetermined level. system. 8. A means for collecting information on a user's movements in the life management terminal device, a means for determining a user's operation status in the life management terminal device, a means for collecting information on a user's environment, A means for generating and presenting a message that causes the user to take an action that leads to health by using the information of 1., and a living management system. 9. A life management terminal device for detecting that the user is eating based on information measured by the user, when it is detected that the user starts or finishes eating, A life management method comprising inquiring the user about meal content after a predetermined time and acquiring the answer. 10. When a life management terminal device that detects that the user is eating based on information measured by the user is detected that the user has started eating,
A life management method characterized in that the user is prompted to transmit an image of a meal content, the image is acquired, and the meal content of the user is transferred to a management server for analysis based on the acquired image. 11. The life management system according to claim 9 or 10, wherein the life management terminal device detects that the user has finished eating, or the life management terminal device starts the user's meal. A life management method, characterized in that, after a predetermined period of time after the fact is detected, information regarding a drug to be taken by the user after eating is presented in order to encourage the user to take the drug. 12. The life management system according to claim 9 or 10, wherein the calorie intake of the user is recorded for each meal, and information on the exercise amount of the user is collected, and the life management terminal device is used. When it is detected that the user has started eating, it corresponds to the current situation of the user's meal based on the exercise amount and calorie intake of the user up to the present time and the target calorie intake predetermined by the user. A life management method characterized by presenting a message for giving advice. 13. The life management system according to claim 9 or 10, for recording calorie intake and meal time of the user for each meal, and controlling information on exercise amount and blood glucose level of the user. The drug name, ingestion time, and intake amount of the ingested drug are collected, and a change in the blood glucose level of the user is periodically predicted based on the collected information, ingested calories, and meal time, and the predicted value is A life management method characterized by presenting a message corresponding to the state of the user determined based on the above. 14. The life management system according to claim 9 or 10, further comprising a life management terminal device for detecting that the user is eating based on biometric information measured by the user, A feature is that the degree of relaxation of the user is obtained from the biological information measured while the user is eating, and when the degree of relaxation does not reach a predetermined level, information for relaxing the user is distributed. How to manage life. 15. The life management system according to claim 9 or 10, wherein it is detected that the user is eating based on the timing of the masticatory sound generated when the user eats. The management terminal device further measures the number of mastications and the masticatory interval during the meal of the user based on the occurrence timing, and starts the number of mastications and the masticatory interval and the meal measured during the meal of the user. A life management method characterized by presenting a message for giving advice on the user's dietary intake method, which is determined based on the time from the end to the end. 16. A life management terminal device collects information on a user's motion, determines the user's motion status, collects environmental information, and uses the information to cause the user to take actions that lead to health. Management method characterized by generating and presenting various messages. 17. A measuring unit for measuring at least a pulse and a skin conductivity of a user, and a unit for judging that the user is eating when the pulse rises and there is no sudden increase in the skin conductivity. A life management terminal device comprising: 18. Measuring means for measuring at least the pulse and skin temperature of the user; and means for determining that the user is eating when the pulse rises and the skin temperature does not fall sharply below a set slope. A life management terminal device comprising: 19. A unit that collects a voice including a mastication sound generated by a user eating a meal, an extraction unit that extracts a voice band of the mastication sound from the voice, and a voice signal of the extracted voice band. And means for detecting the occurrence timing, and determining from the detected occurrence timing that the user has a meal during the previous period when the audio signal is generated at a predetermined interval and continuously for a predetermined number of times. A life management terminal device characterized in that