JP2004289850A - Control method, equipment control apparatus, and program recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve problems that a complicated relation occurs when remotely controlling the equipment such as a television, there are a plurality of equipment or there are a plurality of persons, namely, that a conventional method does not include the distinction that which television is to be operated or is being operated when simultaneously operating a plurality of televisions, and that who changes a channel of the television or who is capable of changing the channel even when a plurality of persons are present in the room. <P>SOLUTION: The control method is characterized by continuously monitoring motions of the plurality of persons and controlling the equipment such as the television on the basis of the detection of a predetermined motion of a person. Concretely, on the basis of the predetermined motion of the person, candidates (3) of a controlled system and candidates (4) of control contents are determined and on the basis of the determined candidates of the controlled system and of the control contents, the controlled system and the control contents are determined (5). <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a technology for performing operations of devices and information, controlling an environment, and the like based on the movement, posture, state, and the like of a person.

  2. Description of the Related Art Conventionally, as a device that detects a human motion and operates a device, there is a device that recognizes a human gesture and operates a television (for example, see Patent Literature 1 and Patent Literature 2). In Patent Literature 1, the position of the palm of a person and a gesture are detected by a camera, and the television is operated.

In Patent Document 2, characters are input to a portable personal computer using the position and shape of a human hand detected by a camera.
JP-A-8-315154 JP-A-8-211979

  However, in the above-described conventional method, it is assumed that the operating person and the operated device are associated with each other in a one-to-one correspondence. When present, there is a problem that it is difficult to achieve a desired operation.

  In general, in homes, offices, outdoors, etc., the number of devices and people in the vicinity is often more than one, and even when controlling devices using human movements, individual people and individual It is necessary to associate devices. For example, when a plurality of televisions are operated at the same time, a distinction as to which television is operated or operated is not included in the conventional method. Further, even when a plurality of people are present in a room, there is a problem that it is difficult to distinguish who is changing the television channel and who can change the channel.

  The present invention has been made in consideration of the problems of the above-described conventional device, and determines the correspondence between devices and humans, and smoothly uses the motions, postures, states, and the like of humans even when a plurality of devices and a plurality of people are present nearby. It is an object of the present invention to provide a control method that allows a user to operate a device or the like.

  The present invention monitors the attributes of a plurality of people, detects the attributes of individuals registered in advance from the attributes of the monitored plurality of people, determines the target person using the detected attributes of the individuals, This is a control method of controlling a predetermined control target among a plurality of devices using a predetermined attribute regarding a detected individual.

  Further, the present invention is a medium holding a program for causing a computer to realize all of the above steps in the control method of the present invention, and is a program recording medium that can be processed by a computer.

  The present invention also provides a monitoring unit that monitors attributes of a plurality of persons, detects an attribute of an individual registered in advance from the attributes of the monitored plurality of persons, and uses the detected attribute of the individual to perform an object. A device control device comprising: a selection unit that determines a person; and a control unit that controls a predetermined control target among a plurality of devices using a predetermined attribute related to the detected individual.

  In addition, the present invention detects an attribute of an individual registered in advance from the attributes of a plurality of persons monitored by a monitoring unit that monitors the attributes of a plurality of persons, and uses the detected attribute of the individual to determine a target person. And a control unit that controls a predetermined control target among a plurality of devices by using a predetermined attribute related to the detected individual.

  As is evident from the above description, the present invention provides the most important problem in smoothly operating devices and information using the attributes of a person, the presence of a plurality of people, the presence of a plurality of devices, Considering the ambiguity of the movement and posture of the device, the advantage that it is possible to control the equipment smoothly by using the everyday attributes of the person without forcing the person to perform a complicated operation that is predetermined in advance. Have.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a first embodiment of the present invention. In FIG. 1, reference numeral 1 denotes a monitoring unit, 2 denotes an operator selection unit, 3 denotes a control target candidate determination unit, 4 denotes a control content candidate determination unit, and 5 denotes a control target / control content determination unit.

  In FIG. 1, a monitoring unit 1 continuously monitors the attributes of a person and the environment around the person. The attributes of a person include the position of the person, the posture of the person, the face of the person, the expression of the person, the gaze of the person, the direction of the head of the person, the movement of the person, the sound of the person, the physiological state of the person, and the specific individual , Monitor the person's body type, the person's weight, the person's gender, the person's age, the person's mental and physical inconvenience, the person's accessory, etc. Here, the mental and physical inconvenience includes visual inconvenience, limb inconvenience, utterance inconvenience, hearing inconvenience, and language understanding inconvenience. Examples of the accessory include clothes, hats, glasses, bags, footwear, and the like.

  As a means for monitoring, a camera (one having sensitivity to visible light, infrared light, and the like), a microphone, a pressure sensor, an ultrasonic sensor, a vibration sensor, a chemical sensor, an optical sensor, and the like are used. Still other sensors may be used. By using a camera, it is possible to monitor a person's position, a person's posture, a person's face, a person's facial expression, a person's movement, a person's body type, a person's accessory, and the like without contact.

  When monitoring the position of a person with a camera, the area where the flesh color exists in the image is defined as the position where the person exists. In addition, the skin color region and the region where the color or brightness of the image changes may be set as the position where a person is present, or an infrared image is used in combination, and the wavelength 3 to 5 μm or 8 to mainly emitted by a person is used. The area where the infrared ray of 12 μm is detected may be set as the position where the person exists. When monitoring the posture of the person, the body shape of the person, and the movement of the person with a camera, the approximate shape of the person is extracted by using the same method as the detection of the position of the person, and the posture and the body shape are monitored from the shape. The movement is monitored by monitoring the temporal change of the posture.

  As the posture, for example, standing, sitting, or distinguishing whether the hand is extending in which direction, a typical shape of each posture is registered in advance and compared with the registered contents. It is possible to judge. When monitoring a person's face, a person's expression, a person's head orientation, and a person's gaze with a camera, the head located at the top of a person's body is detected from the shape of the person, and the facial expression is detected. Can be monitored by comparing the image with a face image including various expressions registered in advance. The direction of the person's head and the direction of the line of sight can be determined by detecting the position of the eyes from the image of the head detected in the above procedure. If the positions of both eyes are symmetrical with respect to the head, the head is facing the front with respect to the camera. It can be determined that it is facing left or right. The position of the eyes can be detected by detecting an elliptical or flat shape in the face area and a dark area in the face area. Further, the line of sight can be detected by detecting the circular region of the iris in the eye, and by detecting the difference between the center of the circular region and the center of the entire eye region. When a person's accessory is detected by the camera, it can be determined that there is an accessory for a body part that detects a color different from the color of a person without clothes in the area of the person detected in the above procedure. Also, it is possible to make a determination by registering an accessory having a specific color in advance. Regarding the glasses, when the face area and the position of the eyes are detected in the above procedure, it can be determined whether or not there is a frame shape around the eyes. In addition, by using a microphone, it is possible to contactlessly monitor a human voice, a sound (a sound of a hand or a finger, a sound of a foot, etc.) generated by a motion of the human. Further, it is also possible to measure a physiological state such as a heart sound from the position of approach or contact. In addition, it is possible to monitor the contact due to the movement of a person by using a pressure sensor, and to monitor the weight and the walking pattern by using a pressure sensor installed on the floor. Further, by using an ultrasonic sensor, it is possible to monitor the distance to a person and the movement of the person due to a change in the distance to the person. When using ultrasonic waves, it is possible to monitor the position of a person even when the illumination fluctuates greatly or without illumination.

  In addition, by using a vibration sensor, it is possible to monitor vibrations caused by human movement. In addition, use chemical sensors that measure the amount of chemical substances such as secretions, excreta, and body fluids in the body, such as sugars and hormones, and optical sensors that measure the spectral distribution of light transmitted through the body. It is possible to monitor the physiological condition with. Also, based on information such as facial features and body movements obtained by the camera, voice features obtained by the microphone, and weight obtained by the pressure sensor, being a specific individual, gender of a person, It is possible to estimate the age, the degree of mental and physical inconvenience of a person, and the like. For example, by registering in advance the facial features, weight, body type, gender, age, and mental and physical inconvenience of a specific individual, if an individual is identified using any of the characteristics (for example, weight), Other characteristics, such as gender, are also known.

  In addition, by using a plurality of cameras having different visual fields, it is easy to three-dimensionally capture the position, posture, and movement of a person, and the monitoring accuracy is improved, and the place where monitoring can be performed can be widened. Similarly, by combining a plurality of sensors having different properties, the accuracy and reliability of detecting the position, posture, and movement of a person can be improved.

  It should be noted that the monitoring of the human and surrounding environment may be intermittent, and when there is little change in the attributes of the human or in the case of a control object that does not require high-speed control, intermittent monitoring is performed to perform a series of control processing. The amount of processing can be reduced, and the effects of reducing computational resources and energy consumption can be obtained.

  In FIG. 1, an operator selecting unit 2 selects an operator based on the result monitored by the monitoring unit 1. Here, it is assumed that the monitoring unit monitors three persons. The operator selection unit 2 selects one of the three persons based on the attribute of the predetermined person monitored by the monitoring unit 1. Selecting a person based on a predetermined attribute means that a person is present at a position closest to a predetermined position (for example, the center of a room, etc.), or has performed a predetermined posture or action (for example, raising a hand). The highest priority person (such as weight, gender, age, physiological condition, mental and physical inconvenience) based on the priority of the person or the predetermined person (for example, father, mother, and child in a family). May be prioritized, etc.), specific words (e.g., "high" or device name, etc.), or specific incidental objects (e.g., holding a red ball in your hand) This is to select a person who has, or a person who is looking or heading to a specific position (for example, a figurine). The operator selection unit 2 obtains an evaluation value for each person based on an evaluation method predetermined based on the attribute of the person, and selects a person whose evaluation value is equal to or more than a certain reference value and has the highest evaluation value. You may make it. In this case, it is possible to consider attributes of various people at the same time. As the evaluation method, for example, a weighted sum of the intensity of the voice uttered “high” and the speed of the raised hand can be used as the evaluation value.

  Next, the operator selection unit 2 presents information about the selected person. For example, if the name of the selected person can be identified, the name of the selected person is displayed on the display, the name is output by voice, or the music, sound, or name associated with the individual in advance is output by sound. Alternatively, a symbol or character previously associated with an individual may be displayed on a display, or a signal may be transmitted to a device attached to each individual in advance. The accessory device that has received the signal can notify the individual of information by vibrating, outputting light, or outputting sound. Further, the lighting may be directed at the selected person, the device such as a display may be rotated to aim at the selected person, or an image of the selected person captured by a camera may be displayed on the display. In addition, the information of the selected person is presented to the selected person only by outputting "what" sound or outputting sound or light immediately after the person's utterance or action. You can also.

  In the above example, the operator selection unit 2 selects one of the three persons, but a plurality of persons (two persons or the like) may be selected, or a person may be selected when a predetermined attribute cannot be observed. It is not necessary.

In FIG. 1, reference numeral 3 denotes a control target candidate determination unit which determines a control target candidate based on a predetermined attribute of a person selected by the operator selection unit 2 and an environment around the selected person. Devices to be controlled include air conditioners, televisions, videos, electric lights, washing machines, personal computers, game machines, pet robots, etc. in the home.
Outside homes, such as elevators and cars, and information and display contents (such as characters and figures displayed in the display) handled by information devices are targeted. As the predetermined attribute of the selected person, a pointing posture by a finger, a line of sight, or a head, utterance of a specific word, sign language operation, holding a specific object in a hand, and the like can be used. In the case of using a pointing posture by a finger, a line of sight, or a head, the display content of a device or a display existing in the vicinity of the pointing is set as a control target candidate. As the environment around a person, temperature, humidity, illuminance, sound volume, airflow state, concentration of a specific gas in air (such as carbon dioxide concentration), time, and the like can be used. When the indoor temperature or humidity is high, an air conditioner, a fan, a dehumidifier, or the like is set as a control target candidate as a control target. When the illuminance in the room is low or at a specific time (time before sunset), the lighting is set as a candidate for the control target. When there is no change in the airflow for a long time or when the concentration of carbon dioxide in the air exceeds a reference value, a ventilation fan or a window is set as a control target. If the sound outside the room exceeds the reference value, the TV or window is set as the control target.

  It should be noted that there may be a plurality of these candidates or one. For example, when the air conditioner and the television are present in the direction in which the person selected as the operator points, both are controlled. When using the utterance of a word or a sign language operation as a predetermined attribute, the name of the device may be indicated or a predetermined word may be used. For example, speaking of "television", television (or a plurality of televisions may be present) is a candidate for control, and "hot" is a fan and air conditioner as candidates for control. When using a specific object in the hand as a predetermined attribute, the device and the object are associated in advance, the red ball is associated with the air conditioner, the blue ball is associated with the TV, and the blue ball is obtained. Thus, the television is set as a candidate for the control target.

  Next, the control target candidate determination unit 3 presents information about the determined control target candidate to the outside. For the information presentation, the name representing the control target may be output by voice or sound, or the name representing the control target may be displayed on a display. Further, a light provided on the device itself to be controlled may be turned on, or sound or voice may be output from a speaker provided on the device itself as the control target candidate.

  In FIG. 1, a control content candidate determination unit 4 determines control content candidates based on a predetermined attribute of a person selected by the operator selection unit 2 and an environment around the selected person. The control contents include turning on / off the switch of the device, changing the operation parameters of the device (volume, air volume, wind direction, channel, light amount, etc.), opening and closing doors and windows, and opening and closing the information device display. Objects to be moved, deformed, changed colors, and edited documents are controlled.

  As the predetermined attribute, by instructing the control content by voice or sign language (for example, "ON" when turning on the switch, "OFF" when turning off the switch, or "Hot" A predetermined operation may be associated with the control content (for example, a switch is turned on when the hand is hit once, and a switch is turned off when the hand is hit twice). Note that there may be a plurality of candidates or one candidate. For example, when the person selected as the operator utters “up”, increasing the volume of the television, increasing the set temperature of the air conditioner, or moving an object to be displayed on the display of the information device to the information are candidates. Things are candidates.

  As the environment around a person, temperature, humidity, illuminance, sound volume, airflow state, concentration of a specific gas in air (such as carbon dioxide concentration), time, and the like can be used. When the indoor temperature and humidity are high, the control contents may include switching on an air conditioner, a fan, a dehumidifier, or the like, and increasing the operation intensity, and the like.

  When the illuminance in the room is low or at a specific time (time before sunset), turning on the light or increasing the light amount are candidates for the control content. When there is no change in the airflow for a long time or when the concentration of carbon dioxide in the air exceeds the reference value, switching on the ventilation fan and opening the window are candidates for the control contents. If the outdoor sound exceeds the reference value, increasing the volume of the television and closing the window are candidates for the control content.

  Next, the control content candidate determination unit 4 presents information on the determined control content candidate. For the presentation of the information, the name representing the control content may be output by voice or sound, or the name representing the control content may be displayed on a display.

  In FIG. 1, a control target / control content determination unit 5 determines a control target and a control content from a control target candidate determined by the control target candidate determination unit 3 and a control content candidate determined by the control content candidate determination unit 4. Is determined, and the determined control is performed on the determined control target. Here, the control target and the control contents are specified from the control target candidates and the control contents candidates by limiting the candidates as follows. For the limitation of the candidates, only a predetermined combination among the combinations of the control target candidate and the control content candidate is adopted. For example, if the control target candidates are a TV and an air conditioner, and the control content candidate is “raise the temperature”, there is no control content for raising the temperature for the TV, and there is no control content for raising the temperature for the air conditioner. In some cases, the air conditioner is set as a control target, and increasing the set temperature of the air conditioner is set as the control content. In addition, as a limitation of the candidate, when the air conditioner is a control target candidate based on the instruction operation of a person and the candidate of the control content is to raise the temperature of the air conditioner based on the utterance of “raise” by the person, the instruction operation is performed. If the time interval between the monitored time T1 and the time T2 when the "raise" utterance is monitored is equal to or longer than a reference value (for example, 3 seconds), the control object and the control content are not selected. Similarly, when the time T2 is earlier than the time T1, the control object and the control content are not selected. Thus, the candidates can also be limited by considering the time interval and the order between the time T1 and the time T2. As a result, it is possible to reduce the rate of misjudgment or the like due to the combination of the accidental instruction operation and the words in the accidental conversation. Further, even when the duration of the instruction operation is less than a reference (for example, 1 second or longer), the control target is not selected. This makes it possible to reduce the ratio of erroneous determination when the same operation as the instruction operation is accidentally performed in the daily operation. Note that when there is no need to perform the limitation (for example, when the number of candidates is one, or when a plurality of control targets are simultaneously controlled), the limitation may not be performed.

  Next, the control target / control content determination unit 5 presents information on the determined control target and control content. The presentation of the control target and the presentation of the control content are the same as the presentation of the control target candidate and the presentation of the control content candidate.

  In addition, the control target / control content determination unit 5 may present an instruction for confirmation, an instruction for re-input, a choice of a candidate, or information such as a determination that the target cannot be determined. The confirmation instruction is for confirming the execution of the determined control target and the control content, and may be an utterance such as “Is it OK?”, A display on a display, or a predetermined sound. The instruction to re-enter or to indicate that the object cannot be determined prompts the user to input again when it is difficult to determine the control target and control details (such as when the predetermined attribute of the person is ambiguous). , An indication on a display, or a predetermined sound may be output. When there are a plurality of control options and control contents, the options are displayed on a display or the like to prompt the user to make a selection.

  Further, the monitoring unit 1 monitors the attributes of the operator after the control target / control content determination unit 5 presents the information, and the control target / control content determination unit 5 determines the control target candidate and the control content candidate. Is limited, the control target and control contents are determined, and information is presented again. The reduction of the control target and the control content based on the presentation of the information and the monitoring of the attribute of the person after the presentation may be repeatedly performed. By repeating the process, the number of candidates can be reduced. As the attribute of the operator after the control target / control content determination unit 5 presents the information, in the case of confirmation of execution, the control of the control target is executed by monitoring an utterance such as “high”. I do. When a candidate option is presented on a display, a number is assigned to the option, and the control is performed on the control target by monitoring the utterance representing the number. Note that the control target candidate determination unit 3 and the control content candidate determination unit 4 described above may prompt the selection of the candidate. In this case, since a person selects a specific target and content from the candidates, the control target / control content determination unit 5 determines the control target and control content based on the selection action.

  The operation of the thus configured first embodiment of the present invention will be described. It is assumed that there are three people A, B, and C in the room, and an air conditioner, a television, and a fan exist in the room. The monitoring unit 1 continuously monitors the attributes of the person and the environment around the person. Here, when A and B point to the television, the operator selection unit 2 sets B, which pointed to the television earlier in time, as the operator, and outputs the name of B as a voice. As a result, it is possible to know that A cannot operate and B can operate, and even a plurality of persons can control the apparatus without confusion.

  The presentation of the information of the operator performed by the operator selection unit 2 includes not only outputting the name of B by voice, but also displaying the name of the selected person on a display, and displaying music, sounds, and names previously associated with the individual. A sound may be output, a symbol or character previously associated with an individual may be displayed on a display, or a signal may be transmitted in advance to a device attached to each individual. The accessory device that has received the signal can notify the individual of information by vibrating, outputting light, or outputting sound. Further, the lighting may be directed at the selected person, the device such as a display may be rotated to aim at the selected person, or an image of the selected person captured by a camera may be displayed on the display. In addition, the information of the selected person shall be presented only to the selected person by outputting a sound "what" or outputting a sound or light immediately after the person's utterance or action. You can also. In this way, by notifying the selected operator to a person, it is possible to know who can perform the operation, and it is possible to prevent confusion even when a plurality of people try to perform the operation.

  The control target candidate determination unit 3 determines a control target candidate based on a predetermined attribute of the person selected by the operator selection unit 2 and an environment around the selected person. When the TV and the air conditioner are present in the vicinity of the direction in which B points the finger, the TV and the air conditioner are determined as control target candidates. Even when the air conditioner is slightly away from the direction pointed by B, if the room temperature is high as the surrounding environment, it is included as a candidate for control. Next, the control target candidate determination unit 3 presents information on the determined control target candidate. For the information presentation, the name representing the control target may be output by voice or sound, or the name representing the control target may be displayed on a display. Further, a light provided on the device itself to be controlled may be turned on, or sound or voice may be output from a speaker provided on the device itself as the control target candidate. By presenting the information of the control target candidate, the operator can confirm whether or not the desired target is included in the candidate. Further, by selecting a plurality of candidates, it is possible to more surely include the control target to be originally selected in the candidates.

  The control content candidate determination unit 4 determines control content candidates based on a predetermined attribute of the person selected by the operator selection unit 2 and an environment around the selected person. If B utters “strong” at the same time as pointing the finger, the control candidates are determined as control candidates such as strengthening the wind, increasing the cooling capacity, increasing the heating capacity, and increasing the lighting. .

  Next, the control content candidate determination unit 4 presents information on the determined control content candidate. For the presentation of the information, the name representing the control content may be output by voice or sound, or the name representing the control content may be displayed on a display. By presenting the information of the candidate for the control content, the operator can confirm whether or not the desired target is included in the candidate. Further, by selecting a plurality of candidates, it is possible to more surely include the control contents to be originally selected in the candidates.

  When the number of control target candidates and control content candidates is large, it is not always necessary to present all information.

  The control target / control content determination unit 5 determines a control target and control content from the control target candidate determined by the control target candidate determination unit 3 and the control content candidate determined by the control content candidate determination unit 4, The determined control is performed on the determined control target. Here, as one of the methods for determining the control target and the control content from the control target candidate and the control content candidate, there is a method described below. That is, only predetermined combinations among combinations of control target candidates and control content candidates are adopted. In the above case, the TV and the air conditioner are candidates for the control target, and the candidate for the control content is to control the TV in four cases of strengthening the wind, increasing the cooling capacity, increasing the heating capacity, and increasing the lighting. Since the air conditioner cannot be combined with the content candidate, the air conditioner is set as a control object, and the control contents that can be combined with the air conditioner are limited to candidates for strengthening the wind, enhancing the cooling capacity, and increasing the heating ability. Further, by monitoring the temperature and the season as a human environment, when the temperature exceeds 30 degrees Celsius or in summer, it is possible to eliminate the need to increase the heating capacity as a control content. In addition, by recording the history of individual control in the past in advance, it is also possible to eliminate a combination of a control target that has not been controlled in the past and a control content.

  As described above, the control target / control content determination unit 5 determines the control target and the control content based on the control target candidate and the control content candidate and the surrounding environment, respectively, so that the control target / control content determination unit 5 can determine only the attributes of the predetermined person. Even when it is difficult to specify the control target or the control content alone, the control target or the control content can be specified more reliably. In particular, when using human attributes that include ambiguity, such as human motion or posture, it is difficult to make a judgment even with high-precision recognition. It is possible to select a desired control target or control content using the daily motion and posture of the person without forcing the person to perform a small number of operations.

  Next, the control target / control content determination unit 5 presents information on the determined control target and control content. The presentation of the control target and the presentation of the control content are the same as the presentation of the control target candidate and the presentation of the control content candidate. By presenting information on the control target and the control content, the operator can confirm whether or not the desired control target and control content are selected.

  Alternatively, the control target / control content determination unit 5 presents an instruction for confirmation, an instruction for re-input, a choice of a candidate, and information indicating that the target cannot be determined. The confirmation instruction is for confirming the execution of the determined control target and the control content, and may be an utterance such as “Is it OK?”, A display on a display, or a predetermined sound. By performing the confirmation, erroneous control can be prevented. In addition, the instruction of re-input and the indication that the target cannot be determined will prompt the user to input again when it is difficult to determine the control target and the control details, such as saying "Please enter again" or displaying on the display. Alternatively, a predetermined sound is output, or options are displayed on a display or the like, and the user is prompted to make a selection again. In the above case, it is urged to give an instruction again by voice as to whether to increase the airflow or the cooling capacity of the air conditioner. Therefore, the monitoring unit 1 monitors the attributes of the operator after the control target / control content determination unit 5 presents the information, and the control target / control content determination unit 5 determines the control target candidate and the control content candidate. Is limited, the control target and control contents are determined, and information is presented again. In the above case, when the person utters “wind”, the control target / control content determination unit 5 determines that the control content should be increased by the air conditioner, and presents the voice to increase the air conditioner by voice. Send a control signal to the air conditioner. The reduction of the control target and the control content based on the presentation of the information and the monitoring of the attribute of the person after the presentation may be repeatedly performed. By repeating this, it is possible to reduce the number of candidates without making an erroneous determination.

  In this way, if the control target or control content cannot be determined, the user is instructed to input again, thereby preventing erroneous determination due to forced determination and allowing ambiguity in attributes such as human motion and posture. However, it is possible to smoothly control devices and information using attributes such as human motion and posture.

  In the above description, the voice is used as the attribute of the person when monitoring the input again from the person, but another attribute (specific operation) and a combination thereof may be used. For example, when the control target and the control content determined by the control target / control content determination unit 5 are presented to urge a person to confirm, the person may make a round shape with his / her arm, hand, or finger (see FIGS. 9 (1) to 9 (4)). )) And the operation of raising the thumb (see FIG. 9 (5)), the control target / control content determination unit 5 determines the presented content as the control target and the control content. Also, when a person makes an X shape with his / her arm or finger (see FIGS. 9 (6) and (7)) or shakes his hand (see FIG. 9 (8)), the control target / control contents are determined. The unit 5 does not adopt the presented content as a control target or control content, and prompts a person to input again.

  In the above description, the pointing operation or posture is used as the attribute of the person when determining the operator and the control target candidate, but another attribute (such as another instruction operation or instruction such as gaze, head direction, or voice) is used. Motion / posture other than motion) and a combination thereof. For example, considering the position of a person as the attribute of the person, it is possible to prevent a person who is not involved in the operation of the television, such as a person in the next room, from being mistakenly selected by the operator. In addition, by using the posture of a person as an attribute, for example, a person who is sitting can be prioritized, and it is possible to prevent a person who accidentally passed a room from erroneously judging an accidental movement. In addition, by using the face / expression of a person, being a specific individual, and the age of a person as attributes of the person, it is possible to restrict the use of the television in advance or the inappropriate operation of the television from the target of the operator. It is also possible to remove it (for example, children cannot operate after 9 o'clock at night). In addition, by using the degree of mental and physical inconvenience of a person, the gender of a person, and the physiological state of a person as attributes of a person, priority is given based on the degree of mental and physical inconvenience of the person, the gender of the person, and the physiological state of the person. Can be operated. In addition, by using an accessory attached to a person, a normal thing can be given a meaning like a remote control (for example, having a red ball means a television). The user can select a television with his / her favorite operation, and at the same time, can visually indicate the priority of television operation among multiple persons (who takes the red ball first).

  In addition, by combining a plurality of attributes (such as voice and line of sight), it is possible to operate a device without imposing a burden on a person without forcing a specific operation. For example, by simultaneously combining (speaking “TV”) and gaze (looking at the direction of the TV), it is possible to prevent an erroneous reaction to an accidental action (speaking “TV” during a conversation).

  The operator can also be appropriately selected according to the combination of the attribute of the person and the surrounding environment. For example, if you want to operate a ventilation fan, or if you want to monitor the concentration of a specific gas in the air (such as carbon dioxide concentration) as the environment around a person, you need to be sensitive to the individual's environment in advance (for those who have a headache if the concentration of carbon dioxide is high). ) Can be preferentially selected as the operator of the ventilation fan. In the case of air conditioner operation, etc., the surrounding environment of the person is monitored for temperature, humidity, airflow, etc., and the sensitivity to the personal environment (hot, cold, dry skin, etc.) By registering (1), when the temperature and humidity are high and the indoor airflow is small, the person who is hot can be preferentially selected as the air conditioner operator. In addition, if the user wants to control the volume of the television or if the outdoor sound is loud as the environment around the person, the operator of the television preferentially prioritizes the sensitivity to the personal environment (such as a person who cannot easily hear the sound). Can also be selected. Also, when you want to change the brightness of the lighting, monitor the illuminance inside and outside the room as the environment around the person, and prioritize the sensitivity to the personal environment (such as people who are difficult to read characters in darkness). Can also be selected. Further, when monitoring the time as a surrounding environment, it is possible to limit the use time according to the individual. For example, it can be realized that the child is not allowed to operate the television after 9 pm.

  Similarly, in the above description, the voice is used as the attribute of the person when determining the control content candidate, but another attribute (other motion or posture) and a combination thereof may be used. For example, by using an action as an attribute of a person, the device can be controlled in a natural manner like a dialogue with a person. Put your index finger in front of your mouth (see Fig. 10 (1)) or close your ears with your hand (see Fig. 10 (2), (3)) to reduce the volume of a TV, etc. Increasing the volume of a television or the like by an attaching operation (see FIG. 10 (4)), and temporarily stopping reproduction of a video or the like by an operation of forming a “T” shape using both hands (see FIG. 10 (5)). For example, by waving a hand and performing an operation of "bye-bye" (see FIG. 10 (6)), the user wears a switch such as a television.

  In the above description, an example is given in which the attribute for determining the control target candidate and the attribute for determining the control content candidate are different. However, both the control target candidate and the control content candidate are determined using one type of attribute. It is also possible. Examples are given below. It is assumed that there is a person in the room, and an air conditioner, a television, a fan, an air purifier, a telephone, a desk, and a bed exist in the room.

  Here, when a person puts the index finger in front of the mouth or closes his ear with his hand, the control target candidate determination unit 3 determines a television that is a device that emits sound as a candidate, and the control content candidate determination unit 4 determines the volume. The control content to be reduced is determined as a candidate. When a person picks up the telephone receiver, the control target candidate determination unit 3 determines a television that is a device that emits a sound as a candidate, and the control content candidate determination unit 4 determines a control content of decreasing the volume as a candidate. .

  Further, when a person fans his / her face or body with his / her hand (see FIG. 10 (7)) and utters a word such as “hot”, the control target candidate determination unit 3 causes the air conditioner, the window, and the fan to be related to the air conditioning control. And the control content candidate determination unit 4 determines the control content of turning on the switch, lowering the set temperature, opening the window, turning on the fan, or increasing the air volume as a candidate. Further, when a person performs an operation of pinching the nose (see FIG. 10 (8)), the control target candidate determination unit 3 determines an air purifier or a window as a candidate, and the control content candidate determination unit 4 determines “switch of the air purifier”. Is selected as a candidate. When a person speaks words such as "goodbye" and "bye" during a call, the control target candidate determination unit 3 determines a telephone as a candidate, and the control content candidate determination unit 4 determines a control content of disconnecting the telephone line. To be determined. When a person sits at a desk and opens a book or holds a writing instrument, the control target candidate determination unit 3 determines room lighting and lighting accompanying the desk as candidates, and the control content candidate determination unit 4 switches Is determined as a candidate. When a person sleeps on the bed for a certain period of time or more, the control target candidate determination unit 3 determines room lighting as a candidate, and the control content candidate determination unit 4 determines control content of switching off as a candidate. When a person holds his hand or object over his / her eyes to block the light (see FIG. 10 (8)), makes a glare-like expression, or utters the word “dazzling,” the control object candidate determination unit Reference numeral 3 designates room lighting as a candidate, and the control content candidate determination unit 4 determines control content such as "darken the lighting" or "switch off" as a candidate.

  As described above, in the first embodiment of the present invention, it is possible to smoothly control devices by using daily attributes of a person without using a remote controller or the like. Further, even when there are a plurality of persons and control devices, it is possible to reduce erroneous determinations and perform control without performing complicated instruction operations.

  FIG. 2 is a block diagram showing a second embodiment of the present invention. In FIG. 2, the configuration and the operation of each unit are the same as in the first embodiment. However, in the second embodiment, when the monitoring unit 1, the operator selection unit 2, the control target candidate determination unit 3, the control content candidate determination unit 4, and the control target / control content determination unit 5 are attached to the control target device. Is shown. For example, when each unit is built in the television itself, the control target candidate determination unit 3 determines only whether or not the television is a candidate. The control content candidate determination unit 4 sets channel switching as a control content candidate based on, for example, the utterance of “channel switching” as a predetermined attribute of a person. Since the switching exists, the channel is switched.

  As described above, in the second embodiment of the present invention, in addition to the effects of the first embodiment, each device determines that the control target candidate determination unit 3 determines only whether the device is selected. Therefore, it is possible to reduce the processing amount for determining the control target candidate as compared with the first embodiment. Further, there is an advantage that even if the position of the device itself is freely moved, it is not necessary to change the process of determining the control target candidate of the device itself.

  FIG. 3 is a block diagram showing a third embodiment of the present invention. In FIG. 3, the configuration of each of the control target devices 1, 2, and 3 and the operation of each unit are the same as those of the control target device of the second embodiment (the control targets 1, 2, and 3 each include, for example, a television, an air conditioner, and a fan, respectively). Means). However, in the third embodiment, there are a plurality of control target devices, the monitoring unit 1 outputs the monitored contents to the communication network, and the operator selecting unit 2 outputs the attribute information of the selected person to the communication network. Then, the control target candidate determination unit 3 outputs information on the determined candidate for the control target (whether or not the device to which the device belongs is a candidate and the degree of the candidate) to the communication network, and the control content candidate determination unit 4 determines The control information thus output is output to the communication network, and the control target / control content determination unit 5 outputs the control target / control content information to the communication network.

  On the other hand, the operator selection unit 2 selects an operator based on the information obtained from the communication network and the information of the monitoring unit 1 and presents the information of the operator, and the control target candidate determination unit 3 selects the information obtained from the communication network. And a control target candidate is determined based on the information of the monitoring unit, and the information of the control target candidate is presented. The control content candidate determination unit 4 determines the control content based on the information obtained from the communication network and the information of the monitoring unit. The candidate is determined and the information of the candidate of the control content is presented, and the control target / control content determination unit 5 determines the information obtained from the communication network and the control target candidate and the control content candidate determination unit 4 determined by the control target candidate determination unit 3. Presents information on the control target and the control content based on the control content candidates determined by, and controls the control target. Here, the difference from the second embodiment is that a plurality of control devices are present, so that when each device individually determines the control target and the control content, control not intended by the operator may be performed. Is a point. For example, when pointing in the middle direction between the television (control target 1) and the air conditioner (control target 2) and saying "turn on", even if only the television (control target 1) is to be operated, The switches for the target 1) and the air conditioner (the control target 2) are both turned on.

  In such a case, the candidate of the control target and the control content candidate and the information of the control target and the control content are obtained for the other control devices, so that the control target candidate and the control content candidate are similar to the first embodiment. Can be restricted. For example, the control target candidate determination unit of the television (control target 1) outputs the television to the communication network as information of the control target candidate, and the control target candidate determination unit of the air conditioner (control target 2) outputs the control target candidate information as the control target candidate information. When the air conditioner is output to the communication network, the control target / control content determination unit of the television (control target 1) determines the control target based on the candidate information of the control target of the television and the candidate information of the air conditioner obtained via the communication network. And present information. In this case, since the television and the air conditioner are both candidates, the television presents information prompting the user to input again. The control target / control content determination unit of the air conditioner (control target 2) performs the same processing. In addition to the control target candidate as information to be output to the communication network, information on the degree of control target candidate is output together (for example, the TV is 10 and the air conditioner is 5), so that the control devices 1 and 2 The control object / control content determination unit compares the degrees of control object candidates, and determines the control object candidate having a larger degree (here, the television) as the control object. Similar processing is performed by exchanging information between different control devices for control content candidates.

  In addition, by obtaining operator information from a communication network, a plurality of devices do not simultaneously react to one person's operation (pointing operation, etc.), and only the device closest to the operator is used. Can react. For example, if the operator selected by the operator selection unit of the television (control target 1) and the operator selected by the operator selection unit of the air conditioner (control target 2) obtained from the communication network are the same as described above. A procedure for determining whether the control target is the television (control target 1) or the air conditioner (control target 2) is performed. Further, if the operators are different, the television (control target 1) and the air conditioner (control target 2) can perform processing based only on the attributes of the respective selected operators. The information output by the monitoring unit of the television (the control target 1) can be used by the control target candidate determination unit, the control content candidate determination unit, and the operator selection unit of the air conditioner (control target 2). In this case, there is an effect that information (such as blind spot information) that could not be monitored with the air conditioner alone can be obtained. The information output by the control target / control content determination unit of the air conditioner (control target 2) can also be displayed on the television (control target 1). In such a case, the output means (image, sound, light, etc.) of each control device can be shared between the control devices.

  Note that the communication network may be either wired (such as one connected via a network line, telephone line, or power line) or wireless (such as one that uses radio waves, infrared rays, ultrasonic waves, or the like as a communication medium), or may be mixed. May be.

  As described above, in the third embodiment of the present invention, in addition to the effects of the first and second embodiments, each control device includes a mechanism for independently determining an operator, a control target, and control contents. Even in such a case, it is possible to smoothly control the devices based on the predetermined attributes of the person without contradiction as a whole.

  FIG. 4 is a block diagram showing a fourth embodiment of the present invention. In FIG. 4, the operation of each unit is the same as in the first embodiment. However, in the present embodiment, the operator selection unit 2 does not exist, and control target candidates and control content candidates are determined for all persons. For example, when there are N persons, the determination of the control target candidate and the determination of the control content candidate are performed N times (or may be performed simultaneously in parallel). The control target / control content determination unit 5 determines the control target and the control content based on the control target candidates and the control content candidates determined for all the persons, and executes the control. A majority decision or the like is used as a method of determining the control target and the control content. For example, when there are N persons, if there are more than half the persons who issue an instruction to lower the set temperature of the air conditioner, control to lower the temperature of the air conditioner is performed. If there is no inconsistency in the control objects and control contents for each person, the control contents may be simultaneously applied to the control objects determined for each person. As described above, in the fourth embodiment of the present invention, in addition to the effects of the first embodiment, it is possible to operate the device in consideration of the operations of a plurality of persons at the same time. In order to perform the same processing using the remote controller, it is necessary to always prepare the remote controller by the number of people and each person needs to operate each of them.In the present invention, instead of using a large number of remote controllers, the instructions of a plurality of people are reflected. Device control and information control become possible.

  FIG. 5 is a block diagram showing a fifth embodiment of the present invention. In FIG. 5, the operation of each unit is the same as in the fourth embodiment. However, in the fifth embodiment, it is assumed that the monitoring unit 1, the control target candidate determination unit 3, the control content candidate determination unit 4, and the control target / control content determination unit 5 are attached to a control target device (for example, an air conditioner). Is shown. With such a configuration, in the fifth embodiment of the present invention, in addition to the effects of the fourth embodiment, each device determines whether the control target candidate determination unit 3 determines whether the device is selected or not. , It is possible to reduce the processing amount for determining the control target candidate as compared with the fourth embodiment. Further, there is an advantage that even if the position of the device itself is freely moved, it is not necessary to change the process of determining the control target candidate of the device itself.

  FIG. 6 is a block diagram showing a sixth embodiment of the present invention. In FIG. 6, the operation of each unit is almost the same as in the first embodiment. However, in the sixth embodiment, the control target candidate determination unit 3 determines control target candidates for all persons, and the control content candidate determination unit 4 determines control content candidates for all persons. I do. For example, when there are N persons, the determination of the control target candidate and the determination of the control content candidate are performed N times (or may be performed simultaneously in parallel).

  The operator selection unit 2 determines an operator based on the control target candidates and the control content candidates for the N persons. The control target / control content determination unit 5 determines a control target and control content based on the control target candidate and the control content candidate for the operator selected by the operator determination unit 2.

  Even with such a configuration as the sixth embodiment of the present invention, the same effect as that of the first embodiment can be obtained. In addition, by selecting the operator after determining the candidate of the control target and the candidate of the control content, the predetermined attribute is ambiguous (for example, the instruction operation is ambiguous), and the candidate of the control content and the candidate of the control content cannot be determined. For a person, a control content candidate such as not selecting the operator and a procedure based on the control content candidate can be performed.

  FIG. 7 is a block diagram showing a seventh embodiment of the present invention. In FIG. 7, the operation of each unit is the same as in the sixth embodiment. However, in the seventh embodiment, the monitoring unit 1, the control target candidate determination unit 3, the control content candidate determination unit 4, the operator selection unit 2, and the control target / control content determination unit 5 include control target devices (for example, air conditioners and the like). ) Is attached. With this configuration, in the seventh embodiment of the present invention, in addition to the effects of the sixth embodiment, each device is controlled by the control target candidate determination unit 3 only when the device is selected. , It is possible to reduce the amount of processing for determining the control target candidate as compared with the sixth embodiment. Further, there is an advantage that even if the position of the device itself is freely moved, it is not necessary to change the determination process of the control target candidate of the device itself.

  FIG. 8 is a block diagram showing an eighth embodiment of the present invention. In FIG. 8, the operation of each section is almost the same as in the first embodiment. However, in the seventh embodiment, the control target candidate determination unit 3 determines control target candidates for all persons, and the control content candidate determination unit 4 determines control content candidates for all persons. I do. For example, when there are N persons, the determination of the control target candidate and the determination of the control content candidate are performed N times (or may be performed simultaneously in parallel). The control target / control content determination unit 5 determines the control target and the control content from the control target candidates and the control content candidates for the operator selected by the operator selection unit 2. With such a configuration as described in the eighth embodiment of the present invention, the same effect as in the first embodiment can be obtained.

  Although the first to eighth embodiments have been described assuming that the operation is performed indoors, the present invention is also applicable to equipment operation outdoors. In addition, as information operation, operation of an object on a screen, control of a screen, and the like can be applied in the same manner as device operation.

  As means for realizing the present invention, hardware, software on a computer, or both may be used in combination.

  The present invention is also a program recording medium storing a program for realizing all or a part of the operation in the control method of the present invention described above with a computer.

  In the first embodiment, the attributes of a plurality of persons are monitored, the attributes of a previously registered individual are detected from the monitored attributes of the plurality of persons, and an object is detected using the detected attributes of the individual. A control method for determining a person and controlling a predetermined control target among a plurality of devices by using a predetermined attribute regarding the detected individual.

  The second embodiment is a control method according to the first embodiment in which a control target is selected from a plurality of devices based on detection of a predetermined attribute of a target person.

  The third embodiment is a control method according to the second embodiment in which a set of control contents of a control target is selected based on detection of a predetermined attribute of a target person.

  The fourth embodiment monitors the surrounding environment of a person, selects a control target from a plurality of devices based on detection of a predetermined attribute regarding the detected individual and the monitored predetermined surrounding environment, This is a control method of the first embodiment for controlling a control target.

  The fifth embodiment is a control method according to the fourth embodiment in which a physical environment around a person is used as a surrounding environment of the person.

  In the sixth embodiment, at least one of a temperature, a humidity, an illuminance, a loudness of a sound, a state of an airflow, a specific gas concentration in the air, and a time is selected as a surrounding environment of a person. Or 5 is a control method of the present embodiment.

  The seventh embodiment is a medium holding a program for causing a computer to realize all of the steps in the control method according to any one of the first to sixth embodiments, and is capable of being processed by a computer. It is a program recording medium.

  In the eighth embodiment, a plurality of controlled objects are connected via a communication path, and among the plurality of connected controlled objects, attribute information of a person held by another controlled object or another controlled object is included. 2. The control method according to claim 1, wherein the information is obtained through a communication path, and a predetermined control target is controlled using the obtained information.

  The ninth embodiment uses a monitoring unit that monitors attributes of a plurality of persons, detects an attribute of an individual registered in advance from the attributes of the monitored persons, and uses the detected attribute of the individual. An apparatus control device comprising: a selection unit that determines a target person by using the control unit; and a control unit that controls a predetermined control target among a plurality of devices using a predetermined attribute related to the detected individual.

  The tenth embodiment detects an attribute of an individual registered in advance from the attributes of a plurality of persons monitored by a monitoring unit that monitors attributes of a plurality of persons, and uses the detected attribute of the individual to detect the attribute of the individual. An apparatus control device comprising: a selection unit that determines a target person; and a control unit that controls a predetermined control target among a plurality of devices using a predetermined attribute regarding the detected individual.

  A first form of technology related to the present embodiment is a control method for monitoring attributes of a person and controlling a device to be controlled with predetermined control contents based on the result.

  In a second aspect of the technology related to the present embodiment, the first environment related to the present embodiment is characterized in that the surrounding environment of the person is also monitored and the result is used to perform the control. It is a control method of the form.

  A third mode of the technology related to the present embodiment is the control method according to the first or second mode related to the present embodiment, wherein the monitoring is performed constantly or intermittently.

  A fourth aspect of the technology related to the present embodiment is related to the present embodiment, wherein an operator is selected first based on the monitoring result, and a control target and a control content are selected later. This is a control method according to the first, second, or third embodiment.

  According to a fifth aspect of the technology relating to the present embodiment, when the control target, the operator, or the control content cannot be determined, the fact is presented to that effect. This is a control method according to a fourth embodiment.

  In a sixth aspect of the technology related to the present embodiment, the information is presented using at least one of light, text, voice, sound, and vibration. It is a control method of a fifth mode.

  According to a seventh aspect of the technology related to the present embodiment, a control target candidate and a control content candidate are selected first based on the monitoring result, and then an operator is selected. The control method according to the first, second, or third aspect related to the present embodiment, characterized in that:

  An eighth aspect of the technology related to the present embodiment is the control method according to the first, second, or third aspect related to the present embodiment, wherein the plurality of persons exist.

  A ninth aspect of the technology relating to the present embodiment is the control method according to the first, second, third or fourth aspect relating to the present embodiment, wherein there are a plurality of the target devices. It is.

  A tenth aspect of the technology related to the present embodiment is characterized in that the monitoring result information is presented to the person, and the control is performed based on a response instruction from the person to the presentation. This is a control method according to any one of the first to ninth aspects related to the present embodiment.

  An eleventh mode of the technology related to the present embodiment is characterized in that the presented information is at least one of the candidate information of the person, the candidate device information of the target, and the control content candidate information. This is a control method according to the tenth embodiment, which is related to the present embodiment.

  A twelfth aspect of the technology relating to the present embodiment is that the monitoring result information is merely presented to the person, and the control is performed automatically. This is the control method of the first, second, or third mode described above.

  A thirteenth aspect of the technology relating to the present embodiment is characterized in that the control is performed automatically without presenting the monitoring result information to the person, This is a control method of the second or third mode.

  A fourteenth aspect of the technology related to the present embodiment provides a plurality of candidates for at least one of a person, a device, and control content as the monitoring result information, and based on the candidates, A control method according to the twelfth or thirteenth aspect related to the present embodiment, wherein the control is performed automatically.

  According to a fifteenth aspect of the technology relating to the present embodiment, the first, second or third aspect related to the present embodiment is characterized in that the control means for performing the control is incorporated in a target device. It is a control method of the form.

  In a sixteenth aspect of the technology related to the present embodiment, there are a plurality of devices in which the control means is incorporated, and various kinds of information are exchanged between the control means using a communication path. A control method according to the fifteenth aspect, wherein the control is performed on the basis of the first embodiment.

  According to a seventeenth aspect of the technology related to the present embodiment, the control means transmits the result of its own monitoring to another control means, and transmits the content obtained from the other control means through the communication path. The control method according to the sixteenth aspect, wherein the control is performed in consideration of the above.

  An eighteenth aspect of the technology related to the present embodiment is the technology according to any one of the first to seventeenth aspects related to the present embodiment, wherein the attribute of the person is an action of the person. It is a control method.

  A nineteenth aspect of the technology relating to the present embodiment is characterized in that the control aspect is to change or turn on / off a control parameter of a target device. The control method according to any one of the first to the eighteenth aspects related to the above.

  A twentieth aspect of the technology related to the present embodiment is a device that detects a motion of the person placing his / her index finger in front of his / her mouth as a predetermined motion of the person and emits a sound based on the motion. Is a target device, and the volume of the device is reduced as a change in the value of a control parameter, in the control method according to the first embodiment related to the present embodiment.

  A twenty-first aspect of the technology related to the present embodiment is a device which detects a person's closing his / her ear with his / her own hand as a predetermined operation of a person, emits a sound based on the operation, and a volume. The control method according to the first aspect, which relates to the present embodiment, characterized in that a device that controls the target device is a target device, and the volume of the device is reduced as a change in the value of the control parameter.

  A twenty-second aspect of the technology related to the present embodiment is a device that detects, as a predetermined motion of a person, the motion of the person putting his / her hand beside his / her ear, and emits a sound based on the motion. The control method according to the first aspect is related to the present embodiment, wherein a target device is a device that controls the sound volume and the control device changes the value of the control parameter to increase the sound volume of the device.

  A twenty-third form of the technology related to the present embodiment is a device that detects, as a predetermined operation of a person, an operation in which the person blows a face or a part of a body with a hand, and controls air conditioning based on the operation. And the window is a target device, and the set temperature of the device is reduced as a change in the value of the control parameter.

  A twenty-fourth aspect of the technology related to the present embodiment is to continuously or intermittently monitor the attribute of a single person or a plurality of persons, and based on the detection of a predetermined attribute of the person, the candidate of the control target and the control. The control method according to the first aspect, which is characterized by determining content candidates and determining a control target and control contents based on the control target candidates and the control content candidates.

  A twenty-fifth aspect of the technology related to the present embodiment is to continuously or intermittently monitor the attributes of a single person or a plurality of persons and the surrounding environment of the person, detect a predetermined attribute of the person, and detect the surrounding environment. Determining a control target candidate and a control content candidate on the basis of the control target candidate and the control content candidate, and determining the control target and the control content based on the control target candidate and the control content candidate. It is a control method of the first mode.

  A twenty-sixth aspect of the technology related to the present embodiment relates to the present embodiment, characterized in that at least one of temperature, humidity, illuminance, air current, time, and sound is used as a surrounding environment. This is a control method according to the twenty-fifth aspect.

  A twenty-seventh aspect of the technology related to the present embodiment is to output information obtained by the monitoring to a communication network, and / or to output control target candidates and control contents candidates to a communication network, and / or A control method according to any one of the twenty-fourth to twenty-sixth aspects related to the present embodiment, wherein an object and control contents are output to a communication network.

  A twenty-eighth aspect of the technology related to the present embodiment is that the communication network is monitored continuously or intermittently, and based on information on the communication network and detection of a predetermined attribute of a person, candidates for control objects and control contents are controlled. 27. A control method according to the twenty-seventh aspect, wherein the control method according to the present embodiment is characterized by determining candidates for

  In a twenty-ninth aspect of the technology related to the present embodiment, the communication network is monitored continuously or intermittently, and control objects and control contents are controlled based on communication network information, control object candidates and control contents candidates. Is the control method according to the twenty-seventh or twenty-eighth aspect related to the present embodiment, characterized in that:

  A thirtieth aspect of the technology related to the present embodiment is characterized in that the control target candidate is set as a control target, and the control content candidate is set as control content. 29 is a control method according to any one of the twenty-ninth aspect.

  In a thirty-first aspect of the technology related to the present embodiment, a candidate for a control target and a candidate for control content are determined for each person based on detection of attributes of a plurality of persons, and the candidate for the control target and the A control method according to any one of the twenty-fourth to thirty aspects related to the present embodiment, wherein a control target and control content are determined based on a control content candidate.

  A thirty-second aspect of the technology related to the present embodiment is characterized in that a control target and a control content are determined based on a majority decision using a candidate for a control target and a candidate for a control content determined for each person. It is a control method according to the thirty-first aspect related to the present embodiment.

  A thirty-third mode of the technology related to the present embodiment determines a candidate of an operator and a control target and a candidate of a control content based on detection of a predetermined attribute of a person, and determines the candidate of the operator and the control target. A control method according to any one of the twenty-fourth to thirty aspects related to the present embodiment, wherein a control target and a control content are determined based on a candidate and the control content candidate.

  In a thirty-fourth aspect of the technology related to the present embodiment, a candidate for a control target and a candidate for control content are determined for each person based on attribute detection of a plurality of people, and the candidate for the control target and control content are determined. Selecting the operator based on the candidate of the above, and determining the candidate of the control target and / or the candidate of the control content based on the attribute of the selected operator, the control according to the thirty-third mode related to the present embodiment, Is the way.

  In a thirty-fifth aspect of the technology related to the present embodiment, an operator is selected based on detection of a predetermined attribute of a person, and a control target candidate and a control content candidate are selected based on the selected operator attribute. A control method according to any one of the twenty-fourth to thirty aspects related to the present embodiment, characterized in that the method is determined.

  A thirty-sixth aspect of the technology related to the present embodiment is the information processing apparatus according to any one of the thirty-third to thirty-fifth aspects related to the present embodiment, which outputs information of a selected operator to a communication network. It is a control method.

  A thirty-seventh aspect of the technology relating to the present embodiment is the communication network according to any one of the above-mentioned twenty-seventh to twenty-ninth or thirty-sixth or thirty-sixth aspects related to the present embodiment, wherein a wireless and / or wired communication network is used. It is a form control method.

  A thirty-eighth aspect of the technology related to the present embodiment is a control method according to any one of the thirty-third to thirty-sixth aspects related to the present embodiment, in which a selected operator is presented as information. is there.

  A thirty-ninth aspect of the technology relating to the present embodiment is characterized in that information is presented based on a candidate for a control target and / or a candidate for control content. This is a control method of one of the forms.

  Also, a fortieth aspect of the technology related to this embodiment is a control target candidate, a control target, or a control content candidate, or a control content, or a confirmation instruction, or a re-input instruction, or a candidate option. Or the control method according to the thirty-ninth aspect related to the present embodiment, characterized by presenting at least one of the fact that the object cannot be determined.

  A forty-first aspect of the technology related to the present embodiment is characterized in that information is presented using at least one of light, characters, voice, sound, and vibration. A control method according to any one of the thirty-eighth to forty-fourth aspects.

  A forty-second aspect of the technology related to the present embodiment is based on the monitoring result of the attribute of the person after the information is presented, the reduction of the candidate of the control target and / or the reduction of the candidate of the control content, and / or the reduction of the control target. And / or the content of the control and / or the presentation of information.

  A forty-third aspect of the technology related to the present embodiment is configured to reduce the number of control target candidates and / or the number of control content candidates based on a predetermined criterion, and / or determine the control target, and / or the control content. The control method according to any one of the twenty-fourth to forty-second modes related to the present embodiment, characterized in that:

  A forty-fourth aspect of the technology related to the present embodiment is configured to reduce the number of control target candidates and / or the number of control content candidates based on the consistency between the control target candidate and the control content candidate. Alternatively, the control method according to the forty-third aspect is related to the present embodiment, in which a control target is determined and / or a control content is determined.

  A forty-fifth aspect of the technology related to the present embodiment detects a first time at which a predetermined attribute used to determine a control target candidate and a predetermined attribute used to determine a control content candidate are detected. The time interval between the second time, or the temporal sequence relationship between the first time and the second time, or using at least one or more of the duration of the predetermined attribute detection, the control target In the control method according to the forty-third or forty-fourth aspect related to the present embodiment, the number of candidates is reduced and / or the number of control content candidates is reduced, and / or the control target is determined, and / or the control content is determined. is there.

  A forty-sixth aspect of the technology related to the present embodiment is any of the above-described twenty-fourth to forty-fifth aspects related to the present embodiment, wherein the control content is to operate an apparatus and / or information. Is a control method.

  Also, a forty-seventh form of the technology related to the present embodiment includes a person's position, a person's posture, a person's facial expression, a person's movement, a person's voice, a person's physiological state, a specific individual, and a person's body type. , Wherein at least one of a person's weight, a person's gender, a person's age, a person's physical and mental inconvenience, or a person's accessory is used as a person's attribute. This is a control method according to any one of the twenty-fourth to forty-sixth aspects.

  A forty-eighth aspect of the technology related to the present embodiment is characterized in that the attribute of a person for determining a candidate for a control target is different from the attribute of a person for determining a candidate for a control content. This is a control method according to any one of the twenty-fourth to forty-seventh modes related to the present embodiment.

  A forty-ninth aspect of the technology related to the present embodiment is characterized in that the attribute of a person for determining a candidate for a control target is the same as the attribute of a person for determining a candidate for control content. The control method according to any one of the twenty-fourth to forty-seventh aspects relating to the present embodiment.

  Further, a fiftieth aspect of the technology related to the present embodiment detects an operation in which the person puts his / her index finger in front of a mouth as an attribute of the person, and controls a device that emits a sound and a volume based on the operation. A control method according to the forty-ninth aspect, wherein a device to be controlled is set as a candidate for a control target, and control for reducing the volume is set as a candidate for a control content.

  A fifty-first aspect of the technology related to the present embodiment is configured to detect, as an attribute of a person, an operation in which the person closes his ear with his / her hand, and control a device that emits a sound based on the operation and a device that controls a volume. A control method according to the forty-ninth aspect, wherein the control for reducing the volume is set as a candidate for the target and the control content is set as a candidate for the control content.

  Also, a fifty-second form of the technology related to the present embodiment is a device and a window for detecting, as an attribute of a person, an operation in which the person blows a face or a part of a body by hand, and controlling air conditioning based on the operation. The control method according to the forty-ninth aspect of the present invention relates to the present embodiment, wherein is set as a candidate for a control target, and a reduction in set temperature or ventilation is set as a candidate for control content.

  In a fifty-third mode of the technology related to the present embodiment, a device that detects a motion of the person placing his or her ear beside the hand as an attribute of the person, and that outputs a sound based on the motion and a device that controls the volume. A control method according to the forty-ninth aspect, wherein the control for increasing the volume is set as a candidate for control, and control for increasing the volume is set as a control content candidate.

  A fifty-fourth aspect of the technology related to the present embodiment is a program for realizing, with a computer, all or a part of the operation in the control method according to any one of the first to fifty aspects related to the present embodiment. Is stored in the program recording medium.

  As described above, the technology related to the present embodiment continuously or intermittently monitors the attributes of a single person or a plurality of persons, and controls a predetermined device based on the detection of the predetermined attribute of the person. A control method characterized by the following. Further, based on a predetermined attribute of a person, a control target candidate and a control content candidate are determined, and the control target and the control content are determined based on the control target candidate and the control content candidate. Is the way. Furthermore, based on the detection of the attributes of a plurality of persons, a candidate for a control target and a candidate for control content are determined for each person, and a control target and control contents are determined based on the candidate for the control target and the candidate for control content. This is a control method characterized in that:

  As is clear from the above description, the above embodiment is the most problematic in smoothly operating devices and information using the attributes of people, the presence of a plurality of people, the presence of a plurality of devices, A control method that enables smooth control of equipment by using daily attributes of a person without forcing the person to perform predetermined complicated operations, etc., taking into account the ambiguity of the person's movement and posture. It is.

  Also, based on a predetermined attribute of a person, a plurality of candidates for the control object and the control content are determined, and the number of candidates is limited by using information of both the control object candidate and the control content candidate. The control target can be specified more reliably.

  Furthermore, it is necessary to present the contents of the operator or candidate determined by the device to the human, or to prompt the user to input again when the control target or the control content cannot be determined, and to observe the attributes of the subsequent humans. And at the same time, it is possible to smoothly determine the control object and the control content.

  Further, according to the above embodiment, not only the information can be presented on the screen but also the information can be presented by voice. It can be confirmed by voice, and even for people with hearing impairments, it is possible to confirm information on the screen reliably, so it is convenient for people who are blind and those who are hearing impaired It is effective in welfare measures.

  Furthermore, by intermittently monitoring the situation, power consumption can be greatly reduced, which is effective from the viewpoint of global environmental protection.

  The control method, the device control device, and the program recording medium according to the present invention have an effect that even when a plurality of devices and a plurality of people are present in the vicinity, the device can be operated more smoothly and the like. It is useful as a technique for controlling the operation of devices and information, controlling the environment, and the like based on movement, posture, state, and the like.

1 is a block diagram illustrating an embodiment of the present invention. Block diagram showing two embodiments of the present invention Block diagram showing three embodiments of the present invention Block diagram showing a fourth embodiment of the present invention. Block diagram showing a fifth embodiment of the present invention. Block diagram showing a sixth embodiment of the present invention. Block diagram showing a seventh embodiment of the present invention. Block diagram showing an eighth embodiment of the present invention. FIG. 3 is a diagram illustrating states of a human arm and fingers according to the embodiment of the present invention. FIG. 3 is a diagram illustrating states of a human arm and fingers according to the embodiment of the present invention.

Explanation of reference numerals

1 monitoring section
2 Operator selection unit 3 Control target candidate determination unit 4 Control content candidate determination unit 5 Control target / control content determination unit

Claims (10)

  Monitor the attributes of a plurality of people, detect the attributes of the individual registered in advance from the attributes of the monitored plurality of people, determine the target person using the attributes of the detected individuals, determine the detected individual A control method for controlling a predetermined control target among a plurality of devices using a predetermined attribute related to the control device.   The control method according to claim 1, wherein a control target is selected from a plurality of devices based on detection of a predetermined attribute of the target person.   The control method according to claim 2, wherein the set of control contents of the control target is selected based on detection of a predetermined attribute of the target person.   2. The control apparatus according to claim 1, further comprising: monitoring a surrounding environment of the person; selecting a control target from a plurality of devices based on detection of a predetermined attribute related to the detected individual and the monitored predetermined surrounding environment; The control method described in the above.   The control method according to claim 4, wherein a physical environment around a person is used as a surrounding environment of the person.   The control method according to claim 4, wherein at least one of a temperature, a humidity, an illuminance, a loudness of a sound, a state of an airflow, a specific gas concentration in the air, and a time is selected as the surrounding environment of the person.   A medium storing a program for causing a computer to realize all of the steps in the control method according to claim 1, wherein the program recording medium can be processed by a computer.   A plurality of controlled objects are connected via a communication path, and among the plurality of connected controlled objects, attribute information of a person possessed by another controlled object or information of another controlled object is obtained through a communication path. The control method according to claim 1, wherein a predetermined control target is controlled using the obtained information.   A monitoring unit that monitors the attributes of a plurality of persons; and a selection unit that detects an attribute of a previously registered individual from the attributes of the monitored plurality of persons, and determines a target person using the detected attributes of the individual. And a control unit that controls a predetermined control target among a plurality of devices by using a predetermined attribute regarding the detected individual.   A selection unit that detects an attribute of an individual registered in advance from the attributes of the plurality of persons monitored by the monitoring unit that monitors the attributes of a plurality of persons, and determines a target person using the detected attributes of the person; And a control unit that controls a predetermined control target among a plurality of devices using a predetermined attribute regarding the detected individual.

Images