JP7191244B2 - air conditioning system - Google Patents

Description

The present invention relates to an air conditioning system for conditioning indoor air.

Patent Literature 1 discloses an air conditioner that displays the position of a person detected based on two-dimensional thermal image data created by a thermal image sensor and the temperature of the person's position on a display unit of a remote controller. . A person's position includes at least one of a person's face position, a person's hand position, and a person's foot position. The position of the person and the temperature of the position of the person are calculated from the information of the thermal image data.

Patent Literature 2 discloses an air conditioner that includes an imaging unit such as a camera, and obtains indoor environment information such as a person's face from an image captured by the imaging unit.

JP 2016-217886 A JP 2011-220612 A

However, in the air conditioner of Patent Document 1, even if a thermal image is displayed on the display unit of the remote controller, it is not possible to identify who the detected person is in the room from the information of the thermal image data. However, there is a problem that it is not possible to intuitively grasp the state of the room and perform the setting operation of the air conditioner. In other words, when the wind direction is set to the right on the remote controller, the thermal image displayed on the display of the remote controller indicates whether the wind direction is to the right when viewed from the air conditioner, or whether the wind direction is to the right when facing the air conditioner. It was hard to tell which way to go.

Moreover, since the air conditioner of the said patent document 2 mounts an imaging part, there existed a problem that the size of an air conditioner becomes large in order to ensure the component mounting space.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an air conditioning system capable of intuitively grasping the state of a room without increasing the size of the system.

In order to solve the above-described problems and achieve the object, the air conditioning system according to the present invention includes an air conditioner that is placed indoors to blow conditioned air into the room, and a controller that controls the operation of the air conditioner. Prepare. The air conditioner has an indoor information acquisition unit that acquires indoor information that is information about the state of the room, an air conditioner communication unit that communicates with external devices, and an air conditioner control unit that controls the air conditioning of the air conditioner. and an indoor information processing unit for extracting, from indoor information, indoor feature information, which is information indicating indoor features . The controller includes an operation unit that receives an operation setting operation of the air conditioner, an imaging unit that captures an indoor image that is an image showing the state of the room, a display unit that displays information regarding the operation of the air conditioner, and an external A controller communication unit that communicates with a device, and an image processing unit that acquires indoor information and an indoor image, superimposes at least part of the indoor information on the indoor image, and displays the image on the display unit . The image processing unit extracts the indoor image feature information, which is the feature of the indoor image, from the indoor image, and based on the indoor information, the indoor feature information, the indoor image, and the indoor image feature information, the indoor feature indicating the same part in the room. The scale of the indoor image is adjusted so that the indoor portion represented by the information and the indoor portion represented by the indoor image feature information are within a predetermined distance range in the indoor image. The indoor image is displayed on the display unit. The display unit displays at least part of the indoor information superimposed on the indoor image.

ADVANTAGE OF THE INVENTION The air conditioning system concerning this invention produces the effect that it is possible to intuitively grasp|ascertain an indoor state, without enlarging.

FIG. 1 is a configuration diagram schematically showing the configuration of an air conditioning system according to Embodiment 1 of the present invention. 1 is a functional block diagram showing the functional configuration of the air conditioner according to Embodiment 1 of the present invention; FIG. 1 is a front view showing the appearance of an indoor unit in the air conditioner according to Embodiment 1 of the present invention; FIG. 2 is a front view schematically showing a state when changing the air conditioning setting of the indoor unit in the air conditioner according to Embodiment 1 of the present invention. FIG. 2 is a perspective view showing an infrared sensor provided in the indoor unit of the air conditioner according to Embodiment 1 of the present invention; Schematic diagram showing an example of a temperature detection range in the infrared sensor according to the first embodiment of the present invention. 1 is a diagram showing an example of a hardware configuration of a processing circuit according to the first embodiment of the present invention; FIG. FIG. 1 is a front view showing an example of a controller according to Embodiment 1 of the present invention; FIG. 10 is a front view showing another example of the controller according to the first embodiment of the present invention, and is a front view showing the controller provided with a touch panel display unit; Flowchart showing the operation of the indoor unit in the air conditioning system according to Embodiment 1 of the present invention FIG. 4 is a diagram showing an example of a thermal image according to the first embodiment of the present invention; FIG. 4 is a diagram showing another example of a thermal image according to the first embodiment of the present invention; FIG. 2 is a diagram showing a storage unit inside the indoor information processing unit according to the first embodiment of the present invention; Flowchart showing operation of the controller in the air conditioning system according to Embodiment 1 of the present invention A diagram showing an example of an indoor image according to the first embodiment of the present invention. FIG. 4 is a diagram showing an example of a thermal image including a human body according to Embodiment 1 of the present invention; FIG. 4 is a diagram showing an example of a background image on which a human body area of a thermal image is superimposed according to Embodiment 1 of the present invention; FIG. 2 is an enlarged diagram showing a state in which a user's face image is superimposed on a human face portion in a thermal image according to Embodiment 1 of the present invention; FIG. 4 is a diagram showing a storage unit of the image processing unit according to the first embodiment of the present invention; A diagram showing a state in which air conditioning settings are set by operating a controller in Embodiment 1 of the present invention. A diagram showing a method of setting the room temperature in the air conditioning setting by operating the controller in Embodiment 1 of the present invention. Schematic diagram showing a method for changing set airflow information in air conditioning settings using a touch panel display unit in Embodiment 1 of the present invention.

An air conditioning system according to an embodiment of the present invention will be described in detail below with reference to the drawings. In addition, this invention is not limited by this embodiment.

Embodiment 1.
FIG. 1 is a configuration diagram schematically showing the configuration of an air conditioning system 100 according to Embodiment 1 of the present invention. FIG. 2 is a functional block diagram showing the functional configuration of the air conditioner 10 according to Embodiment 1 of the present invention. FIG. 2 shows the indoor unit 11 of the air conditioner 10 and the controller 14 in the configuration of the air conditioning system 100 .

As shown in FIG. 1, the air conditioner system 100 according to the first embodiment includes an indoor unit 11 installed indoors, an outdoor unit 12 installed outdoors, and between the indoor unit 11 and the outdoor unit 12. An air conditioner 10 configured with a refrigerant pipe 13 for circulating a refrigerant, and a controller 14 for transmitting a control instruction command for the air conditioner 10 to the indoor unit 11 are provided. The outdoor unit 12 can communicate with the indoor unit 11 via a communication line (not shown).

The air conditioner 10 forms one complete refrigeration cycle with the indoor unit 11 and the outdoor unit 12 . The air conditioner 10 uses the refrigerant circulating between the indoor unit 11 and the outdoor unit 12 through the refrigerant pipe 13 to transfer heat between the indoor air and the outdoor air, which are the spaces to be air-conditioned. and air conditioning is achieved for the room. That is, the indoor unit 11 and the outdoor unit 12 are connected by the refrigerant pipe 13, and the pressure of the refrigerant flowing through the refrigerant pipe 13 is changed by the compressor provided in the outdoor unit 12, and air conditioning is performed by heat absorption and heat dissipation of the refrigerant. conduct.

The indoor unit 11 includes an indoor information acquisition unit 21 , an indoor information processing unit 22 , an indoor unit communication unit 23 , an air conditioning control unit 24 and an air conditioning changing unit 25 . The controller 14 also includes an operation unit 31 , an imaging unit 32 , a controller communication unit 33 , an image processing unit 34 and a display unit 35 .

Each component of the air conditioner 10 will be described below. First, the components of the indoor unit 11 will be described. FIG. 3 is a front view showing the appearance of the indoor unit 11 in the air conditioner 10 according to Embodiment 1 of the present invention. FIG. 4 is a front view schematically showing how the air conditioning setting of the indoor unit 11 in the air conditioner 10 according to Embodiment 1 of the present invention is changed. The indoor unit 11 includes an indoor information acquisition unit 21, an indoor unit communication unit 23, and an air conditioning change unit 25 on the front surface.

The indoor information acquisition unit 21 acquires indoor information, which is information about the state of the room. An infrared sensor is exemplified as an example of the indoor information acquisition unit 21 . FIG. 5 is a perspective view showing an infrared sensor provided in the indoor unit 11 of the air conditioner 10 according to Embodiment 1 of the present invention. FIG. 6 is a schematic diagram showing an example of a temperature detection range in the infrared sensor according to Embodiment 1 of the present invention. In FIG. 6, the horizontal direction corresponding to the width direction of the room is the X direction, and the vertical direction corresponding to the height direction of the room is the Y direction. An infrared sensor can detect the surface temperature of a remote point, and can cover and detect the surface temperature of the entire room. That is, the infrared sensor can acquire the indoor surface temperature as indoor information.

A thermopile sensor is exemplified as an example of the infrared sensor. The thermopile sensor converts the temperature measured by the thermopile element into a format that can be transmitted to the indoor information processing unit 22 and generates temperature distribution information 61 that indicates the temperature distribution of the indoor surface temperature. The number of thermopile elements included in the thermopile sensor may be one or plural. The infrared sensor shown in FIG. 5 includes seven thermopile elements, a thermopile element 41, a thermopile element 42, a thermopile element 43, a thermopile element 44, a thermopile element 45, a thermopile element 46, and a thermopile element 47 arranged in this order in the vertical direction. installed. The infrared sensor shown in FIG. 5 detects the surface temperature from the ceiling surface of the room to the floor surface directly below the indoor unit 11 .

FIG. 6 shows a state in which an infrared sensor including thermopile elements 41 to 47 arranged in a line in the Y direction acquires temperature information on the surface temperature of the room. The monitoring areas in the room monitored by the infrared sensor to obtain surface temperature information are, in the Y direction, from the top, a monitoring range A1, a monitoring range A2, a monitoring range A3, a monitoring range A4, a monitoring range A5, a monitoring range A6 and It is divided into a monitoring range A7.

The thermopile element 41 monitors the monitoring range A1 to acquire indoor information. That is, the thermopile element 41 acquires the indoor surface temperature of the monitoring range A1. Similarly, the thermopile element 42 monitors the monitoring range A2 to obtain indoor information. The thermopile element 43 monitors the monitoring range A3 to obtain indoor information. The thermopile element 44 monitors the monitoring range A4 to obtain indoor information. The thermopile element 45 monitors the monitoring range A5 to acquire indoor information. The thermopile element 46 monitors the monitoring range A6 to obtain indoor information. The thermopile element 47 monitors the monitoring range A7 to obtain indoor information.

The indoor unit 11 includes a direction changer (not shown) that changes the direction of the infrared sensor in the X direction. The direction of the infrared sensor is the direction facing the detection target part of the surface temperature. The direction changing unit has a mechanism for driving the direction of the infrared sensor in the X direction, changes the direction of the infrared sensor in the horizontal direction, and moves the infrared sensor in the horizontal direction at regular intervals. The infrared sensor detects the surface temperature of the entire room while changing the detection target part of the surface temperature in the X direction by driving the direction changing part, and creates a temperature distribution, which is the temperature information in the room on the XY plane.

The indoor information processing unit 22 extracts, from the indoor information acquired by the indoor information acquiring unit 21, indoor feature information 63, such as indoor features and indoor conditions, which is used to grasp the indoor state. The indoor feature information 63 is information indicating indoor features. Further, the indoor information processing unit 22 can extract a human body from the indoor information acquired by the indoor information acquisition unit 21 and generate human body information as part of the indoor feature information 63 . Human body information is information about a human body, such as a person's face, hands, and feet, in indoor information. The indoor information processing unit 22 stores, for example, human body determination information corresponding to the shape and size of the human body in the human body information in advance, and compares the human body determination information with the indoor feature information 63 to determine the human body in the indoor feature information 63. can be extracted.

The indoor unit communication unit 23 is an air conditioner communication unit for the indoor unit 11 to communicate with devices outside the indoor unit 11 . The indoor unit communication unit 23 receives information transmitted from the controller communication unit 33 of the controller 14, transmits the information to the air conditioning control unit 24, and processes and transmits information and air conditioning control in the indoor information processing unit 22. The information transmitted from the unit 24 is transmitted to the controller communication unit 33 . It should be noted that the indoor unit communication unit 23 can communicate with the controller communication unit 33 mounted on the controller 14, and the communication method is not limited. Examples of communication methods between the indoor unit communication unit 23 and the controller communication unit 33 include infrared communication and wireless communication.

For example, when the communication method between the indoor unit communication unit 23 and the controller communication unit 33 is infrared communication, infrared communication in a near-infrared band with a wavelength of approximately 750 nm to 1000 nm is used. Since near-infrared light cannot pass through the walls of a room, it is used in the same room so that the infrared light emitted from the light-emitting part on the transmitting side reaches the light-receiving part on the receiving side, which is short-distance communication. There are many things. Infrared communication has a slow communication speed, but has the advantage that light-emitting members and light-receiving members are configured simply and inexpensively.

On the other hand, for wireless communication, there are various standards such as wireless LAN (Local Area Network) communication and specified low power communication. In Embodiment 1, the type of wireless system used for the communication method between the indoor unit communication section 23 and the controller communication section 33 is not limited. A wireless LAN is communication in the 2.4 GHz band that can be used universally, is a standard that is widely used including personal computers, and is versatile and capable of high-speed communication.

The air conditioning control unit 24 receives various information related to the operation of the air conditioner 10, such as information received from the indoor information processing unit 22, instruction information received from the controller 14, and information stored in advance in the air conditioning control unit 24. Based on this, the operation of the air conditioner 10 is controlled. That is, the air conditioning control unit 24 controls the air conditioning operation such as the temperature of the airflow blown into the room from the indoor unit 11 and the strength and direction of the airflow blown into the room from the indoor unit 11 based on various information related to the operation of the air conditioner 10. and control the operation of the air conditioner 10 .

The air conditioning change unit 25 changes the state of the airflow blown into the room from the indoor unit 11, that is, the direction and volume of the airflow, based on the command sent from the air conditioning control unit 24, thereby changing the air conditioning operation. . As shown in FIG. 4, the air conditioner changing unit 25 includes a first air direction changing unit 25a and a second air direction changing unit 25b having louvers for changing the vertical direction of the airflow blown into the room from the indoor unit 11, an indoor unit A third airflow direction changing part 25c having a louver for changing the horizontal direction of the airflow blown out from 11 into the room, a fan motor (not shown) for changing the strength of the airflow, and a heat exchanger (not shown) for changing the temperature of the airflow. and The third airflow direction changing portion 25c is provided inside the air conditioning changing portion 25 relative to the first airflow direction changing portion 25a and the second airflow direction changing portion 25b. The air conditioning changing unit 25 operates the first air direction changing unit 25a, the second air direction changing unit 25b, the third air direction changing unit 25c, the fan motor, and the heat exchanger based on a command from the air conditioning control unit 24. to change the air conditioning operation.

For example, when changing the airflow blown into the room from the indoor unit 11 upward, the air conditioning control unit 24 changes the directions of the first airflow direction changing unit 25a and the second airflow direction changing unit 25b of the air conditioning changing unit 25, Control for changing the wind direction from downward to upward may be performed. Further, for example, when two people are in the room and the air conditioning settings desired by each of the two people are different, the air conditioning control unit 24 changes the first wind direction changing unit 25a as shown in FIG. and the second wind direction changing unit 25b may be controlled to move independently. Here, in FIG. 4, the first wind direction changing portion 25a shows a state in which the wind direction of the airflow blown out from the indoor unit 11 into the room is directed downward, and the second wind direction changing portion 25b blows out from the indoor unit 11 into the room. It shows a state in which the wind direction of the air current is directed upward. Further, the third wind direction changing part 25c can change the wind direction to the left and right, and is composed of, for example, a plurality of fins.

Further, the strength of the airflow blown into the room from the indoor unit 11 is changed by adjusting the rotation speed of the motor of the fan provided in the air conditioner changer 25 . Also, the temperature of the airflow blown into the room from the indoor unit 11 is changed by changing the temperature of the refrigerant in the heat exchanger provided in the air conditioning changing section 25 .

Also, the air conditioning control unit 24 is implemented as a processing circuit having the hardware configuration shown in FIG. 7, for example. 7 is a diagram illustrating an example of a hardware configuration of a processing circuit according to the first embodiment of the present invention; FIG. When the air-conditioning control unit 24 is realized by the processing circuit shown in FIG. 7, the air-conditioning control unit 24 is realized, for example, by the processor 101 executing a program stored in the memory 102 shown in FIG. . Also, multiple processors and multiple memories may work together to achieve the above functions. Also, part of the functions of the air conditioning control unit 24 may be implemented as an electronic circuit, and other parts may be implemented using the processor 101 and the memory 102 .

Also, at least one of the indoor information processing section 22 and the indoor unit communication section 23 may be realized by the processor 101 executing a program stored in the memory 102 as well. Further, the processor and memory for realizing at least one of the indoor information processing unit 22 and the indoor unit communication unit 23 may be the same as the processor and memory for realizing the air conditioning control unit 24, or may be different. processor and memory.

Next, the constituent parts of the controller 14 will be described. As shown in FIG. 2 , the controller 14 includes an operation section 31 , an imaging section 32 , a controller communication section 33 , an image processing section 34 and a display section 35 . FIG. 8 is a front view showing an example of the controller 14 according to Embodiment 1 of the present invention. Note that the controller 14 shown in Embodiment 1 is a remote controller separate from the indoor unit 11 .

The operation unit 31 accepts a setting operation for air conditioning settings requested by the user. That is, the operation unit 31 is an interface for remotely controlling the operation of the air conditioner 10, and receives operation setting information for setting the operation of the air conditioner 10, which is an instruction on the operation of the air conditioner 10 from the user. . The operation unit 31 is used to start the operation of the air conditioner 10, stop the operation of the air conditioner 10, select the operation mode of the air conditioner 10, change the set temperature, change the set humidity, set the air volume, set the wind direction, and operate. It is configured so that the user can arbitrarily select various functions related to the air conditioning operation of the air conditioner 10, such as setting changes to prohibited items. The operation unit 31 can also set information such as date and time. The operation unit 31 transmits various received information to the controller communication unit 33 and the image processing unit 34 . The operation unit 31 of the controller 14 can be a button-type operation unit as shown in FIG.

The image capturing unit 32 is a device such as a camera that captures a visible image, and captures the interior of the room, which is the space to be air-conditioned, to generate an indoor image that is an image representing the state of the interior of the room. The mounting position in the controller 14 is not limited as long as the imaging unit 32 can photograph the interior. The imaging range of the imaging unit 32 is preferably wide-angle so that a wide indoor area can be photographed.

The controller communication unit 33 receives instruction information for remotely controlling the operation of the air conditioner 10 from the operation unit 31 . The controller communication section 33 transmits the instruction information received from the operation section 31 to the indoor unit communication section 23 of the indoor unit 11 . Also, the controller communication unit 33 receives various information from the indoor unit communication unit 23 of the indoor unit 11 . The controller communication section 33 transmits the received information to the image processing section 34 . In addition, the controller communication part 33 should just be able to mutually communicate with the indoor unit communication part 23 mounted in the indoor unit 11, and the communication method is not ask|required. For the controller communication unit 33, wireless LAN communication in a band of 2.4 GHz is often selected because it can handle image communication with a large amount of data.

The image processing unit 34 transmits various types of information regarding the operation of the air conditioner 10, such as information transmitted from the indoor unit 11, setting information transmitted from the operation unit 31, and information on the indoor image captured by the imaging unit 32, to the user. Perform processing for visualization to show. The image processing unit 34 causes the display unit 35 to display the indoor image captured by the imaging unit 32 as a background image. Further, the image processing unit 34 superimposes at least part of the indoor information transmitted from the indoor information processing unit 22 on the background image and causes the display unit 35 to display the same.

The image processing unit 34 can detect a human body from the indoor image captured by the imaging unit 32 . The image processing unit 34 can detect a human body from the difference in luminance between two indoor images continuously captured by the imaging unit 32 . When extracting the difference between two images taken in succession, the difference is always 0 when there is no moving object such as a human body. On the other hand, when a moving object exists, the difference is other than zero. Therefore, the image processing unit 34 can detect the existence of a moving object at a position where the difference is other than 0 in two images that are taken in succession. Further, the image processing unit 34 identifies the individual of the human body extracted by the indoor information processing unit 22 from the features of the human body information generated by the indoor information processing unit 22, that is, identifies who the human body is. can be recognized.

The display unit 35 displays various information related to the operation of the air conditioner 10 including the content of the operation accepted by the operation unit 31 and the image processed by the image processing unit 34 .

Further, the display unit 35 may be a display unit for color display, or may be a display unit for monochrome display. If the display unit 35 is a display unit that performs color display, visibility is good and there is also a sense of quality, but display members are expensive and power consumption is high. Therefore, if the controller 14 is used wirelessly and the display unit 35 for color display is used, the battery capacity decreases quickly, so a charging system is required, for example, like a mobile phone terminal. On the other hand, when the display unit 35 is a monochrome display unit, power consumption can be suppressed compared to the case where a color display unit is used as the display unit 35, so that non-rechargeable dry batteries can be used. Yes, but less visible.

Note that the content displayed on the display unit 35 does not need to be displayed in real time, and may be stream images such as television and video moving images, or may be still images updated at regular intervals. The display unit 35 outputs to the display unit 35 changes in the settings of the air conditioner 10 when the operation unit 31 is operated, or changes in processed images captured by the imaging unit 32 and processed by the image processing unit 34 . You only need to change the display when For the display unit 35, a memory liquid crystal used for electronic shelf labels or the like may be used. The memory liquid crystal consumes power when rewriting display contents, but has a feature that it can be driven with low power consumption when there is no change in the display contents. Therefore, when the controller 14 is used as a dedicated controller for the air conditioner 10, the battery life of the controller 14 can be extended by using a memory liquid crystal for the display section 35. FIG.

Further, the controller 14 has functions that can be used as an operation unit 31, an imaging unit 32, a controller communication unit 33, an image processing unit 34, and a display unit 35, even if it is not dedicated to the air conditioner 10. Any device that can communicate with the indoor unit communication unit 23 of 11 may be used. The controller 14 can be realized, for example, by using a device such as a mobile phone terminal such as a smart phone or a tablet terminal used by the user.

A typical mobile phone terminal is always equipped with a button-type or touch-panel-type display unit, an image processing unit for display, and a communication unit. As for the communication unit, many mobile phone terminals are equipped with functions of infrared communication, Bluetooth (registered trademark) communication, or wireless LAN communication. Therefore, the mobile phone terminal can be used as the controller 14 by making the indoor unit communication unit 23 of the indoor unit 11 compatible with these communications.

FIG. 9 is a front view showing another example of the controller 14 according to the first embodiment of the present invention, and is a front view showing the controller 14 including the touch panel display section 35a. The operation unit 31 of the controller 14 is not limited to the button type operation unit 31 as shown in FIG. 8, and as shown in FIG. It may be configured as a display unit 35a. FIG. 9 shows a virtual indoor image seen from the side of the user operating the controller 14 including the user operating the controller 14 . Since the touch panel type display unit 35a is well known, a detailed description of the touch panel type display unit 35a will be omitted.

Since the touch panel type display unit 35a displays virtual buttons on the screen, it is possible to limit the number of operation buttons to be selected by displaying only the operation buttons necessary for a certain operation scene. In addition, the touch panel type display unit 35a improves the operability by changing the size of the buttons according to the user's age or preference. The button-type operation unit has the advantage of providing a click sensation when operated by the user. In the touch panel type display unit 35a, for example, a vibration panel may be mounted on the touch panel type display unit 35a, and the user may be given a click sensation by applying vibration stimulation of the vibration panel to the fingertip that operates the touch panel.

On the other hand, the touch panel type display unit 35a may be erroneously recognized as having been operated simply by touching the touch panel type display unit 35a even when the controller 14 is not intended to be operated. For this reason, as a part of the operation unit 31, for example, a decision button 31a, which is a physical button as shown in FIG. 9, may be provided. The operation unit 31 can be configured to enable or disable the operation of the touch panel by pressing the decision button 31a, and can specify the start and end of the operation on the touch panel. good.

Next, operation of the air conditioning system 100 will be described. FIG. 10 is a flow chart showing the operation of the indoor unit 11 in the air conditioning system 100 according to Embodiment 1 of the present invention.

First, in step S110, the indoor information acquisition unit 21 acquires indoor information. In step S<b>120 , the indoor information processing unit 22 extracts the indoor feature information 63 from the indoor information acquired by the indoor information acquisition unit 21 .

For example, if the indoor information acquiring unit 21 is the infrared sensor shown in FIG. 5, the indoor information acquiring unit 21 measures the surface temperature of a wide area in the room, which is the monitoring range. The infrared sensor periodically detects the intensity of the infrared rays in the monitoring range at predetermined time intervals.

The infrared sensor performs predetermined conversion processing on the detection result of the detected infrared intensity to convert the detected infrared intensity in the monitoring range into temperature and obtains temperature distribution information 61 indicating the temperature distribution of the indoor surface temperature. It is generated and transmitted to the indoor information processing unit 22 as indoor temperature information, which is indoor information. The temperature distribution information 61 is indoor information. The indoor information processing unit 22 receives the temperature distribution information 61, which is indoor temperature information, from the indoor information acquisition unit 21, and stores and holds the information.

From the temperature distribution information 61 received from the indoor information acquisition unit 21, the indoor information processing unit 22 generates thermal image information 62, which is thermal image information that expresses the temperature distribution of the indoor surface temperature in terms of color temperature. The thermal image information 62 is information indicating indoor information as an image. The indoor information processing unit 22 then extracts, from the thermal image information 62, indoor feature information 63, which is information indicating indoor features.

FIG. 11 is a diagram showing an example of a thermal image according to the first embodiment of the present invention; When a thermal image is displayed as a monochrome image, for example, as shown in FIG. 11, the image is displayed so that the shade of color varies depending on the temperature. When displaying a thermal image as a color image, for example, a high temperature is displayed in red and a low temperature is displayed in blue.

FIG. 11 shows a thermal image generated from temperature distribution information 61 acquired in summer. Since it is the summer season, the air conditioner 10 is in cooling operation, the room is cool and the outdoor is hot, so there is a temperature difference between the window 71 and the wall 72 . In the thermal image shown in FIG. 11, if one understands the temperature display rule and the arrangement of objects in the indoor space in the thermal image shown in FIG. However, the visibility of thermal images is lower than that of photographs. For this reason, it is generally difficult to guess from the thermal image whether or not the window is arranged.

Therefore, the indoor information processing unit 22 extracts, from the thermal image information 62, the indoor feature information 63, which is information indicating indoor features such as indoor features and indoor conditions. For example, the indoor information processing unit 22 obtains indoor feature information 63, which is information about line segments connecting the temperature change points in the thermal image shown in FIG.

FIG. 12 is a diagram showing another example of a thermal image according to the first embodiment of the present invention; FIG. 12 shows a thermal image in which a person is present. When there is a person in the room, the temperature of the human body is often higher than the temperature of the walls and floor. In this case, the indoor information processing unit 22 extracts the indoor feature information 63 by connecting the temperature change points in the thermal image shown in FIG. and size, the human body 66 in the thermal image shown in FIG. 12 can be extracted. The indoor information processing unit 22 stores in advance human body determination information corresponding to the shape and size of the indoor feature information 63 of the human body in the thermal image, and compares the human body determination information and the indoor feature information 63 to determine the shape and size of the human body in the thermal image. A human body 66 is extracted.

Since people move around, the indoor information acquiring unit 21 periodically acquires the surface temperature of the room and transmits the temperature distribution information 61 to the indoor information processing unit 22 . The indoor information processing unit 22 periodically generates the thermal image information 62 and extracts from the thermal image information 62 information on changes in the surface temperature of the room over time and the magnitude of the change in the surface temperature of the room. Then, from the extracted information, the indoor information processing unit 22 extracts, as the human body 66, a portion where the surface temperature of the room changes faster than the predetermined criterion and the surface temperature of the room is higher than that of the surroundings. good. Further, the indoor information processing section 22 may extract a thermal image having an absolute temperature value of around 36° C. as the human body 66 .

Further, the indoor information processing unit 22 can detect a human body from the difference in the temperature distribution of two indoor surface temperatures continuously acquired by the indoor information acquisition unit 21 . When extracting the difference between temperature distributions of surface temperatures in two rooms that are consecutively acquired, the difference is always 0 when there is no moving body such as a human body. On the other hand, when a moving object exists, the difference is other than zero. Therefore, the indoor information processing unit 22 can detect the presence of a moving object at a position where the difference is other than 0 between two images that are taken in succession.

Then, when the detected moving body is smaller than a predetermined criterion, the indoor information processing section 22 can determine that the detected moving body is a pet or a falling object. Further, when the detected moving body is larger than a predetermined criterion, the indoor information processing unit 22 determines that the detected moving body is a disturbance in human body detection such as furniture such as curtains or lighting. Thus, the accuracy of human body detection can be improved.

That is, the indoor information processing unit 22 obtains human body information such as a person's face, hands, and feet, and indoor objects such as floors, walls, and furniture from the position, size, shape, and absolute value of temperature in the thermal image. Object information, which is information, can be detected and recognized. The human body information and object information also include positional information in a thermal image, that is, positional information in a room. That is, the indoor information processing unit 22 extracts the human body from the indoor information, extracts the human body information, which is information about the human body in the indoor information, and transmits the extracted human body information to the air conditioning control unit 24 and the image processing unit 34 . The indoor information processing unit 22 also extracts objects from the indoor information, extracts object information that is information about the objects in the indoor information, and transmits the extracted object information to the air conditioning control unit 24 and the image processing unit 34 .

FIG. 13 is a diagram showing the storage unit 221 inside the indoor information processing unit 22 according to Embodiment 1 of the present invention. The indoor information processing unit 22 stores the temperature distribution information 61 , the thermal image information 62 and the indoor feature information 63 in the storage unit 221 inside the indoor information processing unit 22 . The human body information and indoor information are included in the indoor feature information 63 and stored. The human body information and indoor information can also be handled independently of the indoor feature information 63 .

In step S<b>130 , the indoor information processing unit 22 transmits the thermal image information 62 and the indoor feature information 63 to the controller 14 . Specifically, the indoor information processing section 22 transmits the thermal image information 62 and the indoor feature information 63 to the image processing section 34 via the indoor unit communication section 23 and the controller communication section 33 . The image processing unit 34 receives and stores the thermal image information 62 and the room feature information 63 .

Next, operation of the controller 14 will be described. FIG. 14 is a flow chart showing the operation of the controller 14 in the air conditioning system 100 according to Embodiment 1 of the present invention. 15 is a diagram showing an example of an indoor image according to the first embodiment of the present invention; FIG.

First, in step S210, the imaging unit 32 captures an indoor image, which is an image showing the state of the room. The image capturing unit 32 captures an image of a range in which the indoor information acquiring unit 21 acquires indoor information. The imaging unit 32 transmits indoor image information 64 that is information about the captured indoor image to the image processing unit 34 . The image processing unit 34 receives and stores the indoor image information 64 transmitted from the imaging unit 32 .

In step S220, the image processing unit 34 performs processing for extracting the features of the indoor image from the indoor image, and extracts the indoor image feature information 65, which is the feature of the indoor image, on the image information of the indoor image. The image processing unit 34 stores the extracted indoor image feature information 65 in association with the indoor image information 64 . The indoor image feature information 65 includes, for example, the shapes and positions of large objects in the room such as walls, floors, windows, and tables; A line etc. are illustrated. The indoor image feature information 65 can also be said to be the features of the room where the image was taken.

For example, the image pickup unit 32 of the controller 14 is arranged near the indoor information acquisition unit 21 of the indoor unit 11, and the image is taken in the same direction as the indoor information acquisition unit 21 faces when the indoor information acquisition unit 21 acquires indoor information. The imaging unit 32 takes an image of the interior while the unit 32 is directed. As described above, when the infrared sensor, which is the indoor information acquisition unit 21, acquires the indoor surface temperature while changing the detection direction of the indoor surface temperature, the direction in which the infrared sensor faces the center of the temperature detection range is the same direction. The imaging unit 32 is directed toward. By capturing the indoor image by the imaging unit 32 in this way, the image processing unit 34 can acquire the indoor image feature information 65 at the same position as the indoor feature information 63 extracted by the indoor information processing unit 22 .

The image capturing unit 32 captures an image of the interior of the room while the controller 14 is held by a holding unit that is provided on the front surface of the indoor unit 11 and holds the controller 14, for example. Note that it is also possible for the imaging unit 32 to photograph the interior while the user is holding the controller 14 .

In step S230, the image processing unit 34 uses the thermal image information 62, the indoor feature information 63, the indoor image information 64, and the indoor image feature information 65 to superimpose the thermal image and the indoor image. A process of enlarging or reducing the indoor image is performed so that the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room match. That is, the image processing unit 34 adjusts the scale of the indoor image so that the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room match. The image processing unit 34 stores the indoor image information 64 whose scale has been adjusted. In addition, the image processing unit 34 performs image processing such as processing to move the position of the indoor image and trimming of the indoor image, if necessary, and obtains the indoor feature information 63 indicating the same part in the room and the indoor image feature information. Correct the indoor image so that 65 matches.

Then, the image processing unit 34 causes the touch panel type display unit 35a of the controller 14 to display the indoor image after the scale adjustment as a background image, as shown in FIG.

Since the background image is displayed on the touch panel display unit 35a in this manner, the user can view the windows, furniture, etc., which were difficult to distinguish only from the thermal image acquired by the indoor information acquisition unit 21, on the touch panel display unit. The background image displayed at 35a allows visual and intuitive recognition, improving the visibility of the indoor conditions.

In step S240, the image processing unit 34 superimposes at least part of the thermal image represented by the thermal image information 62 on the background image displayed on the touch panel display unit 35a. That is, the image processing unit 34 superimposes at least part of the indoor information on the background image displayed on the touch panel display unit 35a. FIG. 16 is a diagram showing an example of a thermal image including a human body according to Embodiment 1 of the present invention. FIG. 17 is a diagram showing an example of a background image on which a human body area of a thermal image is superimposed according to Embodiment 1 of the present invention.

As shown in FIG. 16 , when the thermal image represented by the thermal image information 62 stored in the image processing unit 34 includes a human body 66 , the image processing unit 34 processes the human body transmitted from the indoor information processing unit 22 . Based on the information, a human body area including the human body 66 and the surroundings of the human body 66 is extracted on the thermal image. Then, as shown in FIG. 17, the image processing unit 34 may display the extracted thermal image 73 of the human body area superimposed on the background image displayed on the touch panel type display unit 35a. As described above, since the scale of the indoor image is adjusted so that the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room match, the thermal image of the human body area superimposed on the background image is 73 is superimposed on the background image so as to match the human body 66 .

As a result, the user can see the state of the room, which was difficult to determine only from the thermal image acquired by the indoor information acquisition unit 21, by viewing the background image displayed on the touch panel display unit 35a and the human body area superimposed on the background image. The thermal image 73 can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Therefore, in the air conditioning system 100, the visibility of the indoor state can be improved compared to the case where the indoor state is displayed on the touch panel type display unit 35a only by the thermal image of the room.

Furthermore, the image processing unit 34 may superimpose the thermal image represented by the thermal image information 62 stored in the image processing unit 34 in a semi-transmissive state on the background image displayed on the touch panel display unit 35a. . In this case as well, the user can superimpose the background image displayed on the touch-panel display unit 35a and the touch-panel display unit 35a on the state of the room, which was difficult to determine only from the thermal image acquired by the indoor information acquisition unit 21. The generated thermal image allows visual and intuitive recognition, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved.

Note that in step S220, the imaging unit 32 of the controller 14 is operated in a state in which the imaging unit 32 faces in the completely same direction as the direction in which the indoor information obtaining unit 21 faces when the indoor information obtaining unit 21 obtains indoor information. no need to shoot. That is, by superimposing at least part of the thermal image on the background image, the indoor image can be visually and intuitively recognized by the background image and the thermal image. To the extent that the visibility of the indoor state displayed in 35a is improved, the indoor information acquiring unit 21 is photographed in the same direction as the indoor information acquiring unit 21 when acquiring indoor information. Any image can be used. Therefore, when the indoor information acquiring unit 21 acquires indoor information, the imaging unit 32 of the controller 14 cannot shoot the interior in a state in which the imaging unit 32 faces in the same direction as the indoor information acquiring unit 21 faces. I don't mind.

Then, in step S230, the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room when the thermal image and the indoor image are superimposed do not have to match completely. That is, the indoor feature information 63 and the indoor image feature information 65 indicating the same part in the room with the thermal image and the indoor image superimposed can be obtained by superimposing at least part of the thermal image on the background image. The image and the thermal image should match to the extent that the indoor state can be visually and intuitively recognized and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. Just do it.

Therefore, the indoor feature information 63 and the indoor image feature information 65 indicating the same portion in the room in the state where the thermal image and the indoor image are superimposed are the same as the indoor portion represented by the indoor feature information 63 . , and the indoor portion represented by the indoor image feature information 65 may be enlarged or reduced to such an extent that they fall within a predetermined range. As an example, the indoor portion represented by the indoor feature information 63 and the indoor portion represented by the indoor image feature information 65 are arranged within a predetermined distance range in the indoor image by enlarging or reducing the indoor image. It is sufficient if it is in a state of being able to enter inside. As another example, by enlarging or reducing the indoor image, the indoor portion represented by the indoor feature information 63 and the indoor portion represented by the indoor image feature information 65 are combined for one indoor portion. In the other part of the room, the room part represented by the room feature information 63 and the room part represented by the room image feature information 65 are separated from each other by a predetermined distance in the room image. It suffices if it is in a state of being within the range.

In the above description, the case where the object to be photographed by the imaging unit 32 is the range from which the indoor information acquisition unit 21 acquires the indoor information has been described. The imaging unit 32 may also capture a captured image of the user's face. FIG. 18 is an enlarged view showing a state in which a user's facial image 74 is superimposed on the facial portion of the human body 66 in the thermal image according to Embodiment 1 of the present invention. The thermal image shown in FIG. 18 shows a thermal image generated from the temperature distribution information 61 acquired in summer.

For example, as shown in FIG. 12 described above, when there is a thermal image including the human body 66, the user's face image 74 may be superimposed on the facial portion of the human body 66 in the thermal image. In this case, the user's face image 74 is captured by the imaging unit 32 . Then, the image processing unit 34 enlarges or reduces the facial image 74 of the user so that it matches the size of the facial portion of the human body 66 in the thermal image shown in FIG. to process the face image 74 of The image processing unit 34 superimposes the processed face image 74 of the user on the face portion of the human body 66 in the thermal image as shown in FIG.

By performing similar processing, the user's facial image 74 after processing can be superimposed on the facial portion of the human body 66 in the thermal image shown in FIG. 16 described above. Then, when superimposing the thermal image 73 of the human body area on the background image displayed on the touch panel type display unit 35a as shown in FIG. Then, the thermal image 73 of the human body area on which the user's face image 74 is superimposed can be superimposed on the background image.

In this case as well, the user can see the state of the room, which was difficult to determine only from the thermal image acquired by the indoor information acquisition unit 21, by viewing the background image displayed on the touch panel display unit 35a and the human body area superimposed on the background image. The thermal image and the user's face image 74 superimposed on the thermal image of the human body area can be visually and intuitively recognized, and the visibility of the indoor state displayed on the touch panel type display unit 35a is improved. be done.

Further, instead of the user's face image 74, a portrait image or icon created by the user is superimposed on the face portion of the thermal image shown in FIG. 16, and superimposed on the face portion of the thermal image of the human body area shown in FIG. may be The image processing unit 34 can directly acquire the portrait image or icon created by the user from an external device via the controller communication unit 33 . In addition, the image processing unit 34 can acquire other pictorial images or icons from an external device via the controller communication unit 33 and the Internet.

That is, the image processing unit 34 can superimpose an image captured by the imaging unit 32 or an image or icon acquired from a device external to the controller 14 on the position of the human body specified by the human body information in the indoor image. . An image captured by the imaging unit 32, an image acquired from a device external to the controller 14, and an icon acquired from a device external to the controller 14 are specified and selected based on indoor information, which is information about the state of the room. It can be said that it is one of indoor information.

In addition, when there is only one pattern of a face image or the like superimposed on the thermal image of the human body area, when a plurality of people are present in a room that is an air-conditioned space, it is visually recognized from the viewpoint of who is at which position. sexuality declines. Therefore, an image pre-stored in the image processing unit 34 may be superimposed on the thermal image of the human body area. Based on the features of the human body information included in the indoor feature information 63 acquired from the indoor information processing section 22, the image processing section 34 corresponds to the features of the human body information from a plurality of images stored in advance in the image processing section 34. An image is selected and the selected image is superimposed on the thermal image of the human body area. The features of the human body information are exemplified by the size of the human body, the time period when the human body was detected, the position of the human body in the room, the absolute value of the temperature of the human body, and the like.

The image processing unit 34 converts an image or icon stored in advance in the image processing unit 34 corresponding to the features of the human body information to the image of the person specified by the features of the human body information in the indoor image displayed on the touch panel display unit 35a. is superimposed on the detection position of For example, when the air conditioning system 100 is installed in a house, the image processing unit 34 determines that the detected large human body is the father, the human body detected moving during the day is the mother, and the human body is sitting on the sofa. It may be determined that a human body whose presence is detected is a child, and that a human body whose detected temperature is higher than a predetermined temperature is a baby. That is, the image processing unit 34 can specify and recognize an individual in the human body based on the characteristics of the human body information.

In this way, criteria for determining the individual of the human body, that is, the type of the human body, are stored in advance in the image processing unit 34 based on the characteristics of the human body information. By enabling the user to input the characteristics of the family's human body information to the controller 14 by simple selection, the image processing unit 34 can identify the family member whose human body is detected in the thermal image. Then, the image processing unit 34 associates and stores an image or an icon or the like for each identified individual. As a result, even when a plurality of people are present in the room, the image processing unit 34 can display an image or an icon corresponding to each individual corresponding to the characteristics of the detected human body information on the touch panel display unit 35a of the controller 14. By superimposing on the displayed background image, it is possible to visually and intuitively determine who is at what position.

In addition to face information for each individual, preferred air conditioning setting information 67, which is information on air conditioning settings preferred by each user, is stored in the image processing unit 34. good too. Pre-registered preferred air conditioning setting information 67 is displayed by tapping an area corresponding to a person's image, a face image superimposed on a background image, a picture image, or an icon displayed on the touch panel type display unit 35a. may be displayed on the touch panel type display unit 35a. That is, when information for selecting an individual specified by the characteristics of the human body information and displayed on the touch panel type display unit 35a is input to the operation unit 31, the image processing unit 34 displays the information on the background image. Information for selecting an individual who is present may be received, and preferred air conditioning setting information 67 corresponding to the information for the selected person may be displayed on the touch panel type display section 35a. Since the preferred air-conditioning setting information 67 is associated with the criteria for judging the individual of the human body based on the characteristics of the human body information described above, the individual displayed in the background image is selected to select the preferred air conditioning setting information 67 . Air conditioning setting information 67 is selected.

Then, when the desired air conditioning setting information 67 displayed on the touch panel type display unit 35a is tapped, the image processing unit 34 transmits the tapped desired air conditioning setting information 67 to the controller communication unit 33 and the indoor unit. It is transmitted to the air conditioning control section 24 via the communication section 23 . That is, when information for selecting the preferred air conditioning setting information 67 of the selected person is input through the operation unit 31, the image processing unit 34 converts the selected preferred air conditioning setting information 67 into a new air conditioning setting. It is transmitted to the air conditioning control section 24 as information. The air conditioning control unit 24 receives the preferred air conditioning setting information 67 and controls the operation of the air conditioner 10 based on the preferred air conditioning setting information 67 .

By automatically reflecting the user's preferred air conditioning setting information 67 in the operation of the air conditioner 10 in this way, the operability of the air conditioning setting of the air conditioner 10 for the user can be improved. At this time, if the setting is reflected by one tap, there is a risk of an erroneous operation. Therefore, the image processing unit 34 controls the setting to be reflected by two taps, or displays consent confirmation by the first tap. may be controlled. Also, if you want to change a part of the information of the air conditioning setting, you may edit it in the image processing unit 34 by long-pressing the information you want to change on the screen displayed on the touch panel type display unit 35a.

As described above, the indoor information processing unit 22 can detect and recognize human body information such as a person's face, hands, and feet, and object information, which is indoor object information such as floors, walls, and furniture. can. The human body information and object information also include positional information in a thermal image, that is, positional information in a room. The indoor information processing section 22 transmits the human body information and the object information to the air conditioning control section 24 .

Then, the image processing unit 34 associates the human body information of the person selected by the operation unit 31 with the preferred air conditioning setting information 67 corresponding to the person selected by the operation unit 31, and transmits the information to the air conditioning control unit 24. You may The human body information of the selected person also includes positional information in the background image, that is, positional information in the room.

The air conditioning control unit 24 controls the human body information transmitted from the indoor information processing unit 22, the human body information of the person selected by the operation unit 31, and the selected person's preferred air conditioning unit transmitted from the image processing unit 34. Based on the setting information 67, the position in the room of the person selected by the operation unit 31 is specified. Then, based on the preferred air conditioning setting information 67 corresponding to the person selected by the operation unit 31, the air conditioning control unit 24, for example, when the person who is sensitive to heat is on the right side, the airflow hits the person who is sensitive to heat. , the air conditioning changer 25 is controlled so that the first airflow direction changer 25a and the second airflow direction changer 25b face rightward. The air-conditioning control unit 24 can determine the physical constitution of the person selected by the operation unit 31, such as being sensitive to heat or cold, based on the contents of the user's preferred air-conditioning setting information 67 selected by the operation unit 31. . The air conditioning setting criteria for determining whether the person is sensitive to heat or sensitive to cold is stored in advance in the air conditioning control unit 24 .

In addition, the air conditioning control unit 24 can also specify the position in the room of the person selected by the operation unit 31 based only on the human body information of the person selected by the operation unit 31, which is transmitted from the image processing unit 34. is.

FIG. 19 is a diagram showing the storage unit 341 of the image processing unit 34 according to Embodiment 1 of the present invention. The image processing unit 34 stores the indoor image information 64 , the indoor image feature information 65 , and the preferred air conditioning setting information 67 in the storage unit 341 inside the image processing unit 34 .

FIG. 20 is a diagram showing a state in which the air conditioning setting is set by operating the controller 14 according to Embodiment 1 of the present invention. FIG. 20 shows a state in which a background image on which a human body icon is superimposed is displayed on the touch panel display section 35a. The user can manipulate the air conditioning settings by manipulating the controller 14 . If the user can recognize the current indoor temperature near the user in the room, it will be easier for the user to determine how much the room temperature should be raised or lowered from the current indoor temperature.

Therefore, as shown in FIG. 20, the image processing unit 34 causes the touch panel display unit 35a to display a temperature display 81 indicating the temperature of the touched position on the touch panel display unit 35a. The temperature displayed by the temperature display 81 is not the set temperature in the air conditioner 10, but the airflow temperature calculated from the indoor temperature detected by the indoor information acquisition unit 21 or the blowing temperature of the airflow blown out from the indoor unit 11. be.

FIG. 21 is a diagram showing a method of setting the indoor temperature in the air conditioning setting by operating the controller 14 according to Embodiment 1 of the present invention. As shown in FIG. 20, when the temperature display 81 displayed on the touch panel type display unit 35a is tapped or long-pressed for one second or more, the screen is switched to the air conditioning setting screen as shown in FIG. On the air-conditioning setting screen, a plurality of temperature candidates 82 are displayed next to the temperature display 81, with the current temperature indicated by the temperature display 81 at the center, and a desired room temperature 83 can be selected. By tapping and selecting a temperature candidate 82 displayed on the touch panel type display unit 35a, the air conditioning setting of the room temperature can be changed. FIG. 21 shows a state in which 21° C. is selected as the desired indoor temperature 83 .

In order to prevent an erroneous selection from being reflected when selecting the desired room temperature 83, after the desired room temperature 83 is selected on the touch panel type display unit 35a, a message for confirming consent to reflect the selection of the desired room temperature 83 is displayed on the touch panel. It may be displayed on the expression display section 35a. Then, by the user tapping the message, the selection of the desired room temperature 83 may be reflected in the air conditioning settings.

In the example shown in FIG. 21, the current indoor temperature indicated by the temperature display 81 can be changed in increments of 0.5° C. by 2° C. above or below. In general, if the air conditioner is used regularly, the user's feeling of being cold is often eliminated simply by raising the indoor temperature by 0.5°C. Therefore, if the room temperature setting can be changed by 2° C., it is possible to eliminate the user's feeling of being cold. If the user's feeling of coldness is not sufficiently resolved even after changing the indoor temperature setting by 2°C, if the temperature display 81 is touched again, the temperature candidates 82 are displayed within a range of 2°C above and below the changed temperature. is displayed, and desired room temperature 83 can be changed. Therefore, it is not always possible to change the desired room temperature 83 only within a range of 2° C. from the initial room temperature.

In the example shown in FIG. 21, an example in which the selection range of the desired indoor temperature 83 is 2° C. has been described. While touching 35a and sliding to below 22°C, the temperature above 22°C, 22.5°C, 23°C, and so on may be displayed until the desired temperature can be selected. .

When the user touches the touch panel type display unit 35a, the currently set airflow information is displayed as an arrow icon 84 as vector information including direction and magnitude information as an airflow display. The arrows shown in FIG. 20 are airflow display icons representing the set airflow information set in the air conditioner 10 by the user. The set airflow information is information on airflow, which is one of the air conditioning settings set in the air conditioner 10 by the user, and includes the strength of the airflow. The direction of the arrow icon 84 represents the direction of the airflow in the room, and the length of the arrow icon 84 represents the strength of the airflow in the room.

By looking at the image on the touch panel type display unit 35a shown in FIG. 20, the user can understand the state of the airflow set in the air conditioner 10 by the user. The image processing unit 34 receives the set airflow information set in the air conditioner 10 by the user from the operation unit 31, synthesizes the set airflow information with the background image displayed on the touch panel display unit 35a, and displays the result. be able to.

FIG. 22 is a schematic diagram showing a method of changing the set airflow information in the air conditioning setting using the touch panel type display unit 35a in the first embodiment of the present invention. To change the set airflow information set in the air conditioner 10, when the current set airflow information is in the state of the arrow icon 84 as shown in FIG. When the button is pressed long enough, the airflow axis is displayed as a black circle 85 next to the base point of the arrow icon 84 . When the user performs a drag-and-drop operation near the tip of the arrow icon 84 while the black circle 85 is displayed, the shape or size of the arrow icon 84, or both the shape and size, are changed. The dashed arrow icon 86 in FIG. 22 is the icon after the arrow icon 84 has changed.

To strengthen the airflow, the user drags and drops the vicinity of the tip of the arrow icon 84 while the black circle 85 is displayed to extend the tip of the arrow icon 84 . To change the direction of the airflow, the user drags and drops near the tip of the arrow icon 84 while the black circle 85 is displayed to rotate the tip of the arrow icon 84 around the black circle 85. and slide it.

Information about the changed shape or size, or both the shape and size, of the arrow icon 84 is sent to the image processing unit 34 . The image processing unit 34 converts the information of the arrow icon 84 into an airflow setting value of the air conditioning setting, and transmits the airflow setting value to the air conditioning control unit 24 . The air-conditioning control unit 24 controls air-conditioning operation settings, such as the direction and strength of the airflow, based on the airflow setting values received from the image processing unit 34 . That is, by changing the shape or size of the arrow icon 84 displayed on the touch panel type display unit 35a and indicating the information of the airflow set in the air conditioner 10, or by changing both the shape and size, the dashed line An airflow setting value corresponding to the shape and size of the arrow icon 86 is transmitted to the air conditioning control unit 24 .

Also, the airflow display may display an image of the wind. When the touch panel type display unit 35a supports color display, the image processing unit 34 displays the airflow during heating with a red or orange arrow icon 84 to indicate the warmth of the wind. Further, the image processing unit 34 displays the airflow during cooling with a light blue or blue arrow icon 84 to indicate the coldness of the wind. As a result, it can be seen that the arrow icon 84 is an indication of the wind, and it becomes easy to visually determine in what operation mode the vehicle is being driven by the display on the touch panel type display unit 35a.

By performing the above operations, the user can visually see the state of the room while looking at the room image, which is an image showing the room displayed on the touch panel display unit 35a, the room information superimposed on the room image, and the human body position. , the set airflow information can be changed by operating the arrow icon 84 so as to avoid obstacles such as sofas and furniture. In addition, the user can change the set airflow information so that the airflow is directed in the direction of the temperature unevenness, thereby realizing efficient and comfortable air conditioning and improved operability of air conditioning setting.

Further, since the image processing unit 34 can recognize individuals and objects as described above, the recognition result may be displayed as a background image on the touch panel type display unit 35a. For example, the image processing unit 34 recognizes objects such as a television, a sofa, and a window, and individuals such as a father and a mother, and displays them by superimposing them on the background image of the touch panel display unit 35a. In addition, the image processing unit 34 may display the person and the object on the background image with borders according to the shape of the recognition result of the person and the object. Also, the image processing unit 34 may display a comment of the recognition result near the individual and the object on the background image. As a result, the user can also confirm whether the air conditioner 10 correctly identifies the state of the room and is operating normally by viewing the display on the touch panel type display unit 35a.

Moreover, if the comment of the recognition result is erroneous, the comment of the recognition result can be corrected. When correcting the comment of the recognition result, by touching the comment of the incorrect recognition result displayed on the touch panel type display unit 35a, the comment of the recognition result enters the input mode and the character can be input directly. For example, if you want to correct the comment of the recognition result displayed as "father" on the touch panel type display unit 35a, if you touch the display of "father", correction candidates such as "mother", "child", and "customer" will appear on the touch panel. Correction candidates with correct content displayed on the expression display section 35a may be selected on the touch panel type display section 35a.

As described above, in the air conditioning system 100, when a wide area of the indoor space is photographed and recognized, and the air conditioning operation is controlled in accordance with the recognition result of the human body in the indoor space, how the air conditioner 10 The user can confirm whether the harmonious space is recognized by the display of the touch panel type display unit 35a. In addition, in the air conditioning system 100, if the air conditioning operation is performed in a wasteful manner due to an error in the recognition result of the air conditioning space, the recognition result in the air conditioner 10 can be easily corrected to avoid wasteful air conditioning. Appropriate air conditioning operation can be performed without

Further, when the human body recognition result indicates that the child is a child, the image processing unit 34 disables the operation of the operation unit 31 even if the child operates the operation unit 31. By displaying "Medium", it is possible to prevent erroneous operation of the controller 14 by a child. Also, even when a user other than a specific registrant who is registered in the controller 14 as a user who can operate the controller 14 operates the controller 14, by invalidating the operation of the operation unit 31, wasteful air conditioning operation can be suppressed. Energy-saving operation of the air conditioner 10 can also be realized.

When the individual on the human body is recognized, the image processing unit 34 simply displays the pre-registered personal preference air conditioning setting information 67 on the touch panel type display unit 35a in correspondence with the recognition result of the individual. Instead, the air conditioning setting or the operation menu for the air conditioning setting that is presumed to be changed based on the current indoor environment is presumed and displayed on the touch panel display unit 35a, or the necessary setting function is presumed to be the air conditioning setting. A harmony setting function may be displayed to improve operability. The current indoor environment is exemplified by the current indoor temperature recognized from the thermal image information 62, for example. A necessary setting function is, for example, "a function for setting only the air volume". That is, when an individual on the human body is specified, the image processing unit 34 takes into consideration the current indoor environment, and presumes that the air conditioning settings that are presumed to be the preferences of the specified individual, or the settings that are required by the specified individual. The operation menu for the air conditioning setting to be performed is guessed and displayed as a candidate on the touch panel type display unit 35a.

In addition, the image processing unit 34 uses the recognition result of the human body in the image processing unit 34 and the pre-registered personal preference air conditioning setting information 67 in the form of a question so that the user does not have to worry about the operation setting of the air conditioning setting. You may enable it to select operation. That is, the image processing unit 34 estimates the individual's preferences for air conditioning settings from the identification result of the individual identified by the characteristics of the human body information, and displays the estimated air conditioning settings in a question format on the touch panel display unit 35a. may

Based on pre-registered personal preference air conditioning setting information 67, the image processing unit 34 displays on the touch panel display unit 35a whether or not the air conditioning settings are to be changed, and how to change the air conditioning settings. The touch panel type display unit 35a prompts the user to input a setting instruction using the operation unit 31. FIG. The user inputs desired air conditioning setting conditions from the operation unit 31 according to the display on the touch panel type display unit 35a.

Further, the indoor image captured by the imaging unit 32 is not the scene seen by the user, but the image of the scene seen from the indoor unit 11 of the air conditioner 10 . Therefore, based on the recognition results of objects and human bodies, the image processing unit 34 calculates information about what objects exist in the room with respect to the user and how they are viewed by the user. A virtual image that can be seen from the outside may be generated and displayed on the touch panel type display unit 35a. FIG. 9 described above shows a virtual indoor image seen from the side of the user operating the controller 14 including the user operating the controller 14 . The indoor unit 11 of the air conditioner 10 is also displayed in the virtual indoor image shown in FIG. By displaying the indoor unit 11, which is not actually captured in the indoor image, in the virtual indoor image in this way, it is also possible to clearly display from where to where the wind is blowing.

As described above, in the air conditioning system 100 according to Embodiment 1, the indoor unit 11 of the air conditioner 10 includes the indoor information acquisition unit 21 that acquires indoor information, which is information about indoor conditions. The controller 14 also includes an imaging unit 32 that captures an indoor image, which is an image showing the state of the room, and a display unit 35 that displays information about the operation of the air conditioner. Then, the imaging unit 32 causes the display unit 35 to display at least part of the thermal image, which is indoor information, superimposed on the indoor image.

As a result, the user can visually and intuitively recognize the state of the room, which was difficult to distinguish from the thermal image of the room alone, from the background image displayed on the display unit 35 and the thermal image 73 superimposed on the background image. and the visibility of indoor conditions is improved. In addition, by superimposing the thermal image on the background image, it is possible to recognize the indoor temperature at the same time. You can easily grasp the state of the room compared to .

The air conditioning system 100 uses an indoor image, which is an image captured by the imaging unit 32 of the controller 14, as a background image on the display unit 35 without installing an imaging unit such as an expensive camera in the air conditioner 10. display. Then, at least part of the indoor information is superimposed on the indoor image and displayed on the display unit 35 . As a result, the size of the air conditioner 10 does not increase due to provision of the imaging device in the air conditioner 10, and the air conditioner 10 can be realized at a low cost and in a small space.

In addition, the air conditioning system 100 can display the identification result of the person and the object in the air conditioner 10 by synthesizing it with the background image. As a result, the user can easily and intuitively recognize from the display on the display unit 35 whether or not the air conditioner 10 correctly authenticates the state of the indoor space. The display on the display unit 35 makes it possible to easily and intuitively recognize whether or not the driving is wasteful. Then, when the air conditioner 10 incorrectly identifies the state of the indoor space, the energy-saving operation of the air conditioner 10 can be realized by correcting the identification result.

In addition, the air conditioning system 100 can replace the user's face specified by the thermal image information 62 with the user's face image 74 and display it in combination with the background image of the display unit 35 . Furthermore, the face of the user specified by the thermal image information 62 is replaced with a portrait or icon of the user and displayed in a synthesized manner on the background image of the display unit 35, thereby easily displaying the people in the room while ensuring the privacy of the individual. It can be recognized in part 35 .

In addition, the air conditioning system 100 displays, on the display unit 35, the individual's favorite air conditioning settings specified from the thermal image information 62, so that the user can easily select the desired settings from among the limited air conditioning settings. can be selected, and the operability of the air conditioning setting operation can be improved.

In addition, a touch panel type display unit 35a is used as the display unit 35, and the airflow setting of the air conditioning setting is displayed on the touch panel type display unit 35a by an arrow icon. You can intuitively monitor and configure your air conditioning settings. As a result, an air conditioning system with improved user convenience can be realized.

In addition, the air conditioning system 100 displays the airflow setting on the touch panel type display unit 35a as an arrow icon, thereby adjusting the airflow so that the air conditioning is not hindered by obstacles, and the adjusted air conditioning is performed. If inappropriate, the air conditioning settings can be corrected using a touch panel or the like to achieve appropriate energy-saving operation. The user can visually and intuitively adjust the airflow by looking at the display on the touch panel type display unit 35a, so that the user can set the airflow without being particularly conscious of it.

Therefore, according to the air conditioning system 100 according to the first embodiment, it is possible to intuitively grasp the state of the room without increasing the size of the air conditioner 10 due to the provision of the imaging device in the air conditioner 10. is possible.

The configuration shown in the above embodiment shows an example of the content of the present invention, and it is possible to combine it with another known technology, and one configuration can be used without departing from the scope of the present invention. It is also possible to omit or change the part.

10 air conditioner, 11 indoor unit, 12 outdoor unit, 13 refrigerant pipe, 14 controller, 21 indoor information acquisition unit, 22 indoor information processing unit, 23 indoor unit communication unit, 24 air conditioning control unit, 25 air conditioning change unit, 25a first wind direction changing unit 25b second wind direction changing unit 25c third wind direction changing unit 31 operation unit 31a enter button 32 imaging unit 33 controller communication unit 34 image processing unit 35 display unit 35a touch panel type 41, 42, 43, 44, 45, 46, 47 thermopile element 61 temperature distribution information 62 thermal image information 63 indoor feature information 64 indoor image information 65 indoor image feature information 66 human body 67 Preferred air conditioning setting information, 71 windows, 72 walls, 73 thermal images, 74 user's facial images, 81 temperature display, 82 temperature candidates, 83 desired room temperature, 84 arrow icons, 85 black circles, 86 dashed arrow icons, 100 air conditioning system, 101 processor, 102 memory, 221, 341 storage unit, A1, A2, A3, A4, A5, A6, A7 monitoring range.

Claims (9)

An air conditioner that is placed in a room and blows conditioned air into the room, and a controller that controls the operation of the air conditioner,
The air conditioner is
an indoor information acquisition unit that acquires indoor information that is information about the state of the room;
an air conditioner communication unit that communicates with an external device;
an air conditioning control unit that performs air conditioning control of the air conditioner;
an indoor information processing unit that extracts, from the indoor information, indoor feature information that is information indicating features in the room;
with
The controller is
an operation unit that receives an operation for setting the operation of the air conditioner;
an imaging unit that captures an indoor image that is an image showing the state of the room;
a display unit that displays information about the operation of the air conditioner;
a controller communication unit that communicates with an external device;
an image processing unit that acquires the indoor information and the indoor image, superimposes at least part of the indoor information on the indoor image, and performs control to display the indoor image on the display unit;
with
The image processing unit extracts indoor image feature information, which is a feature of the indoor image, from the indoor image, and extracts the indoor image based on the indoor information, the indoor feature information, the indoor image, and the indoor image feature information. so that the indoor portion represented by the indoor feature information indicating the same portion in the room and the indoor portion represented by the indoor image feature information are within a predetermined distance range in the indoor image adjusting the scale of the indoor image, and displaying the scale-adjusted indoor image on the display unit;
The air conditioning system in which the display unit displays at least part of the indoor information superimposed on the indoor image. The indoor information processing unit extracts a human body from the indoor information, extracts human body information that is information about the human body in the indoor information, and transmits the human body information to the image processing unit,
2. The image processing unit superimposes an image captured by the imaging unit or an image or an icon acquired from a device external to the controller on the position of the human body specified by the human body information in the indoor image. The air conditioning system according to . 3. The image processing unit superimposes an image or an icon stored in advance in the image processing unit corresponding to the feature of the human body information on the detected position of the individual identified by the human body information in the indoor image. The air conditioning system according to . The image processing unit
storing preferred air-conditioning setting information, which is information on air-conditioning settings preferred by the individual specified by the characteristics of the human body information;
4. Displaying the preferred air conditioning setting information on the display unit when information for selecting an individual displayed on the display unit specified by the characteristics of the human body information is received from the operation unit. The air conditioning system according to . The operation unit includes the display unit of a touch panel type,
5. The image processing unit is capable of editing the desired air conditioning setting information in the image processing unit when the desired air conditioning setting information displayed on the touch panel type display unit is selected. The air conditioning system according to . The image processing unit, based on the identification result of the individual identified by the characteristics of the human body information, determines the air conditioning setting presumed to be the identified individual's preference or the individual's needs based on the current indoor environment. 6. The air conditioning system according to claim 4 or 5 , wherein an operation menu for an estimated air conditioning setting is estimated and displayed as a candidate on the display unit. 2. The image processing unit estimates preferences for air conditioning settings of the individual from identification results of the individual identified by the characteristics of the human body information, and displays the estimated air conditioning settings in a question format on the display unit. 7. The air conditioning system according to any one of 6 . The operation unit includes the display unit of a touch panel type,
The air conditioning setting is changed by touching the touch panel type display unit on which the indoor image on which the indoor information is superimposed is displayed,
The air conditioning system according to any one of claims 1 to 6 , wherein the air conditioning control section performs air conditioning control of the air conditioner based on the air conditioning setting changed on the display section. By changing the shape or size of an icon displayed on the touch panel type display unit and indicating the information of the airflow set in the air conditioner, or both the shape and size of the icon, the shape and size of the icon are changed. 9. The air conditioning system according to claim 8 , wherein the set value of the airflow corresponding to is transmitted to the air conditioning control unit.

Images