WO2015152028A1

WO2015152028A1 - Makeup assistance device and recording medium

Info

Publication number: WO2015152028A1
Application number: PCT/JP2015/059557
Authority: WO
Inventors: 基康田中; 直子佐々木
Original assignee: 株式会社メガチップス
Priority date: 2014-03-31
Filing date: 2015-03-27
Publication date: 2015-10-08
Also published as: JP2015197710A

Abstract

　A makeup assistance device (1) carried with a user when the user applies makeup to herself is provided with: an image-capturing unit (71) for capturing the image of the user and acquiring image-capture information; a measurement control unit (100) for acquiring, on the basis of image-capture information (112) acquired by the image-capturing unit (71), information pertaining to a three-dimensional shape pertaining to the user, and generating three-dimensional shape information (113); an information creation unit (103) creating, on the basis of the three-dimensional shape information (113) created by the measurement control unit (100), makeup assistance information (114) for assisting with makeup applied to the user; and a display unit for displaying the makeup assistance information (114) created by the information creation unit (103).

Description

Makeup support device and recording medium

The present invention relates to a technique for supporting makeup of a user using three-dimensional information about the user's body.

Conventionally, various techniques for supporting user's makeup have been proposed. For example, Patent Literature 1 describes a technique for assisting a user in preparing eyebrows by displaying a face image obtained by imaging a user's face. Patent Document 2 describes a technique for processing and displaying an image obtained by capturing a user according to various uses.

JP 2007-293649 A JP2013-223001A

However, the conventional technology supports makeup applied to the human body, which is a three-dimensional object, using only the captured image, which is two-dimensional information, and there is a problem that there are limitations on the situations and methods that can be supported. It was.

The invention of claim 1 is a makeup support apparatus carried by the user when the user applies makeup to the user, and is acquired by the imaging unit that images the user and acquires imaging information. 3D measurement means for acquiring information on the 3D shape related to the user based on the captured image information and creating 3D shape information, and the 3D shape information generated by the 3D measurement means Information creation means for creating makeup support information for supporting makeup to be applied to a user, and display means for displaying makeup support information created by the information creation means.

Further, the invention of claim 2 is a makeup support apparatus according to the invention of claim 1, wherein the three-dimensional measuring means acquires information on a three-dimensional shape related to the user at the time of makeup of the user.

The invention of claim 3 is the makeup support apparatus according to the invention of claim 1, wherein the three-dimensional measuring means obtains information on the three-dimensional shape related to the user before the user's makeup. And prepared as three-dimensional shape information.

The invention of claim 4 is the makeup support system according to the invention of claim 3, wherein the information creation means is configured to obtain the three-dimensional shape information prepared by the three-dimensional measurement means by the user. The makeup support information is created by texture mapping the imaging information acquired by the imaging means during makeup.

Further, the invention of claim 5 is the makeup support apparatus according to the invention of claim 3, wherein the three-dimensional measuring means acquires information on a three-dimensional shape related to the user at the time of makeup of the user.

Further, the invention of claim 6 is the makeup support apparatus according to the invention of claim 5, and requires information relating to a three-dimensional shape based on imaging information acquired by the imaging means at the time of makeup of the user. And a specifying means for specifying the user's part.

The invention of claim 7 is a makeup support apparatus according to the invention of claim 6, wherein the specifying means is a part of the part imaged in the imaging information acquired by the imaging means at the time of makeup of the user. The part of the user who needs information on the three-dimensional shape is specified from among the three-dimensional measuring means, and the three-dimensional measuring means only has information on the three-dimensional shape for the part related to the user part specified by the specifying means. The three-dimensional shape information about the user is created by synthesizing the acquired information about the three-dimensional shape and the prepared three-dimensional shape information acquired at the time of makeup of the user.

The invention of claim 8 is the makeup support apparatus according to the invention of claim 6, wherein the specifying means is a part of the part that is not imaged by the imaging information acquired by the imaging means at the time of makeup of the user. The user's part that needs information about the three-dimensional shape is identified from among the three-dimensional shape information, and the three-dimensional measurement means includes the prepared three-dimensional shape information about the part related to the user part specified by the specifying means; The three-dimensional shape information is created by combining information about the three-dimensional shape related to the user acquired at the time of makeup of the user.

The invention of claim 9 is the makeup support apparatus according to the invention of claim 1, further comprising a viewpoint acquisition means for acquiring viewpoint information, wherein the information creation means is the viewpoint acquired by the viewpoint acquisition means. Makeup support information for supporting makeup to be applied to the user is created based on the information.

The invention of claim 10 is the makeup support apparatus according to the invention of claim 1, wherein the user's line of sight is estimated based on imaging information imaged by the imaging means at the time of makeup of the user. The display position of the makeup support information displayed on the display means is corrected.

The invention of claim 11 is the makeup support apparatus according to the invention of claim 1, wherein the skin quality of the user is estimated based on the three-dimensional shape information created by the three-dimensional measuring means. The information creation means creates makeup support information suitable for the skin quality at the time of makeup of the user estimated by the skin quality estimation means.

The invention of claim 12 is a makeup support apparatus according to the invention of claim 1, wherein an elasticity estimation means for estimating the elasticity of the skin surface based on a change in the skin surface when the skin surface is pressed. Further, the information creation means creates makeup support information suitable for the elasticity of the skin surface at the time of makeup of the user estimated by the elasticity estimation means.

The invention of claim 13 is the makeup support apparatus according to the invention of claim 1, further comprising pressing force estimation means for estimating a pressing force by the user at the time of makeup of the user, wherein the makeup support information is , Information on the pressing force by the user estimated by the pressing force estimation means is included.

The invention of claim 14 is the makeup support apparatus according to the invention of claim 1, further comprising speed estimation means for estimating a cosmetic application speed at the time of makeup of the user, wherein the makeup support information includes Information on the coating speed estimated by the speed estimation means is included.

The invention of claim 15 is the makeup support apparatus according to the invention of claim 1, further comprising cheekbone position estimating means for estimating the user's cheekbone position, wherein the information creating means is the cheekbone position estimating means. The makeup support information is created according to the position of the user's cheekbone estimated by the above.

The invention of claim 16 is the makeup support apparatus according to the invention of claim 1, further comprising light estimation means for estimating a light environment at the time of makeup, and light at the time of makeup estimated by the light estimation means. Based on the environment and the reference light environment, the imaging information captured by the imaging unit at the time of makeup by the user is corrected.

The invention of claim 17 is the makeup support apparatus according to the invention of claim 1, further comprising light estimation means for estimating a light environment at the time of makeup, and light at the time of makeup estimated by the light estimation means. Based on the environment and the light environment at the display location desired by the user, the imaging information captured by the imaging means at the time of makeup of the user is corrected.

The invention of claim 18 is the makeup support apparatus according to the invention of claim 1, further comprising light estimation means for estimating a light environment at the time of makeup, and light at the time of makeup estimated by the light estimation means. According to the environment, it further comprises facial color estimation means for estimating the facial color at the time of makeup of the user, and the information creating means provides makeup support information suitable for the facial color at the time of makeup of the user estimated by the facial color estimation means. create.

Further, the invention of claim 19 is a makeup support apparatus according to the invention of claim 1, wherein the information creating means creates makeup support information suitable for the light environment in a presentation place desired by the user.

The invention of claim 20 is the makeup support apparatus according to the invention of claim 1, wherein the information creating means selects a recommended article from among the articles possessed by the user, and the selected recommendation Include information about goods in makeup support information.

The invention of claim 21 is a makeup support apparatus according to the invention of claim 1, wherein the makeup support information includes predicted image information after makeup for the user.

Further, the invention of claim 22 is a makeup support apparatus according to the invention of claim 1, wherein the makeup support information includes information regarding a position where makeup should be applied to the user.

Further, the invention of claim 23 is the makeup support apparatus according to the invention of claim 1, wherein the makeup support information includes information on a concentration to be applied to the cosmetic.

Further, the invention of claim 24 is the makeup support apparatus according to the invention of claim 1, wherein the makeup support information includes information related to a degree of curvature of eyelashes.

The invention of claim 25 is the makeup support apparatus according to the invention of claim 1, wherein the makeup support information includes information on the end of makeup for the user, and the information creating means The end of the makeup is determined by comparing a plurality of parts.

The invention of claim 26 is a recording medium recording a program read by a computer carried by the user when the user applies makeup to the user, and causing the computer to execute the program. 3D shape information by acquiring information on a 3D shape related to the user based on the imaging information acquired by the imaging means acquired by the imaging means and imaging information acquired by the imaging means on the computer A step of creating makeup support information for supporting makeup applied to the user based on the created three-dimensional shape information, and a step of displaying the created makeup support information Let

According to the first to 26th aspects of the present invention, based on the imaging information acquired by the imaging means, information on the three-dimensional shape related to the user is acquired to generate the three-dimensional shape information, and the generated three-dimensional shape information By creating makeup support information for supporting makeup to be applied to the user based on the information and displaying the created makeup support information, the user can easily perform accurate and appropriate makeup regardless of location. be able to.

It is an external view which shows a makeup | decoration assistance apparatus. It is a block diagram of a makeup | decoration assistance apparatus. It is a figure which shows the functional block with which a makeup | decoration assistance apparatus is provided with the flow of data. It is a figure which illustrates the light environment estimated with respect to imaging information. It is a figure which illustrates the imaging information which imaged including the reference | standard object comprised with a white cube in the imaging range. It is a figure which shows the example displayed including a guide on a display user image according to the estimated cheekbone position. It is a figure which compares imaging information and makeup | decoration assistance information. It is a figure which illustrates the makeup | decoration assistance information containing the information regarding the position which should apply makeup | decoration. It is a figure which illustrates the makeup | decoration assistance information containing the information regarding the position which should apply makeup | decoration. It is a figure which illustrates the makeup | decoration assistance information displayed about eyelashes. It is a flowchart which shows the makeup | decoration assistance method implement | achieved by the makeup | decoration assistance apparatus. It is a figure which illustrates the menu image displayed on a display part. It is a flowchart which shows the pre-process performed by the makeup | decoration assistance apparatus. It is a flowchart which shows the makeup | decoration preparation process performed by the makeup | decoration assistance apparatus. It is a flowchart which shows the makeup | decoration assistance process performed by the makeup | decoration assistance apparatus. It is a conceptual diagram which shows a mode that the information regarding the three-dimensional shape acquired in real time and the preparation three-dimensional shape information are synthesize | combined.

1 makeup support device 10 CPU
DESCRIPTION OF SYMBOLS 100 Measurement control part 101 Specification part 102 Estimation part 103 Information preparation part 104 Correction | amendment part 11 Memory | storage device 110 Program 111 Database 112 Imaging information 112 Captured image 113 Three-dimensional shape information 114,114a, 114b Makeup support information 4

Operation part

5,6 Display Unit 7 Measuring unit 70 Projecting unit 71

Imaging unit

80, 81 Image 90

Reference object

91, 92, 93, 94, 95, 96 Guide

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, unless otherwise specified in the following description, descriptions of directions and orientations correspond to the drawings for the convenience of the description, and do not limit, for example, a product, a product, or a scope of rights.

In addition, this application claims the benefit of Patent Application No. 2014-073896 filed in Japan on March 31, 2014, and the contents of the application are incorporated herein by reference.

FIG. 1 is an external view showing a makeup support apparatus 1. As shown in FIG. 1, the makeup support apparatus 1 includes a casing unit 2, a main body unit 3, an operation unit 4,

display units

5 and 6, and a measurement unit 7. The makeup support apparatus 1 is configured as a device that can be carried by a user. The user can carry the makeup support apparatus 1 and move to various places, and can freely activate and use the makeup support apparatus 1 at the destination.

In the following description, “when applying” means not only the moment when the user is actually applying makeup, but also the makeup support apparatus 1 (application for assisting makeup) for applying makeup unless otherwise specified. The period from when the user activates to when the user instructs the makeup support apparatus 1 to end makeup is assumed to be said. That is, the period when the user checks his / her state with the makeup support apparatus 1 in order to perform makeup is included in the “makeup” period.

In addition, the makeup support apparatus 1 can set a normal operation mode, a sub power saving operation mode, and a power saving operation mode as operation modes when assisting the user's makeup. Although details of each operation mode will be described later, switching of these operation modes is performed based on a control signal (user instruction) from the operation unit 4 or information set in advance.

Also, in the following explanation, makeup will be described as an example of dressing that is conscious of being seen by others on the go. However, “makeup” in the present invention is not limited to makeup for dressing. However, “makeup” in the present invention includes, for example, makeup for maintaining health and beauty (so-called “care”) or makeup removal.

The housing part 2 is a substantially box-like structure and houses the main body part 3 in a folded state. Thereby, makeup support device 1 is further miniaturized so that it is convenient to carry when carried by the user. Moreover, the housing | casing part 2 also has the function to protect the

display parts

5 and 6 by accommodating the

display parts

5 and 6 inside.

The main body 3 is a rectangular plate-like structure, and a display unit 5 is provided on the front surface and a measuring unit 7 is provided on the upper front surface. The main body 3 is rotatable around a shaft (not shown). Thereby, the makeup support apparatus 1 can be deformed between a state in which the main body 3 is taken out from the housing 2 and a state in which the main body 3 is accommodated in the housing 2. That is, the makeup support apparatus 1 has a structure in which the main body 3 is stored in the housing 2 by folding the main body 3.

The operation unit 4 is hardware that the user operates to input instructions to the makeup support apparatus 1. In FIG. 1, a plurality of buttons are illustrated as the operation unit 4. However, the makeup support apparatus 1 includes a touch panel as the operation unit 4 in addition to the buttons illustrated in FIG. That is, the touch sensors are provided on the surfaces of the

display units

5 and 6, and the user can input the instruction information to the makeup support apparatus 1 by touching the screen. In addition to this, the makeup support apparatus 1 may include, for example, various keys and switches, a pointing device, a jog dial, or the like as the operation unit 4. The operation unit 4 has a function as a viewpoint acquisition unit that acquires viewpoint information (described later).

Display units

5 and 6 are hardware having a function of outputting various data to the user by displaying the various data. In FIG. 1, a liquid crystal display is shown as the

display units

5 and 6. The user can receive various information from the makeup support apparatus 1 by browsing the

display units

5 and 6 during makeup. Thereby, the user can easily enjoy appropriate and advanced makeup. In addition, the makeup | decoration assistance apparatus 1 may be provided with a lamp | ramp, LED, a liquid crystal panel etc. other than a liquid crystal display as the

display parts

5 and 6, for example.

FIG. 2 is a block diagram of the makeup support apparatus 1. The makeup support apparatus 1 includes a CPU 10 and a storage device 11 in addition to the configuration shown in FIG.

The CPU 10 reads and executes the program 110 stored in the storage device 11, and performs various data calculations, control signal generation, and the like. Thereby, CPU10 has a function which calculates and produces various data while controlling each structure with which makeup support apparatus 1 is provided. That is, the makeup support apparatus 1 is configured as a general computer.

The storage device 11 provides a function of storing various data in the makeup support device 1. In other words, the storage device 11 stores information electronically fixed in the makeup support apparatus 1.

As the storage device 11, a RAM or buffer used as a temporary working area of the CPU 10, a read-only ROM, a non-volatile memory (for example, a NAND memory), and a portable storage medium mounted on the dedicated reading device (SD card, USB memory, etc.) In FIG. 2, the storage device 11 is illustrated as if it were one structure. However, the storage device 11 is normally composed of a plurality of types of devices that are employed as necessary among the various devices (or media) exemplified above. That is, the storage device 11 is a general term for a group of devices having a function of storing data.

Further, the actual CPU 10 is an electronic circuit having a RAM that can be accessed at high speed. However, the storage device included in the CPU 10 is also included in the storage device 11 for convenience of explanation. That is, it is assumed that the storage device 11 also stores data temporarily stored in the CPU 10 itself. As shown in FIG. 2, the storage device 11 is used to store a program 110, a database 111, imaging information 112, three-dimensional shape information 113, makeup support information 114, and the like.

Here, in the database 111, the owner information, how to make up according to the situation (concentration, application position, application method, force adjustment, type of article to be used, etc.), standard light environment (ideal light environment), Stores lighting environment, etc. according to the show location.

Owner information refers to personal information that affects makeup such as the user's gender, age, and preferences, imaging information 112, preparatory three-dimensional shape information (described later), and information on items (such as cosmetics and tools) possessed by the user. Etc.

Although details will be described later, the imaging information 112 included in the database 111 (owner information) is information acquired by the imaging unit 71, but is not information that is captured in real time at the time of makeup, but is captured and prepared in advance. Information. The subject included in such imaging information 112 includes a part of the user's part that is expected to be difficult to image while applying makeup.

During makeup, the user is expected to place (have) the makeup support apparatus 1 so as to face the user so that the

display units

5 and 6 can be easily viewed. In such an arrangement, since the imaging unit 71 faces the user, the imaging unit 71 images the user from the front, and conversely, it is difficult to capture in real time the part that is not facing the front at the time of makeup. is there. As such a part, for example, the temporal region, the occipital region, the top of the head, the throat, and the like are assumed. The makeup support apparatus 1 images such a part in advance to create imaging information 112 and stores it in the database 111.

Further, the imaging information 112 in this case does not need to be a moving image, and may be only a still image for one frame for each part. However, the imaging information 112 does not necessarily have to be information obtained by selectively imaging a region, and may be captured over the entire circumference of the user's head, for example.

Also, the standard light environment is a light environment that the user acquires in advance at home or the like. As such an optical environment, an optical environment that illuminates the subject from multiple directions is desirable so that shade is not generated at the site to which makeup is applied. A method for acquiring the reference light environment will be described later.

Also, the light environment according to the show location is the assumed light environment in a place that is assumed as a place where the user puts off the makeup. For example, outdoor locations such as parks and beaches, offices, residential interiors, restaurants, bar counters, hotel lobbies, event venues, and car interiors are assumed. In the makeup support apparatus 1, the light environment assumed at the presentation place is acquired for each predicted place and stored in the database 111.

The makeup support apparatus 1 includes two

display units

5 and 6 as shown in FIGS. 1 and 2, and is configured as a so-called twin display structure apparatus. In the makeup support apparatus 1, the

display units

5 and 6 have a function of displaying makeup support information 114.

In the following description, an example in which makeup support information 114 is displayed on the display unit 5 will be described in order to simplify the description. However, unless otherwise specified, the makeup support information 114 may be displayed on the display unit 6 or may be displayed separately on the display unit 5 and the display unit 6. For example, the makeup support apparatus 1 can display the image of the current state on the display unit 5 and simultaneously display the image of the makeup completed state on the display unit 6. Alternatively, it is possible to display an image of the user's profile on the display unit 6 while displaying an image when the user's face is viewed from the front.

As shown in FIG. 2, the measuring unit 7 includes a light projecting unit 70 and an imaging unit 71.

The light projecting unit 70 has a function of projecting a pattern having a known shape toward a measurement target. Note that the measurement target is a body part of a user to be a makeup target.

The light projecting unit 70 shown here projects the pattern by invisible light. Note that the invisible light referred to here is light having a wavelength that is not perceived by human vision. In addition, the pattern projected by the light projecting unit 70 is referred to as a “measurement pattern” in the following description.

The imaging unit 71 is a general digital camera, and captures imaging information 112 by imaging a subject (user). The imaging unit 71 shown here acquires imaging information 112 as a color moving image. Here, the moving image means that the imaging information 112 is acquired as a collection of continuous still images captured at a predetermined frame interval. Note that the imaging unit 71 is not limited to color, and may acquire a monochrome image.

FIG. 3 is a diagram illustrating functional blocks included in the makeup support apparatus 1 together with a data flow. The measurement control unit 100, the specifying unit 101, the estimation unit 102, the information creation unit 103, and the correction unit 104 illustrated in FIG. 3 are functional blocks realized by the CPU 10 operating according to the program 110.

The measurement control unit 100 controls the light projecting unit 70 according to a control signal (user instruction) from the operation unit 4 to cause the light projecting unit 70 to project a measurement pattern toward the subject.

The measurement control unit 100 also has a function of controlling the imaging unit 71 in accordance with a control signal (user instruction) from the operation unit 4 to cause the imaging unit 71 to image a subject. Then, the measurement control unit 100 transfers the imaging information 112 acquired by the imaging unit 71 to the storage device 11 and stores it in the storage device 11.

Further, the measurement control unit 100 acquires the three-dimensional shape information 113 related to the user based on the imaging information 112 acquired by the imaging unit 71.

Specifically, first, the measurement control unit 100 performs image recognition processing on the imaging information 112 and cuts out an image portion expressing the user (hereinafter referred to as “user captured image”). However, the original imaging information 112 from which the user captured image is cut out may be information for one frame of the imaging information 112 constituting the moving image. In addition to the user's body itself, the user-captured image referred to here may include clothes (such as clothes) worn by the user, such as clothes, a hat, a ribbon, and glasses.

Next, the measurement control unit 100 analyzes how the measurement pattern captured in the user captured image (imaging information 112) is deformed with respect to the known shape, thereby obtaining the user's shape. Is converted into numerical information expressed in three dimensions. As such a technique, it is possible to adopt a conventional technique, and therefore, detailed description thereof is omitted here. And the measurement control part 100 makes this numerical information the three-dimensional shape information 113. FIG.

That is, in the makeup support apparatus 1, the measurement unit 7 and the measurement control unit 100 correspond to a three-dimensional measurement unit, and the measurement unit 7 also includes an imaging unit 71.

In a device that is carried by a user and used in a mobile environment, it is usually difficult to obtain information about the user's three-dimensional shape by simultaneously photographing from a plurality of cameras set at different angles. However, in the makeup support apparatus 1, by projecting the measurement pattern from the light projecting unit 70, the three-dimensional shape information 113 regarding the user can be acquired even when the imaging unit 71 captures images from only one direction. . In other words, makeup support device 1 configured as a device carried by the user can perform makeup support based on the three-dimensional shape of the user.

It should be noted that the three-dimensional measuring unit in the present invention is not limited to the above configuration. Any three-dimensional measuring unit may be used as long as it can acquire user three-dimensional information. As such a technique, for example, stm (structure from) that measures and estimates a three-dimensional shape from multiple viewpoint images, such as TOF (Time や Of Flight), stereo method without pattern projection, or DTAM (Dense Tracking And Mapping) A technique such as motion) can also be employed.

In addition, when the user is not applying makeup and the 3D shape information 113 is created, the measurement control unit 100 stores the 3D shape information 113 in the database 111 as the prepared 3D shape information. That is, the measurement control unit 100 has a function of acquiring the three-dimensional shape information 113 related to the user as the prepared three-dimensional shape information in advance before the user's makeup. Note that the measurement control unit 100 may store the imaging information 112 in the database 111 as well.

In addition, the measurement control unit 100 stores information on the three-dimensional shape of the user's specific part based on information transmitted from the specification part 101 (hereinafter referred to as “specific part information”). 3D shape information 113 is also obtained from the prepared 3D shape information).

Furthermore, in order to create information on the three-dimensional shape of the user's specific part based on the specific part information, the measurement control unit 100 causes the light projecting part 70 to project the measurement pattern onto the part. Control. As described above, when the light projecting unit 70 partially projects the measurement pattern, the measurement control unit 100 obtains information regarding the three-dimensional shape based on the imaging information 112 only for the part on which the measurement pattern is projected. create. On the other hand, the measurement control unit 100 acquires information on the three-dimensional shape for other parts from the database 111 (prepared three-dimensional shape information). And the measurement control part 100 synthesize | combines these and produces the three-dimensional shape information 113. FIG.

As described above, the three-dimensional shape information 113 created at the time of makeup by the user may be composed of prepared three-dimensional shape information for a specific part of the user. However, details will be described later.

The identification unit 101 has a function of identifying a part of the user who needs information on a three-dimensional shape based on the imaging information 112 acquired by the imaging unit 71 at the time of user makeup according to the operation mode. is doing.

Further, the specifying unit 101 transmits the specified part of the user to the measurement control unit 100 as specific part information. Although details will be described later, a case where a part of a user who needs information on a three-dimensional shape is specified from parts picked up in the imaging information 112 at the time of makeup of the user and a case of imaging when the user is makeup There is a case where a part of a user who needs information on a three-dimensional shape is specified from parts not imaged in the information 112.

The estimation unit 102 has a function of estimating various situations and states during makeup based on the imaging information 112 and the three-dimensional shape information 113 and transmitting the estimation result to the information creation unit 103. The estimation result transmitted from the estimation unit 102 to the information creation unit 103 is hereinafter referred to as “estimation information”.

First, the estimation unit 102 measures the degree of skin roughness (skin irregularities) of the user during makeup based on the three-dimensional shape information 113 acquired by the measurement control unit 100, and estimates the skin quality. In the case of measuring skin quality, a dedicated sensor (such as a sensor pressed against the skin surface) may be connected to the makeup support apparatus 1 for measurement. In that case, more detailed skin quality can be measured as compared with the case where the skin quality is determined by the imaging information 112 and the three-dimensional shape information 113.

Also, the estimation unit 102 estimates the elasticity of the skin surface based on the change in the skin surface when the skin surface is pressed. For example, the estimation unit 102 estimates the skin surface repair speed when the user presses and releases the skin surface with a finger or a stick based on the imaging information 112, and estimates the elasticity of the skin surface. How much the user has pressed the skin surface can be obtained from the three-dimensional shape information 113, and the time until the skin surface is repaired can be obtained from the number of frames of the imaging information 112. Note that the makeup support apparatus 1 may be provided with a pressure sensor, and the pressure sensor may be pressed against the skin surface to measure the elasticity of the skin surface.

Further, the estimation unit 102 estimates the pressing force by the user at the time of user makeup. For example, the degree of skin dent when applying cosmetics with a brush is measured as the amount of skin depression obtained from the three-dimensional shape information 113. Thereby, the estimation unit 102 estimates how much force the user presses the brush.

In addition, the estimation unit 102 estimates the application speed of cosmetics at the time of makeup by the user. The coating speed can be obtained, for example, depending on how much distance is applied over how long. The distance can be determined based on the three-dimensional shape information 113 and / or the imaging information 112. Further, how long it takes to apply can be obtained from the number of frames of the imaging information 112 based on the imaging information 112 acquired as a moving image.

Also, the estimation unit 102 estimates the cheekbone position based on the three-dimensional shape information 113. The estimation unit 102 analyzes the three-dimensional shape of the user's face based on the three-dimensional shape information 113, and specifies the position of the cheekbone from the undulation distribution state. The cheekbone position is specified as a three-dimensional area (undulation area) having a certain size. Then, the undulating region is specified as a region having a shape unique to each user. That is, the cheekbone position here is a concept including a position and a shape.

Further, the estimation unit 102 estimates the light environment during makeup. In particular, the estimation unit 102 estimates the light beam direction and light intensity, and also estimates the color of light emitted toward the user. For example, the following method can be employed as a method for the estimation unit 102 to estimate (specify) the light environment during makeup.

First, a plurality of rendering images when a specific intensity of light is applied from a specific direction to the three-dimensional shape information 113 acquired in real time during makeup are created while changing the direction and intensity. Then, by comparing the luminance distribution between the rendered image and the imaging information 112 acquired in real time at the time of makeup, the combination having the highest degree of coincidence is identified as the light environment (direction and intensity of light) at the time of makeup.

FIG. 4 is a diagram illustrating a light environment estimated with respect to the imaging information 112. Thus, by estimating the direction of the light beam and the intensity of the light beam, for example, a black region such as the mouth can be determined to be a “shadow”. Thereby, for example, it is possible to avoid giving an instruction to apply the region with cosmetics by mistake.

Also, as a method for estimating the color of light in the light environment at the time of makeup, imaging information 112 is created by imaging a reference object (for example, a white cube) with a known color at the time of makeup. Then, by analyzing how the color of the object is imaged in the imaging information 112, the color of light irradiated on the object (that is, the color of light in the light environment at the time of makeup) is determined. presume.

FIG. 5 is a diagram exemplifying imaging information 112 obtained by imaging the reference object 90 composed of white cubes in the imaging range. In the imaging information 112 shown in FIG. 5, if the color of the pixel representing the reference object 90 is determined and compared with a known color, the color of light in the light environment when the imaging information 112 is captured can be specified. It becomes. It should be noted that the reference object 90 can be registered in advance as an object of known color, such as the user's hair or the edge of glasses that are always used, and is likely to be imaged during makeup. As a substitute.

Further, the estimation unit 102 estimates the face color at the time of makeup of the user according to the estimated light environment at the time of makeup. For example, the estimation unit 102 identifies the facial color of the user at the time of makeup by removing the estimated influence of the light environment at the time of makeup from the facial skin portion of the imaging information 112 (user captured image) captured at the time of makeup. .

The information creation unit 103 creates makeup support information 114 for supporting makeup applied to the user based on the three-dimensional shape information 113 acquired by the measurement control unit 100.

Specifically, an image (hereinafter referred to as a “display user image”) is created in the three-dimensional shape information 113 by using a texture mapping technique using the imaging information 112 captured at the time of makeup, and the display user image is included. Makeup support information 114 is created. The display user image is an image that is displayed on the display unit 5 and plays a role of a so-called mirror image during makeup.

However, although the details will be described sequentially, the display user image in the makeup support apparatus 1 is displayed not as a simple mirror image but as an image that has been processed to be useful for the user who performs makeup. For example, the viewpoint (angle) in the display user image is not limited to the imaging direction, and can be changed according to the place where makeup is applied. Based on the viewpoint information input from the operation unit 4, the information creation unit 103 determines from which direction the display user image is to be created. In addition, a display user image zoomed to a place where makeup is to be applied can be created based on instruction information from the operation unit 4.

Further, when creating the makeup support information 114, the information creation unit 103 searches the database 111 as appropriate, information indicating how to make up according to the situation, information on cosmetics and tools to be used (recommended article information) ) And the like are included in the makeup support information 114.

Information used as a condition (search key) when the information creation unit 103 searches the database 111 includes information transmitted from the operation unit 4 (instruction information from the user) and information transmitted from the estimation unit 102. There is estimated information. Below, the specific example which produces the makeup | decoration assistance information 114 mainly with estimation information is demonstrated.

The information creation unit 103 creates makeup support information 114 suitable for the skin quality at the time of makeup of the user estimated by the estimation unit 102. Specifically, based on the estimated skin quality, a makeup method corresponding to the situation included in the database 111 is searched, information indicating a makeup method suitable for the skin quality is acquired, and makeup support information 114 Include in

For example, if the skin appears to be rough during makeup, makeup support such as modest makeup or recommending medicinal cosmetics is considered in consideration of health. Alternatively, when it is estimated that the skin quality is good, it is expected that the makeup is good, so makeup support such as reducing the number of times of painting may be considered. Thus, the makeup support apparatus 1 can perform makeup support suitable for the skin quality during makeup.

Also, the information creation unit 103 creates makeup support information 114 suitable for the elasticity of the skin surface at the time of makeup of the user estimated by the estimation unit 102. Specifically, based on the estimated elasticity of the skin surface, a makeup method according to the situation included in the database 111 is searched, information indicating a makeup method according to the elasticity is acquired, and makeup support information 114. Thereby, the makeup | decoration assistance apparatus 1 can perform the makeup | decoration assistance suitable for the elasticity of the skin surface at the time of makeup | decoration.

Also, the information creation unit 103 creates makeup support information 114 so as to include information on the pressing force by the user estimated by the estimation unit 102. Specifically, based on the estimated pressing force, a makeup method corresponding to the situation included in the database 111 is searched, a message indicating whether the pressing force is appropriate, and a remaining coating corresponding to the pressing force. The number of times is acquired and included in the makeup support information 114. Thereby, the makeup | decoration assistance apparatus 1 can determine the propriety of the pressing force by a user, and can perform makeup | decoration assistance.

Also, the information creation unit 103 creates makeup support information 114 so as to include information on the application speed estimated by the estimation unit 102. Specifically, based on the estimated application speed, a makeup method corresponding to the situation included in the database 111 is searched, a message indicating whether the application speed is appropriate, and a remaining application corresponding to the application speed. The number of times is acquired and included in the makeup support information 114. Thereby, the makeup | decoration assistance apparatus 1 can determine the suitability of the application speed by a user, and can perform the makeup | decoration assistance with respect to the said user.

The information creation unit 103 creates makeup support information 114 according to the user's cheekbone position estimated by the estimation unit 102. Specifically, the application position of cosmetics such as teak is determined based on the position of the cheekbone. That is, based on the estimated cheekbone position, a makeup method corresponding to the situation included in the database 111 is searched, information indicating the application position according to the cheekbone position is acquired, and included in the makeup support information 114. Thereby, the makeup | decoration assistance apparatus 1 can perform the makeup | decoration assistance suitable for a user's cheekbone position.

FIG. 6 is a diagram illustrating an example in which the guide 91 is displayed on the display user image (makeup support information 114) according to the estimated cheekbone position. In the example illustrated in FIG. 6, the guide 91 is displayed as a circle indicating a region where cosmetics are to be applied.

Also, the information creation unit 103 creates makeup support information 114 according to the light environment during makeup estimated by the estimation unit 102. Specifically, based on the estimated light environment, a makeup method corresponding to the situation included in the database 111 is searched, information indicating a makeup method suitable for the light environment is acquired, and makeup support information 114 is obtained. Include in Thereby, the makeup | decoration assistance apparatus 1 becomes possible for the makeup | decoration assistance which considered the present light environment. Note that the information creation unit 103 uses parameters indicating the light environment, such as the light beam direction, light beam intensity, and light color.

Further, the information creation unit 103 is imaged by the imaging unit 71 at the time of makeup of the user based on the light environment at the time of makeup estimated by the estimation unit 102 and the reference light environment stored in the database 111. The captured image information 112 is corrected. That is, the information creation unit 103 corrects the user captured image acquired at the time of makeup to a display user image corresponding to the reference light environment.

FIG. 7 is a diagram for comparing the imaging information 112 and the makeup support information 114. The imaging information 112 shown on the left side in FIG. 7 is an image (an image before correction) in the current (makeup) light environment.

The information creation unit 103 extracts the user captured image acquired at the time of makeup from the imaging information 112, and converts the user captured image into an image from which the influence of the light environment has been removed based on the estimated light environment at the time of makeup. . Next, a reference light environment stored in the database 111 is acquired, and image processing is further performed on the converted image so as to obtain an image as if it was captured in the acquired reference light environment. To create a display user image. Then, makeup support information 114 (the image on the right side in FIG. 7) including the display user image created in this way is created.

Thereby, the user can always confirm the appearance in the standard light environment. Therefore, stable makeup can be performed without being influenced by the light environment of the destination. Note that the information creation unit 103 determines whether or not to correct the user-captured image so as to be a display user image in the reference light environment based on instruction information input by the user operating the operation unit 4.

Further, the information creating unit 103 corrects the imaging information 112 captured at the time of makeup of the user based on the light environment at the time of makeup estimated by the estimation unit 102 and the light environment at the presentation place desired by the user. To do. That is, the information creation unit 103 corrects the user captured image acquired at the time of makeup to a display user image corresponding to the light environment at the presentation place desired by the user.

More specifically, a user captured image acquired at the time of makeup is extracted from the imaging information 112, and based on the estimated light environment at the time of makeup, the user captured image is converted into an image from which the influence of the light environment has been removed. . Next, using the instruction information from the operation unit 4 as a search key, the light environment at the show location stored in the database 111 is searched to identify the light environment at the show location desired by the user. For example, when the user operates the operation unit 4 to input instruction information for designating “restaurant” as a show place, the light environment in the restaurant is specified from the database 111. Then, a display user image is created by further performing image processing on the converted image so as to obtain an image as if it was captured in the light environment of the identified restaurant.

Thereby, the user can confirm the appearance of the makeup in the light environment of the place where the makeup is exhibited. The information creation unit 103 determines whether or not to correct the user captured image so as to be a display user image of the light environment at the presentation place desired by the user. The instruction information that the user inputs by operating the operation unit 4 Judgment by.

Also, the information creation unit 103 creates makeup support information 114 suitable for the face color at the time of makeup of the user estimated by the estimation unit 102. Thereby, appropriate makeup support can be performed according to the facial color (health state, etc.) at that time without being affected by changes in the light environment.

In addition, the information creation unit 103 creates makeup support information 114 suitable for the light environment in the presentation place desired by the user. Specifically, the makeup method corresponding to the situation in the database 111 is searched using information indicating the user's desired show location input from the operation unit 4 as a search key.

For example, when “restaurant” is input as a desired display place of the user, the makeup method suitable for the restaurant is specified from the database 111 using “restaurant” as a search key. The information creating unit 103 includes the specified makeup method in the makeup support information 114 in this way. The user browses the makeup support information 114 displayed on the display unit 5 and performs makeup according to the browse support information 114, thereby completing makeup that shines in the “restaurant” without any particular awareness. Thus, the makeup support apparatus 1 can perform appropriate makeup support corresponding to the light environment of the place where makeup is performed.

Also, the information creation unit creates makeup support information 114 for supporting makeup to be applied to the user based on the viewpoint information acquired by the operation unit 4. For example, when an instruction (viewpoint information) for confirming a profile is input from the operation unit 4, an image of the profile of the user is created as a display user image and included in the makeup support information 114.

The makeup support information 114 shown in FIG. 6 is an image displayed in a state where the user is facing the imaging unit 71. Thus, since the makeup | decoration assistance apparatus 1 can produce a display user image based on the three-dimensional shape information 113, it can display not only the image from one direction but the image from various directions (angle). Therefore, the user can confirm the appearance of the makeup for himself / herself from various viewpoints (angles).

Also, the user can not only confirm the appearance but also make up while changing the viewpoint (angle) by operating the operation unit 4 during makeup. For example, the user can make a makeup while facing the display unit 5 while displaying the profile on the display unit 5 as a display user image. That is, it is possible to make up the side face while looking at the image (side view image) facing the side face instead of making up the side face (for example, cheek) while looking at the image from the front. Therefore, the user can make up correctly.

In such a case, it may be possible to apply makeup while facing sideways to some extent so as to image the side surface. However, in that case, the displayed mirror image also moves in the side surface direction, so it is necessary to shift the line of sight from the front direction to the side surface direction, and the viewing performance by the user is degraded.

Further, the information creation unit 103 creates makeup support information 114 according to the makeup purpose of the user. The user's makeup purpose is the user's desire to give an impression, and examples include makeup that looks neat, makeup that looks healthy, gorgeous makeup, wild makeup, etc. . That is, even if it is the same scene, the impression that the user desires to give to the other party is different.

Thus, when the information creation unit 103 creates the makeup support information 114 corresponding to the makeup purpose of the user, makeup variations that can be proposed to the user are increased, and versatility is improved. In addition, a user's makeup | decoration objective can be input as instruction information from the operation part 4, for example.

Also, the information creation unit 103 selects a recommended article from among the articles possessed by the user registered in the database 111, and includes information on the selected recommended article in the makeup support information 114. Thereby, the optimal article | item according to a condition can be proposed and a user's makeup can be supported more appropriately. Note that brushes, brushes, rollers, pads, curlers, and the like are assumed as recommended articles. In addition, when a plurality of articles of the same kind are registered, an optimum article is recommended as a recommended article depending on the situation. For example, when A brush and B brush are registered, a pattern is assumed in which A brush is recommended when using C cosmetics and B brush is recommended when using D cosmetics.

Further, the information creation unit 103 creates makeup support information 114 including predicted image information after makeup for the user by searching the database 111 according to the situation. For example, the information creation unit 103 creates a display user image when cosmetics recommended according to the situation are executed by a recommended method of use by image processing based on prediction, and includes them in the makeup support information 114.

Thereby, the user can start the makeup after confirming the state after the makeup is completed. Therefore, the makeup support apparatus 1 can appropriately support makeup so as not to have an unexpected result of the user. The information creation unit 103 may create the subsequent makeup support information 114 so that the predicted image information is corrected by the user and then is in a corrected state.

In addition, the information creation unit 103 creates makeup support information 114 including information on a position where makeup should be applied to the user. Further, the position where makeup is to be applied includes information about the application start position when applying cosmetics, the application end position when applying cosmetics, or the trajectory when applying cosmetics.

FIG. 8 and FIG. 9 are diagrams illustrating makeup support information 114 including information on a position where makeup should be applied. FIG. 8 shows

linear guides

92 and 93 together with the display user image. FIG. 9 shows

elliptical guides

94, 95, and 96 together with the display user image.

Such guides 92 to 96 can be determined by the following method. For example, the starting point of the cheek is determined based on the position of the cheekbones, black eyes, and nose. Based on the start point of the cheek and the face image from the side, the end point of the cheek and the shape of the region to be painted are determined. The start point and length of the highlight are determined by the shape of the face. The position of the eye shadow and the size and shape of the area to be painted are determined based on the double width and the size of the eye hole. The position of shading and the size and shape of the area to be painted are determined by the shape of the face, chin, position of the gill, and the size of the forehead.

Also, it is possible to display what kind of curve should be applied when applying a cheek based on the position and shape of the cheekbone (for example, a locus display by a curved arrow). Furthermore, the recommended application speed can be expressed by displaying the guides 92 to 96 in an animation. For example, an expression method is possible in which the arrow is gradually extended from the starting point according to the optimum application speed in the direction of application. If such an expression method is used, it is possible to guide the user to apply individual cosmetics.

The makeup support apparatus 1 includes the guides 92 to 96 together with the display user image in the makeup support information 114 and displays them. By comprising in this way, the makeup | decoration assistance apparatus 1 can show specifically how to apply makeup to which site | part.

Also, the information creation unit 103 creates makeup support information 114 including information on the concentration to be applied to the cosmetic by searching the database 111. For example, when applying a cheek, a patch image having a recommended density (color) is displayed as makeup support information 114 in the vicinity of the portion to be applied with the cheek in the displayed user image.

Thus, for example, when the user compares the color of the cheek that is being cheeked with the color of the displayed patch image and feels that the color of the cheek is equal to the color of the patch image, the user completes Judgment can be made. Note that even if the density is simply referred to, there may be a case where the density gradually changes as in the degree of gradation change. Gradation is a technique used when applying eye shadow, teak, or the like, and can be determined according to, for example, the type of cosmetic to be applied, the size or shape of the region, and the like.

Also, the information creation unit 103 creates makeup support information 114 including information on the degree of curling of the eyelashes.

FIG. 10 is a diagram illustrating

makeup support information

114a and 114b displayed for eyelashes. The makeup support information 114a is makeup support information 114 in which the peripheral region of the current eyelashes is displayed as a user image. The makeup support information 114b is makeup support information 114 in which a peripheral part of eyelashes created by predicting a state where makeup is completed is used as a display user image. That is, the makeup support information 114b is makeup support information 114 including a display user image as predicted image information.

As is clear from FIG. 10, in both of the

makeup support information

114a and 114b, the degree of curling of the eyelashes is expressed as an image based on the three-dimensional shape information 113. By displaying such makeup support information 114, the user can easily adjust the curved shape (curl) of the eyelashes.

Also, the information creation unit 103 creates makeup support information 114 including information related to the end of makeup for the user. For example, the makeup support information 114 for notifying the end of the application of the cosmetic product is created when the target color is obtained by applying the cosmetic product. Thereby, for example, the user can avoid excessive makeup.

Also, the information creation unit 103 determines the end of the makeup by comparing the progress of the makeup on the plurality of parts of the user. For example, the information creation unit 103 compares the left cheek with the right cheek, and creates makeup support information 114 that notifies the end of makeup on the cheek when both colors become equal. Thereby, the user can balance with other parts.

The correction unit 104 illustrated in FIG. 3 estimates the user's line of sight based on the imaging information 112 and / or the three-dimensional shape information 113 captured by the imaging unit 71 during the user's makeup, and thus based on the change in the line of sight. Then, the display position of the makeup support information 114 displayed on the display unit 5 is corrected.

The above is the description of the configuration and functions of the makeup support apparatus 1. Next, a method for assisting the user's makeup using the makeup support apparatus 1 will be described. Note that the user can make up using the makeup support apparatus 1 in the manner of possessing a general compact.

FIG. 11 is a flowchart showing a makeup support method realized by the makeup support apparatus 1. In addition, before each process shown in FIG. 11 is started, the database 111 of the makeup support apparatus 1 includes basic information such as “how to apply makeup according to the situation” and “light environment according to the show location”. Is stored. Unless otherwise specified, each step shown in FIG. 11 is executed by the CPU 10 operating according to the program 110.

When the makeup support apparatus 1 is turned on, the makeup support apparatus 1 executes a predetermined initial setting. Then, when an application for supporting makeup (hereinafter referred to as “makeup application”) is activated by the user, makeup support apparatus 1 displays a menu on display unit 5 (step S1).

FIG. 12 is a diagram illustrating a menu image 50 displayed on the display unit 5. As shown in FIG. 12, the menu image 50 is provided with

button images

40, 41, 42, and 43. Each

button image

40, 41, 42, 43 is configured to be selected by the user touching the image or operating the operation unit 4.

The button image 40 is an image selected when performing user registration. User registration is a process required when a user inputs owner information. In user registration, the makeup support apparatus 1 displays a predetermined GUI screen (not shown). The user is configured to complete user registration (input of owner information) by inputting necessary items in accordance with the displayed GUI screen. However, in the following description (including FIG. 11), description of user registration is omitted.

The button image 41 is an image that is selected when pre-processing is performed. The pre-processing is processing for pre-registering the imaging information 112 and the prepared three-dimensional shape information to be registered in the database 111, and details will be described later.

The button image 42 is an image selected when the user actually starts makeup. Processing after makeup is started (after the button image 43 is operated) will be described later.

The button image 43 is an image that is selected when the makeup application is terminated.

Returning to FIG. 11, when step S1 is executed and the menu image 50 is displayed, the CPU 10 waits while repeating step S1 until instruction information is input (step S2).

When any one of the

button images

40, 41, 42, and 43 in the menu image 50 is operated, instruction information is input according to the operation, and the CPU 10 determines Yes in step S2.

When the button image 41 is operated in the menu image 50 and the input instruction information becomes “pre-processing”, the CPU 10 determines Yes in step S3 and executes pre-processing (step S4).

FIG. 13 is a flowchart showing pre-processing executed by the makeup support apparatus 1.

When the pre-processing is started, the CPU 10 waits until the measurement preparation by the user is completed (step S11). In preparation for measurement, in principle, the user removes all makeup (especially, makeup for influencing the color) and enters a natural state. In preparation for measurement, the user prepares a reference light environment.

When the predetermined preparation is completed, the user operates the operation unit 4 to input instruction information indicating that the measurement preparation is completed. In response to this, the CPU 10 determines Yes in step S11 and controls the light projecting unit 70 so as to start projecting the measurement pattern. Thereby, the light projection part 70 starts the projection of the pattern for a measurement (step S12).

Next, the CPU 10 controls the imaging unit 71 so as to start imaging. In response to this, the imaging unit 71 starts imaging (step S13). Thereby, the imaging information 112 is acquired thereafter until the pre-processing is completed. Note that the imaging information 112 acquired at this time is displayed on the display unit 5 and can be confirmed by the user.

When imaging is started, the CPU 10 acquires the light environment at this time as a reference light environment based on the imaging information 112 (step S14). The CPU 10 stores the acquired reference light environment in the database 111.

If the color of light emitted in the reference light environment prepared by the user is not white, the display unit 5 displays the reference object (this embodiment) before the step S14 is executed. A message that prompts the imaging unit 71 to present a white cube in the form may be displayed.

Even after the light environment serving as a reference is acquired, the imaging unit 71 continues imaging and continues to acquire the imaging information 112 (step S15).

After step S14 is completed, the user images the entire circumference of the user himself / herself while moving the makeup support apparatus 1. The measurement control unit 100 extracts the user captured image from the captured image information 112 acquired while step S15 is continued, and combines information from each direction. When the measurement control unit 100 analyzes the combined user-captured image and determines that an image over the entire circumference has been obtained, the measurement control unit 100 ends Step S15. Thereby, imaging of the entire circumference of the user is completed, and a color image (imaging information 112) corresponding to the entire circumference of the user is acquired. Then, the measurement control unit 100 stores imaging information 112 corresponding to the entire circumference of the user in the database 111.

In step S15, the measurement control unit 100 creates the three-dimensional shape information 113 based on the imaging information 112. Then, the measurement control unit 100 combines the created three-dimensional shape information 113 from each direction to create complete three-dimensional shape information 113 corresponding to the entire circumference of the user.

Next, the measurement control unit 100 stores the created complete 3D shape information 113 in the database 111 as prepared 3D shape information (step S16).

At this time, information (imaging information 112 and prepared three-dimensional shape information) may be stored separately for each part of the user. For example, the hair portion and the face portion may be separated. By separating and storing in this way, for example, it is possible to reduce processing when only information relating to the hair portion is needed later.

When step S16 is executed, the CPU 10 ends the preliminary process and returns to the process shown in FIG. When the preliminary process ends and the process returns to FIG. 11, the makeup support apparatus 1 repeats the process from step S1.

When the button image 42 is operated in the menu image 50 and the input instruction information becomes “makeup start”, the CPU 10 determines Yes in step S5 and executes makeup preparation processing (step S6).

FIG. 14 is a flowchart showing a makeup preparation process executed by the makeup support apparatus 1. It is assumed that the pre-processing already described is executed at least once before the makeup preparation processing shown in FIG. 14 is started.

When the makeup preparation process is started, the CPU 10 controls the imaging unit 71 to acquire the imaging information 112. Thereby, the imaging unit 71 starts imaging (step S21), and acquisition of the imaging information 112 is started. In step S21, the creation of the three-dimensional shape information 113 is also started.

Next, the estimation unit 102 estimates the current light environment (during makeup) based on the imaging information 112 and the three-dimensional shape information 113 (step S22). In addition, when performing step S22, the makeup | decoration assistance apparatus 1 is good to display the message which urges | positions on the display part 5 to arrange | position a reference | standard object.

If the light environment at the time of makeup is estimated, the estimation unit 102 further estimates the face color of the user at the time of makeup (step S23). Note that if the makeup target is not the user's face, step S23 may be skipped.

Next, the estimation unit 102 estimates the user's skin quality based on the three-dimensional shape information 113 (step S24). When step S24 is executed, the measurement control unit 100 may change the measurement pattern to a finer pattern than that normally used, for example, in order to improve measurement accuracy.

Next, the estimation unit 102 estimates the elasticity of the user's skin based on the imaging information 112 (step S25). At this time, the makeup support apparatus 1 preferably displays a message prompting the user to press the skin on the display unit 5.

When steps S22 to S25 are sequentially executed and various states at the time of makeup are estimated, the estimation unit 102 transmits the estimation results in these steps to the information creation unit 103 as estimation information.

Next, the CPU 10 causes the display unit 5 to display a screen for inputting conditions for performing makeup (step S26). In step S <b> 26, the display unit 5 displays a predetermined GUI, and the user inputs a makeup condition to be started in accordance with the GUI. Note that the conditions input by the user in step S26 include information indicating the place and purpose of makeup, the site to which makeup is applied, and the like.

When the input by the user is completed, the CPU 10 ends the step S26 and holds the input information (condition) as instruction information. Furthermore, the information creation unit 103 creates predicted image information representing the user's part after makeup is completed as makeup support information 114 in accordance with the instruction information. And the display part 5 displays the makeup | decoration assistance information 114 containing prediction image information (step S27). Thereby, the user can confirm the state after completion of makeup | decoration by the conditions input by step S26, before starting makeup | decoration. Therefore, it is suppressed that it induces to the makeup state which a user does not think, and the failure of makeup is suppressed.

When step S27 is executed, the CPU 10 determines whether or not the user has accepted the completed state indicated by the predicted image information (step S28). The determination in step S <b> 28 can be executed according to instruction information input by the user operating the operation unit 4.

If the user does not agree (No in step S28), makeup support apparatus 1 accepts the correction instruction (step S29), and then returns to the process of step S27. In step S27, predicted image information reflecting the correction instruction is newly created, and makeup support information 114 including the predicted image information is displayed.

On the other hand, when the user agrees (Yes in step S28), the CPU 10 ends the makeup preparation process and returns to the process shown in FIG.

After finishing the makeup preparation process and returning to the process shown in FIG. 11, the makeup support apparatus 1 executes the makeup support process (step S7).

FIG. 15 is a flowchart showing a makeup support process executed by the makeup support apparatus 1. Note that the makeup preparation process (step S6) is always executed before the makeup support process (step S7) is started. Therefore, when the makeup support process is started, projection by the light projecting unit 70, imaging by the imaging unit 71, and creation of the three-dimensional shape information 113 by the measurement control unit 100 have already been started.

When the makeup support process is started, the CPU 10 first determines the operation mode of the makeup support apparatus 1 during makeup (step S31). The operation mode is determined according to instruction information input by the user.

As already described, the makeup support apparatus 1 can select the normal operation mode, the sub power saving operation mode, and the power saving operation mode as the operation mode at the time of makeup.

The normal operation mode is an operation mode in which information on a three-dimensional shape related to the entire user-captured image captured by the imaging unit 71 is continuously generated in real time based on the imaging information 112 that is continuously captured in real time at the time of makeup. Therefore, it is necessary to continuously project (at least intermittently) the measurement pattern by the light projecting unit 70 toward the entire range imaged by the imaging unit 71. The normal operation mode is an operation mode in which a display user image with high accuracy can be obtained instead of the largest power consumption.

When the normal operation mode is selected, the specifying unit 101 creates a display user image from the viewpoint (angle) based on the imaging information 112 and viewpoint information acquired by the imaging unit 71 at the time of user makeup. In order to identify a part that is not captured by the imaging information 112 (a part of the user that needs information on a three-dimensional shape). Then, the specifying unit 101 transmits specific part information to the measurement control unit 100.

In the normal operation mode, the measurement control unit 100 acquires the prepared three-dimensional shape information regarding the part indicated by the specific part information from the database 111. Then, the acquired three-dimensional shape information is created by combining the acquired three-dimensional shape information with information about the three-dimensional shape created in real time based on the imaging information 112.

FIG. 16 is a conceptual diagram showing a state in which information on the three-dimensional shape acquired in real time and the prepared three-dimensional shape information are combined.

The image 80 is a display user image created based on the imaging information 112 captured from the front. The image 80 is an image created in real time, and can be said to be an image that reflects the current situation most faithfully. However, since makeup assisting apparatus 1 is configured to be able to image only from one direction (usually from the front), when an angle is changed based on viewpoint information, a region that is not imaged (a region outside the imaging range) Can not create an image. Therefore, in such a case, a defective portion is generated as in the image 80 shown in FIG. 16, resulting in an incomplete display user image.

However, the database 111 of the makeup support apparatus 1 stores imaging information 112 and preparatory three-dimensional shape information that have been captured and created in advance. Therefore, the measurement control unit 100 can acquire information regarding the three-dimensional shape of the missing portion from the database 111 according to the specific part information transmitted from the specifying unit 101. Then, using the information regarding the three-dimensional shape of the missing portion acquired from the database 111, the three-dimensional shape information 113 that compensates for the missing portion can be created.

Thus, in the makeup support apparatus 1, the three-dimensional shape information 113 is created using the prepared three-dimensional shape information stored in the database 111 even in the normal operation mode.

In addition, regarding the part supplemented by the prepared three-dimensional shape information in the three-dimensional shape information 113, the imaging information 112 stored in the database 111 is texture-mapped by the information creating unit 103 to create a display user image. As a result, a display user image such as an image 81 shown in FIG. 16 is created. In addition, in the sub power saving operation mode and the power saving operation mode, the identifying unit 101, the measurement control unit 100, and the information creating unit 103 are used to detect a missing portion (a part that is not imaged in the imaging information 112 acquired in real time). Similar processing is executed.

The sub power-saving operation mode is based on the imaging information 112 that is continuously captured in real time at the time of makeup, and the moving part (the part in which the three-dimensional shape is changed) in the user captured image captured by the imaging unit 71. ) Is an operation mode in which information relating to the three-dimensional shape is continuously created in real time, and information relating to the three-dimensional shape relating to other parts (stationary parts) is created based on the prepared three-dimensional shape information. And the measurement control part 100 produces | generates the three-dimensional shape information 113 by synthesize | combining the part produced in real time, and the preparation three-dimensional shape information created beforehand. Therefore, the projection of the measurement pattern by the light projecting unit 70 is not limited to the entire range imaged by the imaging unit 71, but only to the moving part, and the normal operation mode is sufficient for partial projection. Compared with the power consumption is reduced.

When the sub power-saving operation mode is selected, the specifying unit 101 during makeup uses a moving part (information about a three-dimensional shape based on the imaging information 112 acquired by the imaging unit 71 during makeup of the user. The user's part that is required) is specified. Then, the specifying unit 101 transmits specific part information to the measurement control unit 100. In addition, as a site | part with a motion, the part of an eye | mouth, a mouth, etc. are assumed, for example.

In the associate power saving operation mode, the measurement control unit 100 controls the light projecting unit 70 so as to selectively project the measurement pattern only toward the part indicated by the specific part information.

The power saving operation mode is an operation mode that does not create information on the three-dimensional shape based on the imaging information 112 imaged at the time of makeup, and all the information on the three-dimensional shape uses the prepared three-dimensional shape information. is there. Therefore, in the power saving operation mode, the light projecting unit 70 does not project a measurement pattern. Thereby, in the power saving operation mode, the power consumption is further suppressed as compared with the sub power saving mode.

In step S31, the state of projection of the measurement pattern by the light projecting unit 70 and the method of creating the three-dimensional shape information 113 by the measurement control unit 100 are changed according to the operation mode determined in step S31. . That is, the transition to the determined operation mode is realized.

When step S31 is executed, the information creation unit 103 creates a display user image by texture mapping the imaging information 112 (user imaging information) captured at the time of makeup based on the three-dimensional shape information 113. Furthermore, the information creation unit 103 corrects the created display user image according to conditions desired by the user (step S32), and completes the display user image.

In step S32, the condition desired by the user is a part of the instruction information input in step S26. Specifically, the display user image once created is corrected to the light environment of the makeup presentation place. Information indicating whether to correct the light environment as a reference. When a plurality of images can be displayed separately on the

display units

5 and 6, a display user image that has executed either one of the above corrections may be completed.

Next, the information creation unit 103 creates makeup support information 114 including the completed display user image and various information (for example, information serving as advice) acquired from the database 111 (step S33).

When the makeup support information 114 is created, the correction unit 104 detects a user's camera shake based on the imaging information 112 acquired in real time during makeup, and the makeup support information is determined according to the detected camera shake. The display position of 114 (particularly the display user image) is corrected (step S34). Then, the display unit 5 displays the makeup support information 114 at the display position corrected by the correction unit 104 (step S35).

When step S35 is executed, the CPU 10 determines whether or not to finish the makeup for the part currently being made up (step S36).

It is assumed that the end of the makeup relating to the part under makeup is input as instruction information when the user operates the operation unit 4. That is, only when the user is satisfied with the makeup state and inputs the end of makeup, it is determined Yes in step S36, and unless there is an input, it is determined No in step S36 and the processing from step S32 is repeated. .

Although omitted in the description of FIG. 15, the estimation unit 102 continues to estimate the application speed and the pressing force by the user while steps S32 to S36 are being executed. And the information preparation part 103 produces the makeup | decoration assistance information 114 according to the estimated information transmitted from the estimation part 102 in step S33.

Further, although the end instruction itself is input from the user, the makeup support information 114 that informs the completion of makeup is created by the information creation unit 103 as described above.

If it is determined Yes in step S36, the CPU 10 prompts the user to instruct whether or not to continue makeup for other parts, and waits until the instruction is given. Then, when an instruction from the user is input, it is determined whether or not the instruction is an instruction to continue makeup for another part (step S37).

When the user inputs that makeup is to be performed for another part, it is determined Yes in step S37, and the process from step S26 (FIG. 14) is repeated. In other words, a condition input relating to a part where makeup is newly started is accepted.

On the other hand, when the user inputs that makeup is not performed on other parts, it is determined No in step S37, and projection by the light projecting unit 70, imaging by the imaging unit 71, and tertiary by the measurement control unit 100 are performed. After completing the creation of the original shape information 113, the makeup support process is terminated, and the process returns to the process shown in FIG. When the makeup support process in step S7 ends and the process returns to the process shown in FIG. 11, the makeup support apparatus 1 returns to step S1 and repeats the process.

When the button image 43 is operated in the menu image 50 and the input instruction information becomes “end”, the CPU 10 determines Yes in step S8 and ends the makeup application.

As described above, the makeup support apparatus 1 captures information about the three-dimensional shape related to the user based on the imaging unit 71 that captures the user and acquires the imaging information 112 and the imaging information 112 acquired by the imaging unit 71. Information for creating the measurement control unit 100 that acquires and creates the three-dimensional shape information 113 and the makeup support information 114 for supporting the makeup to be applied to the user based on the three-dimensional shape information 113 created by the measurement control unit 100 A creation unit 103 and

display units

5 and 6 for displaying makeup support information 114 created by the information creation unit 103 are provided. As a result, accurate and appropriate makeup can be easily performed regardless of location.

In addition, the measurement control unit 100 acquires information about the three-dimensional shape related to the user before the user's makeup and creates the prepared three-dimensional shape information, for example, information about the three-dimensional shape at the time of makeup. By acquiring preparatory 3D shape information in advance for parts that are difficult to acquire (such as the temporal region), complete 3D shape information 113 can be created even during makeup.

In addition, the information creation unit 103 texture-maps the imaging information 112 acquired by the imaging unit 71 at the time of user makeup on the preparation three-dimensional shape information created by the measurement control unit 100, thereby providing makeup support information 114. Create Thus, the three-dimensional makeup support information 114 can be displayed during makeup without performing three-dimensional measurement during makeup. Therefore, power consumption at the time of makeup can be suppressed.

In addition, since the measurement control unit 100 can acquire the three-dimensional shape information 113 reflecting the current shape by acquiring information about the three-dimensional shape related to the user at the time of makeup of the user, Realistic natural makeup support information 114 that follows the movement can be created.

Further, the specifying unit 101 specifies a part of the user who needs information regarding a three-dimensional shape from the parts captured in the imaging information 112 acquired by the imaging unit 71 at the time of user makeup, and performs measurement control. The unit 100 acquires information about the three-dimensional shape only for the part related to the part of the user specified by the specifying unit 101 at the time of user makeup, and acquires the acquired information about the three-dimensional shape and the prepared three-dimensional shape information. The three-dimensional shape information 113 related to the user is created by combining. Thereby, even when the part is deformed at the time of makeup, it is possible to create complete three-dimensional shape information 113 without acquiring information on a complete (over the entire circumference) three-dimensional shape in real time. Therefore, the power consumption can be suppressed as compared with the case of acquiring information related to the three-dimensional shape for all parts.

Further, the specifying unit 101 specifies a part of the user who needs information regarding a three-dimensional shape from parts not captured in the imaging information 112 acquired by the imaging unit 71 at the time of user makeup, and performs measurement control. The unit 100 synthesizes the prepared three-dimensional shape information about the part related to the user's part specified by the specifying unit 101 and the information about the three-dimensional shape related to the user acquired at the time of the user's makeup, to obtain the three-dimensional shape information 113. Create Thereby, even if information about a three-dimensional shape can be acquired only from one direction at the time of makeup, the three-dimensional shape information 113 about the entire circumference can be created.

The information creation unit 103 creates makeup support information 114 for assisting makeup to be applied to the user based on the viewpoint information acquired by the operation unit 4, so that various viewpoints can be obtained even when imaging from one direction is performed. You can check the appearance from (angle).

The correction unit 104 corrects the display position of the makeup support information 114 displayed on the

display units

5 and 6 by estimating the user's line of sight based on the imaging information 112 captured by the imaging unit 71 at the time of user makeup. Therefore, camera shake can be corrected, and stable makeup can be performed even in an environment where shaking is intense such as in a train.

Further, the estimation unit 102 estimates the user's skin quality based on the three-dimensional shape information 113 created by the measurement control unit 100, and the information creation unit 103 determines the skin quality at the time of makeup of the user estimated by the estimation unit 102. By creating suitable makeup support information 114, makeup support suitable for the skin quality at the time of makeup can be performed.

Further, the elasticity of the skin surface is estimated based on the change of the skin surface when the estimation unit 102 presses the user's skin surface, and the information creation unit 103 estimates the skin at the time of the user's makeup estimated by the estimation unit 102 By creating makeup support information 114 suitable for the elasticity of the face, makeup support suitable for the elasticity of the skin surface during makeup can be performed.

In addition, the estimation unit 102 estimates the pressing force by the user at the time of makeup of the user, and the makeup support information 114 includes information on the pressing force by the user estimated by the estimation unit 102, thereby determining whether the pressing force by the user is appropriate. And can provide makeup support.

In addition, the estimation unit 102 estimates the application speed of the cosmetic product at the time of the user's makeup, and the makeup support information 114 includes information on the application speed estimated by the estimation unit 102, thereby determining whether or not the application speed of the cosmetic product by the user is appropriate. It can be judged and makeup support can be performed.

Further, the estimation unit 102 estimates the user's cheekbone position, and the information creation unit 103 creates the makeup support information 114 according to the user's cheekbone position estimated by the estimation unit 102, thereby responding to the user's cheekbone position. Can provide makeup support. In particular, it is effective at the time of makeup with a cheek that is greatly influenced by the position of the cheekbones.

In addition, when the estimation unit 102 estimates the light environment at the time of makeup, makeup support in consideration of the current light environment becomes possible.

Further, based on the light environment at the time of makeup estimated by the estimation unit 102 and the reference light environment, the reference information is always corrected by correcting the imaging information 112 captured by the imaging unit 71 at the time of makeup of the user. The appearance in the light environment can be confirmed. Therefore, stable makeup can be performed without being influenced by the light environment of the destination.

Further, by correcting the imaging information 112 captured by the imaging unit 71 at the time of makeup of the user based on the light environment at the time of makeup estimated by the estimation unit 102 and the light environment at the presentation place desired by the user. The appearance in the light environment of the place where makeup is performed can be confirmed without being affected by the light environment at the time of makeup.

Further, the estimation unit 102 estimates the face color at the time of makeup of the user according to the estimated light environment at the time of makeup, and the information creation unit 103 applies makeup support information 114 suitable for the estimated face color at the time of makeup of the user. Thus, it is possible to perform appropriate makeup support according to the face color (health state, etc.) at that time without being affected by changes in the light environment.

In addition, the information creation unit 103 can create makeup support information 114 suitable for the light environment at the presentation place desired by the user, thereby performing appropriate makeup support corresponding to the light environment of the place where makeup is presented. .

In addition, the information creation unit 103 creates makeup support information 114 according to the makeup purpose of the user, so that the same makeup is not always suggested, but makeup variations increase and versatility is improved.

Further, the information creation unit 103 proposes an article according to the situation by selecting a recommended article from among the articles possessed by the user and including information on the selected recommended article in the makeup support information 114. And appropriate makeup support can be realized.

Also, the makeup support information 114 includes predicted image information after makeup for the user, so that makeup can be started after confirming the state after the makeup is completed. Therefore, failure can be suppressed.

In addition, the makeup support information 114 can specifically indicate which region the makeup should be applied to by including information on the position where the makeup should be applied for the user.

Further, the position where the makeup should be applied indicated in the makeup support information 114 includes information on the application start position when applying cosmetics, so that it is possible to specifically indicate where it is appropriate to start applying.

In addition, the position where the makeup should be applied indicated in the makeup support information 114 includes information on the application end position when applying the cosmetic, so that it can be specifically shown to what extent the application is appropriate.

In addition, the position where makeup is to be applied indicated in the makeup support information 114 includes information on the locus when the cosmetic is applied, so that it is possible to finely instruct the bending condition during the application of the cosmetic.

In addition, the makeup support information 114 includes information on the concentration of cosmetics to be applied, so that over-coating can be prevented and effective gradation and shading can be easily realized. Can do.

In addition, the makeup support information 114 includes information on the degree of curling of the eyelashes, so that appropriate makeup support can be performed for eyelashes whose three-dimensional shape is particularly important.

Also, the makeup support information 114 includes information on the end of makeup for the user, for example, it is possible to effectively prevent overcoating of cosmetics, for example.

In addition, the information creation unit 103 can balance the other parts by comparing the plurality of parts of the user and determining the end of the makeup.

The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the above-described preferred embodiments, and various modifications can be made.

For example, the steps shown in the preferred embodiment are merely examples, and are not limited to the order and contents shown above. That is, as long as the same effect can be obtained, the order and contents may be changed as appropriate.

In addition, it has been described that the functional blocks (for example, the measurement control unit 100, the specifying unit 101, the estimation unit 102, and the like) described in the above-described preferred embodiment are realized as software when the CPU 10 operates according to the program 110. . However, some or all of these functional blocks may be configured by a dedicated logic circuit and realized in hardware.

Also, the user's part that is the object of makeup is not limited to the user's face. For example, it may be another part of the user's body such as a nail or a head hair.

The casing 2 may have a structure that can also be used as a case for storing cosmetics (foundation, teak, etc.) and tools (bake, pad, etc.).

In the preferred embodiment, the light projecting unit 70 projects the pattern with invisible light so that the imaging information 112 displayed as the makeup support information 114 is not visually affected by the pattern. It was. However, for example, the light projecting unit 70 may project the pattern at a timing that avoids the imaging timing of the imaging unit 71. For example, the light projecting unit 70 may project the pattern during the frame interval of the imaging unit 71. Also with this configuration, it is possible to prevent the visible influence of the pattern from appearing in the imaging information 112.

Claims

A makeup assisting device carried by the user when the user applies makeup to the user,
Imaging means for imaging the user and obtaining imaging information;
Three-dimensional measurement means for acquiring information on a three-dimensional shape related to the user and creating three-dimensional shape information based on the imaging information acquired by the imaging means;
Information creation means for creating makeup support information for supporting makeup to be applied to the user based on the three-dimensional shape information created by the three-dimensional measurement means;
Display means for displaying makeup support information created by the information creating means;
A makeup support apparatus comprising:
The makeup support apparatus according to claim 1,
The said three-dimensional measurement means is a makeup | decoration assistance apparatus which acquires the information regarding the three-dimensional shape regarding the said user at the time of the said user's makeup.
The makeup support apparatus according to claim 1,
The said three-dimensional measuring means is the makeup | decoration assistance apparatus which acquires the information regarding the three-dimensional shape regarding the said user before the time of the said user's makeup | decoration, and produces as preparation three-dimensional shape information.
The makeup support system according to claim 3,
The information creation means texture-maps the imaging information acquired by the imaging means at the time of the user's makeup on the prepared 3D shape information created by the 3D measurement means, thereby obtaining the makeup support information. Makeup support device to create.
The makeup support apparatus according to claim 3,
The said three-dimensional measurement means is a makeup | decoration assistance apparatus which acquires the information regarding the three-dimensional shape regarding the said user at the time of the said user's makeup.
The makeup support apparatus according to claim 5,
A makeup support apparatus further comprising a specifying unit that specifies a part of the user who needs information on a three-dimensional shape based on imaging information acquired by the imaging unit during makeup of the user.
The makeup support apparatus according to claim 6,
The specifying means specifies the part of the user that needs information on the three-dimensional shape from the parts imaged in the imaging information acquired by the imaging means at the time of makeup of the user,
The three-dimensional measuring means acquires information about the three-dimensional shape only for the part related to the user's part specified by the specifying means at the time of makeup of the user, the acquired information about the three-dimensional shape, and the preparation A makeup support apparatus that creates three-dimensional shape information about the user by combining the three-dimensional shape information.
The makeup support apparatus according to claim 6,
The specifying unit specifies a part of the user that needs information on the three-dimensional shape from parts not captured in the imaging information acquired by the imaging unit at the time of makeup of the user,
The three-dimensional measuring unit synthesizes the prepared three-dimensional shape information about a portion related to the user's part specified by the specifying unit and information about the three-dimensional shape related to the user acquired at the time of makeup of the user. A makeup support apparatus for creating the three-dimensional shape information.
The makeup support apparatus according to claim 1,
It further includes a viewpoint acquisition means for acquiring viewpoint information,
The information creation unit is a makeup support apparatus that creates makeup support information for supporting makeup to be applied to the user based on the viewpoint information acquired by the viewpoint acquisition unit.
The makeup support apparatus according to claim 1,
A makeup support apparatus that corrects the display position of makeup support information displayed on the display unit by estimating the user's line of sight based on image information captured by the imaging unit during the makeup of the user.
The makeup support apparatus according to claim 1,
Based on the three-dimensional shape information created by the three-dimensional measuring means, further comprising a skin quality estimating means for estimating the skin quality of the user,
The information creation means is a makeup support apparatus that creates makeup support information suitable for the skin quality of the user during makeup estimated by the skin quality estimation means.
The makeup support apparatus according to claim 1,
Further comprising an elasticity estimation means for estimating the elasticity of the skin surface based on a change in the skin surface when pressing the skin surface;
The makeup creating apparatus creates makeup support information suitable for the elasticity of the skin surface at the time of makeup of the user estimated by the elasticity estimating unit.
The makeup support apparatus according to claim 1,
A pressing force estimating means for estimating a pressing force by the user at the time of makeup of the user;
The makeup support information includes makeup information including information related to the pressing force by the user estimated by the pressing force estimation means.
The makeup support apparatus according to claim 1,
Further comprising a speed estimation means for estimating a cosmetic application speed at the time of makeup of the user;
The makeup support information includes information on the application speed estimated by the speed estimation unit.
The makeup support apparatus according to claim 1,
Further comprising cheekbone position estimating means for estimating the user's cheekbone position;
The information creation unit is a makeup support apparatus that creates makeup support information according to the user's cheekbone position estimated by the cheekbone position estimation unit.
The makeup support apparatus according to claim 1,
It further comprises light estimation means for estimating the light environment at the time of makeup,
A makeup support apparatus that corrects imaging information captured by the imaging unit at the time of makeup of the user based on a light environment at the time of makeup estimated by the light estimation unit and a reference light environment.
The makeup support apparatus according to claim 1,
It further comprises light estimation means for estimating the light environment at the time of makeup,
A makeup support apparatus that corrects imaging information captured by the imaging unit at the time of makeup by the user based on a light environment at the time of makeup estimated by the light estimation unit and a light environment at a presentation place desired by the user. .
The makeup support apparatus according to claim 1,
It further comprises light estimation means for estimating the light environment at the time of makeup,
According to the light environment at the time of makeup estimated by the light estimation means, further comprising a face color estimation means for estimating the face color at the time of makeup of the user,
The makeup creating apparatus is configured to create makeup support information suitable for the face color of the user when makeup is estimated by the face color estimation unit.
The makeup support apparatus according to claim 1,
The makeup creation device is configured to create makeup support information suitable for a light environment in a presentation place desired by the user.
The makeup support apparatus according to claim 1,
The information creation means is a makeup support apparatus that selects recommended articles from among the articles possessed by the user and includes information on the selected recommended articles in makeup support information.
The makeup support apparatus according to claim 1,
The makeup support information is a makeup support apparatus including predicted image information after makeup for the user.
The makeup support apparatus according to claim 1,
The makeup support information is a makeup support apparatus including information regarding a position where makeup should be applied to the user.
The makeup support apparatus according to claim 1,
The makeup support information is a makeup support apparatus that includes information on the concentration to be applied to the cosmetic.
The makeup support apparatus according to claim 1,
The makeup support information is a makeup support apparatus including information related to the degree of curvature of eyelashes.
The makeup support apparatus according to claim 1,
The makeup support information includes information on the end of makeup for the user,
The information creation unit is a makeup support apparatus that determines completion of the makeup by comparing a plurality of parts of the user.
A recording medium that records a program that is read by a computer carried by the user when the user applies makeup to the computer, causing the computer to execute the program,
Imaging the user and obtaining imaging information by imaging means;
Based on the imaging information acquired by the imaging means, obtaining information about a three-dimensional shape related to the user and creating three-dimensional shape information;
Creating makeup support information for supporting makeup to be applied to the user based on the created three-dimensional shape information;
Displaying the created makeup support information;
Recording medium that executes