KR20220030526A - A server and method for providing production service of user customized accessory based on learning - Google Patents

Abstract

The present invention relates to a learning-based customized accessory manufacturing service, which enable a user to manufacture, order, and sell customized accessories. More specifically, the service comprises: a coupling position determination unit determining a coupling position from sample images of each unit configuration on the basis of a coupling position determination model generated by learning coupling positions of unit components forming an accessory; a database matching and storing the determined coupling position of each unit configuration and the sample images of the corresponding unit configuration; a UI providing unit providing the sample image for each unit configuration for forming an accessory to a user terminal to receive selection of the sample image of the unit configuration for forming the accessory when customized manufacture is requested from the user terminal; and a virtual combination unit providing a virtual combined image combining the selected sample images according to combination positions of corresponding unit components stored in the database when a plurality of sample images are selected. The UI providing unit moves and positions the selected sample image on a screen according to operation of the user terminal.

Description

A SERVER AND METHOD FOR PROVIDING PRODUCTION SERVICE OF USER CUSTOMIZED ACCESSORY BASED ON LEARNING}

The present invention relates to a learning-based accessory customization service.

Accessories are ornaments that harmonize clothes, and also refer to accessories such as earrings, rings, bracelets, and necklaces worn by people.

In general, accessories are not produced in a custom-made method according to the user's needs, but in most cases, the originality and marketability of the accessory design is determined by the intention of a professional designer.

However, recently, consumers want to organize their own style, lead the trend, and lead the way, rather than blindly choosing the products suggested by brands.

In this way, people want products that can express their lifestyle and express their individuality beyond brands, that is, customized products just for themselves. are seeking

Accordingly, there is a need for a service that allows a user to customize an accessory desired by the user. However, there are many limitations in terms of lack of expertise and cost for the user to design and customize the accessory from the design stage.

Accordingly, the present applicant intends to provide a service that collects the unit components constituting the accessories and makes them a DB, and allows the user to customize the customized accessories by combining the unit components of the accessories according to the user's taste.

1. Korea Patent Publication No. 2018-0135626 (2018.12.21. Announcement)

An object of the present invention is to produce a user-customized accessory by storing a combination position and a sample image for each accessory unit configuration based on a learning model, and using this to provide a virtual combination image when a user combines a plurality of unit configurations to suit their taste. It is to provide a customized service for learning-based accessories that can be ordered and sold.

The learning-based accessory customization service providing server according to an embodiment of the present invention for achieving the above object learns the coupling position of the unit configuration forming the accessory, and each unit configuration based on the combined positioning model generated A coupling position determining unit that determines a coupling position from a sample image of a DB that matches and stores the determined coupling location of each unit configuration and a sample image of the corresponding unit configuration, and a unit for accessory formation when a custom production is requested from a user terminal When a UI providing unit for providing a sample image for each component to the user terminal to select a sample image of a unit configuration for forming an accessory and a plurality of sample images are selected, the selected sample according to a combination position of the corresponding unit components stored in the DB It may include a virtual combining unit that provides a virtual combined image combining images.

Also, the UI providing unit may move and position the selected sample image on the screen according to the manipulation of the user terminal.

In this case, the virtual combining unit may virtually combine the corresponding unit components when the coupling positions of the corresponding unit components corresponding to the sample images are located within a preset distance.

In addition, the virtual coupling unit, when the virtual coupling of the plurality of selected sample images, if the coupling direction between the unit components is the same, by adding a coupling member to connect the corresponding unit components.

In addition, when the combination position of the sample image for each unit configuration is selected and input from the manager terminal, it further comprises a model generator for learning the combination position of the sample image for each unit configuration and each of the selected inputted sample images to generate the coupling position determination model. can do.

In addition, the model generation unit, when the coupling position is reset based on the verification of the manager terminal by re-learning the reset coupling position to update the coupling position determination model.

In addition, each unit configuration includes at least one coupling area for coupling between the unit configurations, and when a specific location is selected as a coupling location by the manager terminal, the model generation unit uses the color similarity between the selected specific location and surrounding locations. To determine the coupling area, and correcting the central position of the determined coupling area to the coupling position can be used for learning.

In addition, the service providing method of the learning-based accessory customization service providing server includes the steps of learning the coupling position of the unit configuration forming the accessory to generate a coupling positioning model, a sample of each unit configuration based on the coupling positioning model Determining a coupling position from the image, matching the determined coupling location of each unit configuration and a sample image of the corresponding unit configuration to each other and storing it in a DB Providing an image to the user terminal, receiving a selection of a sample image for forming an accessory, and when a plurality of sample images are selected, a virtual combination of the selected plurality of sample images according to the combination position of the corresponding unit components stored in the DB providing a combined image.

In addition, in the step of providing the virtual combined image, if the pre-stored combining positions of the unit constituents corresponding to the selected plurality of sample images are located within a preset distance, the corresponding unit constituents may be virtually combined.

In addition, in the providing of the virtual combined image, when the virtual combination of the plurality of selected sample images, if the coupling direction between the unit components is the same, it is possible to connect the unit components by adding a coupling member.

In addition, the step of generating the coupling position determination model comprises the steps of selecting and receiving a coupling position of the sample image for each unit configuration from the manager terminal, the sample image for each unit configuration and the coupling location of each sample image selected and input from the manager terminal It may include the step of learning to generate the coupling position determination model and when the coupling position is reset based on the verification of the manager terminal, re-learning the reset coupling position to update the coupling position determination model.

In addition, each unit configuration includes at least one coupling region for coupling between the unit configurations, and the generating of the coupling position determination model includes: when a specific location is selected as a coupling location by the manager terminal, the selected specific location and the surrounding area The method may further include determining the combined region using the color similarity of the position, and correcting the determined central position of the combined region as the combining position.

As described above, the learning-based accessory customization service providing server and its service providing method of the present invention provide a sample image with a matching combination location to virtually combine the combined accessories when a user selects and arranges a desired unit configuration. Images can be provided. Accordingly, the user may manufacture and order customized accessories while confirming the combination, and may sell the manufactured customized accessories online.

At this time, by adding and connecting a coupling member only when the coupling direction between the unit components to be coupled is the same when providing the virtual coupling image, unnecessary use of the coupling member can be prevented.

In addition, by automatically determining the bonding position from the sample image of the unit configuration based on the bonding position determination model, the administrator can build the DB without the need to specify the bonding position for each sample image.

However, for the creation of the combined positioning model, the administrator must designate and select the combined position on the sample image when constructing the initial training data. At this time, by correcting the error using the color similarity of the combining region, it is possible to determine the correct combining position (center of the combining region) for each unit configuration.

In addition, by updating the coupling positioning model based on the manager verification, it is possible to infer the exact coupling location of the unit configuration.

1 is a schematic diagram of a system including a learning-based accessory customization service providing server according to an embodiment of the present invention.
2 is a block diagram showing a schematic configuration of a learning-based accessory customization service providing server according to an embodiment of the present invention.
3 is a diagram for explaining the construction of initial learning data.
4 is a view for explaining the determination position error correction of FIG.
5 is a view for explaining the coupling direction of the unit configuration.
6 is a view for explaining an example of a unit configuration selected by a user.
7 and 8 are diagrams for explaining the combination according to the user arrangement of the unit configuration.
9 is a flowchart illustrating a method for providing a learning-based accessory customization service according to an embodiment of the present invention.
10 is a flowchart for explaining the learning-based DB construction (step S910) of the present invention.

The terms or words used in the present specification and claims should not be construed as being limited to their ordinary or dictionary meanings, and the inventor may properly define the concept of the term in order to best describe his invention. Based on the principle that there is, it should be interpreted as meaning and concept consistent with the technical idea of the present invention.

Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical spirit of the present invention, so various equivalents that can be substituted for them at the time of the present application It should be understood that there may be water and variations.

Hereinafter, prior to the description with reference to the drawings, it is not shown or specifically described for the known components that are not necessary to reveal the gist of the present invention, that is, a known configuration that can be added obviously by those skilled in the art with ordinary knowledge. reveal the sound

1 is a schematic diagram of a system including a learning-based accessory customization service providing server according to an embodiment of the present invention. 2 is a block diagram showing a schematic configuration of a learning-based accessory customization service providing server according to an embodiment of the present invention.

1 and 2 , the learning-based accessory customization service providing server (hereinafter, service providing server) according to an embodiment of the present invention includes a UI providing unit 110 , a DB 120 , and a model generating unit 130 . ), a combination position determining unit 140 , a virtual combining unit 150 and an order/sales management unit 160 .

The service providing server 100 stores the combination location and sample image for each accessory unit configuration in the DB 120 based on the combination location determination model, and provides the stored sample image to the user terminal 300 for the accessory unit selected by the user. By providing a virtual combined image with a combination of configurations, it is possible to provide a service that allows you to order and sell customized accessories online.

Here, accessories can be accessories such as earrings, rings, bracelets, necklaces, and the like. there is. That is, the accessories may be coupled to each other in a unit configuration, and the unit configuration may include a coupling member (eg, an O-ring) for coupling.

In addition, the sample image is an image of a unit configuration, and the binding position is a position that can be combined with another unit configuration in the sample image, and may be a position of a binding region. At this time, when the unit configuration includes a coupling member, the inner region of the coupling member can be a coupling area, and in the case of a ring earring (when the earring body is a ring), it can be coupled with another unit configuration even if a coupling member is not provided. The region inside the ring may be the bonding region. In this case, the specific position of the bonding region may be the bonding position.

The manager terminal 200 is a terminal of an administrator who manages the service providing server 100 , and may be a terminal operated in the manager mode by receiving a UI from the manager UI 111 of the service providing server 100 . In this case, the manager terminal 200 may be a terminal such as a PC, a notebook computer, a smart phone, a tab book, which can communicate with the service providing server 100 and display input/output of information through the UI.

The manager terminal 200 may manage the setting of initial learning data, the user's production order and sales status, etc. through the UI for the overall operation and management of the service providing server 100 . Information related to this may be stored in the DB 120 , and specifically, the DB 120 may store information for providing a customized accessory manufacturing service, user management information, and accessory order/sale information.

The user terminal 300 is a terminal of a user who receives the customized accessory service of the service providing server 100 through an app or web, and may be a terminal operated in a user mode by receiving the UI from the user UI 112 . In this case, the user terminal 300 may be a terminal such as a PC, a laptop computer, a smart phone, a tab book, which can communicate with the service providing server 100 and display input/output of information through the UI.

When a custom-made request is received from the user terminal 300, the service providing server 200 provides a sample image stored in the DB 120 to the user terminal 300, a virtual combination combining the accessory unit configuration selected by the user. By providing an image, it is possible to order custom accessories made by the user or to sell custom accessories made and ordered online.

In this case, the model generation unit 130 may generate a coupling position determination model by learning the sample image for each unit configuration uploaded by the manager terminal 200 and the coupling position set in the sample image.

Here, the information for providing the accessory customization service may be a sample image of the accessory unit configuration and a combination position included in the sample image. Specifically, the DB 120 matches and stores the sample image separated by category/unit configuration and the combined position included in the sample image, which is inferred by the initial learning data for generating the combined positioning model and the combined positioning model. data can be

In this case, for setting the initial learning data of the coupling position determination model, the manager terminal 200 may provide the service providing server 100 by setting the coupling position in the sample image of the accessory unit configuration.

The service providing server 100 may receive a sample image uploaded from the manager terminal 200 through the manager UI 111, a specific location of the sample image is selected from the manager terminal 200, and a combination location of the sample image may be set. . A detailed description thereof may be described with reference to FIG. 3 .

3 is a diagram for explaining the construction of initial learning data. Referring to FIG. 3, (a) of FIG. 3 is a sample image of the unit configuration uploaded by the manager terminal 200, and the unit configuration is a ribbon-shaped subsidiary material 20 with a coupling member 21 that becomes a coupling area. contains At this time, when the manager terminal 200 selects the coupling region in the coupling member 21 (for example, the cursor: c), the corresponding position is the coupling position (b(x ₁ ,y ₁ )) as shown in FIG. 3 (b). can be set to

Referring to (b) of FIG. 3 , the combined position may be stored in the DB 120 as a coordinate value. A specific position of the sample image (a) may be set as the reference point (P), and the coordinate value of the combined position set by the manager terminal 200 from the reference point (P) may be calculated and stored. In this case, the reference point P is preferably the upper left corner of the sample image, and the reference point P of all sample images may be at the same position.

In the same manner as in FIG. 3 , the sample image (a) for each unit configuration shown in FIG. 3(b) and the coupling position (b) in the sample image (a) may be matched with each other and stored in the DB 120 .

At this time, the setting of the coupling position of the initial learning data should be the center of the coupling member 21 to the location selected by the administrator, but an error may occur because it is set in the vicinity of the coupling area rather than the exact center. Accordingly, in the present invention, the correct coupling position can be stored in the DB 120 as the final coupling position (b) through error correction.

4 is a view for explaining the determination position error correction of FIG.

When a specific position (b ') is selected as a coupling position by the manager terminal 200 (cursor (c) in FIG. 3), the model generation unit 130 calculates the color similarity between the selected specific position (b ') and the surrounding position. It is possible to determine the coupling area by using, or to determine the inner coupling area by determining the edge of the coupling member (21).

At this time, the model generation unit 130 can be used for learning by correcting the error of the determined central position of the coupling region as the final coupling position (b) and storing it in the DB 120 . In addition, a method of determining the coupling region may be applied in various ways.

The coupling position determining unit 140 inputs the sample image for each unit configuration uploaded by the manager terminal 200 to the coupling positioning model generated by the model generating unit 130, and the coupling position inferred from the coupling positioning model. It can be stored in the DB 120 by matching the input value of the sample image. In this case, re-learning can be made for the sample image with an error in the binding position through the manager verification.

Specifically, the coupling location of the sample image for each unit configuration determined by the coupling location determining unit 140 is provided to the manager terminal 200, so that the manager verification can be input.

At this time, the verification can be whether or not the determination error of the combined position of the sample image (True or False), and the model generator 130 is reset from the manager terminal 200 for the sample image in which the combined position inference is an error (False). By re-learning the coupling position, it is possible to update the previously generated coupling location determination model.

Accordingly, the coupling position determining unit 140 determines the coupling position based on the real-time updated coupling positioning model, and the DB 120 finally stores the sample image and the corresponding coupling location for which the manager verification is completed. That is, the learning data stored in the DB 120 may be updated according to the update of the combined positioning model and the verification of the manager.

When a custom-made request is received from the user terminal 300 , the user UI 112 provides a sample image for each unit configuration for accessory formation stored in the DB 120 to the user terminal 300 , and the user terminal 300 . A plurality of unit configuration sample images for forming an accessory selected from can be selected. For example, the user may be selected in the order of a category (earrings, rings, bracelets, necklaces, etc.), a body (ring type, ring type, pin type, etc.), and subsidiary materials.

At this time, it is possible to classify the type of the unit configuration according to the formation direction of the coupling member provided in the unit configuration. 5 is a view for explaining the coupling direction of the unit configuration. Referring to Fig. 5, Figs. 5 (a) and 5 (b) are ribbon-type auxiliary materials 20a and 20b, and are unit configurations in which coupling members 21a and 21b are formed thereon.

At this time, in Fig. 5 (a), both the forming direction of the auxiliary material 20a and the forming direction of the coupling member 21a extend in the same axial direction, and in the present invention, it can be defined as a horizontal type. On the other hand, (b) of FIG. 5 shows that the forming direction of the auxiliary material 20b and the coupling member 21b are formed perpendicular to each other, and in the present invention, it can be defined as a vertical type. However, a ring-type body without a coupling member can be defined as a horizontal type because the inside of the ring can be a coupling area.

The user UI 112 provides a horizontal type and a vertical type when selecting an auxiliary material in the user terminal 300 , so that the user can select a combination to be manufactured.

6 is a view for explaining an example of a unit configuration selected by a user. For example, when three unit configurations as shown in FIG. 6 are selected by the user terminal 300, the sample images of the corresponding unit configuration selected through the display unit (not shown) of the user terminal 300 can be arranged and provided. there is.

In the sample image of the unit configuration selected in FIG. 6 , the earring body 10, the first subsidiary material 20c and the second subsidiary material 20d are selected, and each unit configuration is provided with a coupling member. At this time, the main body 10 and the first auxiliary material 20c is a horizontal type in the coupling direction, and the second auxiliary material 20d has a vertical coupling direction.

The user UI 112 may move and position the selected sample image in the screen of the display unit (not shown) as shown in FIG. 6 according to the manipulation (drag, etc.) of the user terminal 300 .

The virtual combining unit 150 virtual combination of the unit constituents by virtual combining the corresponding unit constituents when the combining positions of the corresponding unit constituents corresponding to the sample images (the combining positions matched and stored in the DB 120) are located within a preset distance. Combined images can be provided. In addition, when the image combined by the user terminal 300 is dragged and moved, it can be displayed again as a separated sample image.

7 and 8 are diagrams for explaining the combination according to the user arrangement of the unit configuration. Referring to FIG. 7 , if the sample image of FIG. 6 is arranged in the user terminal 300 as shown in FIG. A coupling member for the connection of the unit components 10 and 20c according to the coupling direction of the unit components 10 and 20c by determining that the coupling position b1 of the first subsidiary material sample image 20c is located within a preset distance to decide whether to add

At this time, the virtual coupling unit 150 determines the coupling direction of the unit components required to be coupled by the user terminal 300, and if the coupling direction is the same, a coupling member is added to connect the corresponding unit components, and the coupling direction to each other is Otherwise, the coupling positions of each unit configuration can be coupled to each other without adding a coupling member.

That is, referring to (a) of FIG. 7 , both the main body 10 and the first subsidiary material 20c have a horizontal coupling direction. Accordingly, the virtual coupling unit 150 is a vertical type coupling member 30 at the coupling location (b) of the main body 10 and the coupling location (b1) of the first subsidiary material (20c) as shown in FIG. 7(b). In addition, the unit configuration (10, 20c) can be combined. That is, the coupling member 30 is added between the coupling member 10a of the main body 10 and the first coupling member 21c of the first subsidiary material 20c to combine the body 10 and the first subsidiary material 20c. can do it

On the other hand, when the vertical type second auxiliary material 20d is disposed as shown in (a) of FIG. 8, the second coupling member 22c of the first auxiliary material 20c and the second auxiliary material 20d without adding a coupling member A virtual coupling image in which the coupling members 21d are coupled to each other is provided.

A user may select and arrange a desired unit configuration as shown in FIGS. 6 to 8 to manufacture a customized accessory, order a customized accessory through the order/sales management unit 160 , and may perform online sales.

The order/sales management unit 160 may store custom made accessories manufactured for each user terminal 300 , and may provide an order service and an online sales service according to a request of the user terminal 300 .

9 is a flowchart illustrating a method for providing a learning-based accessory customization service according to an embodiment of the present invention. The method of providing a learning-based accessory customization service according to an embodiment of the present invention of FIG. 9 may be described with reference to FIGS. 1 to 8 , and may be performed by the service providing server 100 .

It is possible to build the DB 120 by storing the coupling location and the sample image for each unit configuration inferred based on the coupling location determination model (S910).

Next, when a sample image for custom production is requested from the user terminal 300 (S920), a sample image for each unit configuration is provided to the user terminal 300 (S930), as shown in FIG. 6, a plurality of A sample image may be selected and inputted (S940).

Next, when the arrangement position of the sample image selected by the user terminal 300 is adjusted (S950), it may be determined whether the combined positions of the corresponding unit components are located within a preset distance (S960).

Next, when the combining positions of the corresponding unit components are located within the preset distance, a virtual combined image obtained by virtual combining the corresponding sample images according to the coupling direction of the corresponding unit components may be provided (S970).

At this time, if the coupling directions of the unit components are the same, a coupling member (O-ring) is added between the coupling members of the unit components to connect the unit components, and if the coupling directions of the unit components are different, the unit components are separated without adding a coupling member. The coupling members may be directly connected to each other to be coupled.

Next, when an order for a custom accessory made by the user is requested from the user terminal 200, a production order service according to the virtual combined image can be provided, and when online sales of the custom accessory are requested, the virtual combined image is sold and uploaded to provide a sales service (S980).

10 is a flowchart for explaining the DB construction (step S910) of FIG. Referring to step 910 of FIG. 9 , the learning data may be stored in the DB 120 by inferring the coupling position from the sample image of each unit configuration based on the coupling location determination model.

At this time, it is possible to collect the initial learning data through the step S1000 to generate the combined positioning model. Specifically, when a sample image of a unit configuration is uploaded from the manager terminal 300, the service providing server 100 may receive a selection input from the manager terminal 300 for a combination location of the sample image (S1000).

In this case, the combined position of the sample image is determined by an administrator's click or touch, and a position error may occur. Accordingly, in the present invention, when a specific location is selected as the coupling location by the manager terminal 300, the coupling area is determined using the color similarity between the selected specific location and the surrounding location, and the center position of the determined coupling area is the final coupling position. can be corrected for error.

Next, by learning the sample image for each unit configuration and the coupling position selected from the sample image as initial learning data (S1100), it is possible to generate a coupling position determination model (S1200).

Next, the DB 120 can be built by determining the coupling location of the new sample image based on the coupling location determination model (S1300). In this case, a sample image for each unit configuration may be input to the coupling positioning model, and the output of the coupling positioning model may be used as a determination location.

Next, by transmitting the output of the combined positioning model to the manager terminal 300, it is possible to perform manager verification (S1400). In this case, when it is determined that the determined position is an incorrect value (false) during the manager verification, the location may be reset from the manager terminal 300 .

As a result of the manager verification, when the coupling position for a specific sample image is reset from the manager terminal 300, the coupling positioning model can be updated by applying the reset coupling location and re-learning. Through this, it is possible to increase the accuracy of the coupling positioning model.

Next, the DB 120 can be built by matching and storing the sample image for each unit configuration, the combination position of which is accurately determined as a result of the manager verification, and the combined position of the sample image (S1700). In this case, the sample image stored in the constructed DB 120 may be provided upon a custom production request of the user terminal 300 .

What has been described using FIGS. 1 to 10 above describes only the main points of the present invention, and as many designs are possible within the technical scope, the present invention is not limited to the configuration of FIGS. 1 to 10 is self-evident

100: Learning-based accessory customization service providing server
110: UI providing unit 120: DB
130: model generation unit 140: coupling position determining unit
150: virtual combination unit 160: order / sales management unit
200: user terminal 300: administrator terminal

Claims (5)

a coupling position determining unit for determining a coupling position from a sample image of each unit configuration based on a coupling position determining model generated by learning the coupling position of the unit configuration forming the accessory;
A learning-based accessory customization service including; a DB for matching and storing the determined combination location of each unit configuration and a sample image of the corresponding unit configuration.
According to claim 1,
a UI providing unit for selecting a sample image of a unit configuration for accessory formation by providing a sample image for each unit configuration for accessory formation to the user terminal when a custom production is requested from the user terminal; and
When a plurality of sample images are selected, a virtual combining unit that provides a virtual combined image combining the selected sample images according to the combining positions of the corresponding unit components stored in the DB;
The UI providing unit moves and positions the selected sample image in the screen according to the manipulation of the user terminal,
The virtual coupling unit,
Learning-based accessory customization service, characterized in that when the combining positions of the corresponding unit components corresponding to the sample images are located within a preset distance, the corresponding unit components are virtually combined.
According to claim 1,
The virtual coupling unit,
When combining the selected plurality of sample images, if the coupling direction between the unit components is the same, a learning-based accessory customization service, characterized in that by adding a coupling member to connect the unit components.
According to claim 1,
When the combination position of the sample image for each unit configuration is selected and input from the manager terminal, a model generation unit for learning the coupling position of the sample image for each unit configuration and each of the selected and inputted sample images to generate the coupling position determination model; further includes and,
The model generation unit, when the coupling position is reset based on the verification of the manager terminal, learning-based accessory customization service, characterized in that to update the coupling position determination model by re-learning the reset coupling position.
5. The method of claim 4,
Each unit composition includes at least one binding region for bonding between the unit constituents,
The model generation unit,
When a specific location is selected as the coupling location by the manager terminal, the coupling area is determined using the color similarity between the selected specific location and the surrounding location, and the central position of the determined coupling area is corrected to the coupling location and used for learning. Characterized learning-based accessory customization service.

Images