KR102442347B1 - Asset management server, method and program for virtual objects in metaverse based on artificial intelligence - Google Patents

Abstract

The present disclosure relates to an asset management server for virtual objects in an artificial intelligence-based metaverse, which may calculate virtual value information for virtual assets of virtual objects in the metaverse using a value calculation model, manage assets for virtual object in the metaverse, and broker trading based on the same.

Description

Asset management server, method and program for virtual objects in metaverse based on artificial intelligence}

The present disclosure relates to an asset management server, and more particularly, to an asset management server for a virtual object in a metaverse.

Recently, interest in the metaverse has greatly increased, and many attempts are being made to actually implement the metaverse.

However, one of the common problems is that there is no clear standard for transaction and value calculation of objects in the metaverse.

Even if the metaverse is created as a digital twin for the real world, reflecting the values of the real world as it is because avatars interact within the metaverse and behavior patterns that are different from the real world may appear. There is a problem with this falling.

Registered Patent Publication No. 10-2322953, (2021.11.02)

An embodiment disclosed in the present disclosure has an object to provide an asset management server for virtual objects in the metaverse based on artificial intelligence.

In addition, the embodiment disclosed in the present disclosure is to calculate virtual value information on virtual assets of virtual objects in the metaverse using a value calculation model, and manage assets for virtual objects in the metaverse based on this and mediate trading. do.

In addition, in the embodiment disclosed in the present disclosure, when an instance registration in the metaverse is requested, instance contract information including at least one of an instance display position and a displayed unit price in the metaverse is generated based on the instance request information, and the contract is completed. Then, we want to display the instance in the metaverse.

The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

An asset management server for a virtual object in an artificial intelligence-based metaverse according to an embodiment of the present disclosure for solving the above-described problem receives an image acquired for the real world, and converts it into a digital twin for the real world a communication unit that provides the generated metaverse image to a user's virtual reality device; an object recognition unit recognizing at least one real object in the received real world image and loading real world information of the recognized real object; a rendering unit generating a virtual object based on the real object recognition result and real world information loaded with respect to the recognized real object to render the metaverse image; a storage unit storing a value calculation model for calculating virtual value information to be applied to the metaverse based on the real value information on at least one real object in the real world and the real value information on the real object; and a processor for calculating virtual value information on a virtual asset of the virtual object by using the value calculation model.

In addition, the value calculation model includes real value information of the real object, floating population information within a preset distance from the real object in the real world, flow information of an avatar within a preset distance from the virtual object in the metaverse, and meta information. The virtual value information may be calculated based on at least one of average user information for each time zone for the zone to which the virtual object belongs in the bus.

In addition, the processor is configured to check the flow information of the avatar within a preset distance from the virtual object in the metaverse and average user information for each time zone in the metaverse of the zone to which the virtual object belongs at each preset time to determine the first change amount may be calculated, and virtual value information on the virtual asset of the virtual object may be recalculated based on the first amount of change for each preset time and the second amount of change for the demand of the virtual object in the metaverse.

In addition, when an instance registration in the metaverse is requested, the processor is configured to include instance contract information including at least one of a display location and a display unit price of the instance in the metaverse based on the request information on the instance , and when a contract for the generated instance contract information is completed, the instance requested to be registered according to the instance contract information may be displayed in the metaverse.

In addition, the processor derives a first instance displayable position corresponding to the real information in the metaverse based on the current status of the real information being displayed using the real object in the real world and stores it in the storage unit and input the value of the real information in the real world into the value calculation model to calculate the unit price for displaying the first instance and store it in the storage unit.

In addition, the processor determines that the real information is not displayed in the real world, but that instances can be displayed in the metaverse based on the virtual object arrangement information in the metaverse and the flow information of the avatars in the metaverse. At least one second instance displayable position may be derived and stored in the storage unit.

In addition, when the specific avatar in the metaverse looks at the specific instance displayed in the metaverse for more than a preset time, the processor is configured to maintain the specific instance in the gaze of the avatar in the virtual reality of the user of the specific avatar. The specific instance in the metaverse image being provided to the device may be rendered to be rotated.

In addition, the processor receives the real value information of each of the real objects at preset times, calculates a first price trend for the real values of each of the real objects, and virtual assets for each of the virtual objects calculates a second price trend for the virtual value information of Virtual value information on the virtual asset may be updated.

In addition, the asset management method for virtual objects in the metaverse based on artificial intelligence according to an embodiment of the present disclosure for solving the above problems is a method performed by an asset management server, and an image acquired for the real world receiving; an object recognition step of recognizing at least one real object in the received real-world image and loading real-world information of the recognized real object; rendering the metaverse image by generating a virtual object based on a result of real object recognition and real world information loaded with respect to the recognized real object; providing an image of the metaverse generated as a digital twin for the real world to a user's virtual reality device; and calculating virtual value information on a virtual asset of the virtual object by using a value calculation model, wherein real value information on at least one real object in the real world and the real object and a storage unit storing a value calculation model for calculating virtual value information to be applied to the metaverse based on the real value information.

In addition to this, a computer program stored in a computer-readable recording medium for execution for implementing the present disclosure may be further provided.

In addition to this, a computer-readable recording medium for recording a computer program for executing a method for implementing the present disclosure may be further provided.

According to the above-described problem solving means of the present disclosure, an effect of providing an asset management server for a virtual object in an artificial intelligence-based metaverse is provided.

According to the above-described problem solving means of the present disclosure, virtual value information on virtual assets of virtual objects in the metaverse is calculated using a value calculation model, and assets for virtual objects in the metaverse are managed and traded based on this. can mediate

According to the above-described problem solving means of the present disclosure, when an instance registration in the metaverse is requested, instance contract information including at least one of an instance display position and a display unit price in the metaverse is generated based on the instance request information, and the contract When this is completed, an instance is displayed in the metaverse so that avatars in the metaverse can see it.

Effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a schematic diagram of an asset management system for a virtual object in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.
2 is a block diagram of an asset management system for virtual objects in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.
3 is a block diagram illustrating a detailed configuration included in a server to implement a metaverse.
4 is a flowchart of an asset management method for a virtual object in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.
5 is a diagram illustrating that instances registered in the metaverse are displayed in the virtual world.
6 is a diagram illustrating real world information being displayed in the real world.
7 is a diagram illustrating an instance being displayed in the metaverse.
8 is a diagram exemplifying that a target-type instance is displayed to an avatar connected in the metaverse.
9 is a diagram illustrating a change in the display angle of an instance according to the movement of the viewpoint of the avatar in FIG. 8 .
10 is a flowchart of an asset management method for a virtual object in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.
11 is a diagram illustrating that a user wears a virtual reality device and takes a specific motion.
12 is a diagram exemplifying rendering of a virtual figure for environment setting in a metaverse image because a user's motion corresponds to a virtual figure call operation.
13 is a diagram illustrating that different control signals are set to respective surfaces included in the virtual figure for different rotational states of the virtual figure.
14 is a diagram illustrating rendering of a virtual figure at a position that does not overlap an instance in the metaverse.

Advantages and features of the present disclosure and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present disclosure to be complete, and those of ordinary skill in the art to which the present disclosure pertains. It is provided to fully understand the scope of the present disclosure to those skilled in the art, and the present disclosure is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present disclosure. In this specification, the singular also includes the plural, unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may have the meaning commonly understood by those of ordinary skill in the art to which this disclosure belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of an asset management system 10 for a virtual object 50 in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.

Referring to FIG. 1 , a schematic configuration of an asset management system 10 for a virtual object 50 in an artificial intelligence-based metaverse according to an embodiment of the present disclosure is shown.

As shown in FIG. 1 , the server 100 creates a metaverse as a digital twin for the real world, and provides the metaverse image to users connected to the server 100 .

In detail, the server 100 provides a metaverse image to the user's virtual reality device 30 connected to the server 100 , and the avatar 60 in the metaverse under the control of the virtual reality device 30 . , to control the movement of the character.

In the embodiment of the present disclosure, the server 100 starts generating a metaverse as a digital twin for the real world, but in some embodiments, the server 100 performs asset management and instance management functions, and implements the metaverse. Functions such as to do may be performed through the additionally included server 100 device.

2 is a block diagram of the asset management system 10 for the virtual object 50 in the metaverse based on artificial intelligence according to an embodiment of the present disclosure.

Referring to FIG. 2 , the asset management system 10 for the virtual object 50 in the metaverse based on artificial intelligence according to an embodiment of the present disclosure includes a server 100 and a virtual reality device 30 .

The server 100 includes a processor 110 , a communication unit 120 , an object recognition unit 140 , a rendering unit 140 , a storage unit 150 , a value calculation model 160 , a statistic unit 170 , a determination unit ( 180) and an input/output unit 190 .

However, in some embodiments, the system 10 and the server 100 may include fewer or more components than the components shown in FIG. 2 .

For example, the asset management server 100 or the asset management system 10 may further include a separate cloud storage.

The communication unit 120 receives the image acquired for the real world, and provides the image of the metaverse generated as a digital twin for the real world to the user's virtual reality device 30 through the rendering unit 140 .

In addition, the communication unit 120 communicates in real time with the virtual reality device 30 of the user connected to the server 100 to provide a metaverse image, as well as receives a control signal input to the virtual reality device 30 to process the processor. The 110 may control the user's avatar 60 and character in the metaverse image or control environment settings for the metaverse.

The object recognition unit 140 recognizes at least one real object 40 in the real world image received through the communication unit 120 , and loads real world information of the recognized real object 40 .

Specifically, the processor 110 may load information on an object existing in the real world and store it in the storage 150 .

In this case, the object information may include at least one of appearance information, characteristic information, price, and market price of the object, and the appearance information may include at least one of a shape, size, and location of the object.

For example, when a specific building is recognized as an object in the image received through the communication unit 120, the object recognition unit 140 determines at least one of the location, size (area, height, floor, etc.) of the corresponding building, and the market price. It is possible to load real-world information including

In the embodiment of the present disclosure, the real object 40 may be any object existing in the real world, such as a building, a sculpture, a tree, a mountain, a station, and the like.

At this time, the object recognition unit 140 may recognize the real object 40 in the real world image and generate a recognition result, in which case the real object 40 recognition result is the position, size, It may include at least one of the shapes.

The rendering unit 140 may render a metaverse image by generating a virtual object 50 based on a result of recognizing the real object 40 and real world information loaded with respect to the recognized real object 40 .

Since the recognition result of the real object 40 recognized by the object recognition unit 140 in the real world image may be different from the real information, the real object 40 based on the real object 40 recognition result and the real world information. A metaverse image may be rendered by creating a virtual object 50 corresponding to .

The storage unit 150 stores the real value information and the value calculation model 160 for at least one real object 40 in the real world.

In addition, the storage unit 150 stores a 3D UI (3-Dimensional User Interface)-based virtual figure in which different control commands for environment settings in the metaverse are assigned to each of a plurality of surfaces.

The server 100 may provide a tutorial for environment setting using a 3D UI-based virtual figure to a user who accesses the server 100 using the virtual reality device 30 .

The server 100 may provide information on a plurality of different virtual figures and request the user to perform customization for environment setting using at least one virtual figure.

For example, the user can select a preferred virtual figure. (Example: cube, cuboid, tetrahedron, etc.)

Although the virtual figure of a polyhedron is exemplified in the above-described embodiment, the virtual figure is not limited to a polyhedron in the embodiment of the present disclosure, and a virtual figure having no face such as a "sphere" is also applicable.

The value calculation model 160 may calculate virtual value information to be applied to the metaverse based on the real value information about the real object 40 .

The statistic unit 170 may generate statistical information about various data generated by the server 100 .

Specifically, the statistic unit 170 may calculate flow information of the avatar 60 in the metaverse for each of the plurality/plural partitioned areas in the metaverse, and calculate user statistical information for each area/region.

The determination unit 180 may determine/determine at least one of an operation of the virtual avatar 60 character in the metaverse and a control command of a virtual figure based on the motion gesture of the user wearing the virtual reality device.

The input/output unit 190 may receive a control signal for the server 100 or output generated information, and may be divided into an input unit and an output unit.

In an embodiment of the present disclosure, the processor 110 is responsible for controlling the components in the server 100 , and may execute the asset management method by executing instructions and algorithms stored in the memory and the storage unit 150 .

In addition, the processor 110 operates the asset management server 100 based on artificial intelligence using the artificial intelligence model and the value calculation model 160 , and calculates the values of the virtual objects 50 in the metaverse. It is possible to mediate the transaction of the objects 50 and manage the market price.

The processor 110 may calculate virtual value information on a virtual asset of the virtual object 50 by using the value calculation model 160 .

As described above, in the embodiment of the present disclosure, the real object 40 may be any object existing in the real world, and the virtual asset from which the processor 110 calculates virtual value information is meta Any virtual object 50 that can have a value in the bus can be applied.

Also, the processor 110 may control the brokerage of the virtual asset of the virtual object 50 based on the calculated virtual value information.

3 is a block diagram illustrating a detailed configuration included in the server 100 to implement the metaverse.

Although not described in detail in FIG. 2 , referring to FIG. 3 , the server 100 may further include various detailed configurations for generating a metaverse as a digital twin for the real world.

The camera module can be installed anywhere where real-world images can be acquired, and can be installed in vehicles, drones, and flying vehicles to collect real-world images.

In detail, the server 100 may further include an input/output interface and a camera module.

The memory and storage unit 150 may include an AR tracking module, a 3D engine, an interactive module, and an AR display module.

4 is a flowchart of an asset management method for a virtual object 50 in an artificial intelligence-based metaverse according to an embodiment of the present disclosure.

The server 100 receives an image acquired for the real world through the communication unit 120 . (S100)

The processor 110 recognizes at least one real object 40 in the real world image received in S100 . (S200)

The processor 110 loads real world information of the real object 40 recognized in S200 . (S300)

The processor 110 renders a metaverse image by generating a virtual object 50 corresponding to the real object 40 . (S400)

The processor 110 provides the metaverse image to the virtual reality device 30 of the server 100 user. (S500)

The processor 110 calculates virtual value information on a virtual asset of the virtual object 50 . (S600)

In an embodiment of the present disclosure, the value calculation model 160 may generate a virtual object 50 corresponding to the real object 40 in the metaverse based on the real value information of the real object 40 .

Specifically, the value calculation model 160 includes real value information of the real object 40, floating population information within a preset distance from the real object 40 in the real world, and the region to which the virtual object 50 belongs in the metaverse. Virtual value information for the corresponding virtual object 50 may be calculated based on at least one of the average user information for each time period.

In this case, the real value information of the real object 40 may include a market price, a predicted market price, and the like of the corresponding real object 40 .

In addition, since an instance (advertisement) is provided to the avatars 60 in the metaverse by using the virtual object 50 directly or indirectly in the embodiment of the present disclosure, a preset distance from the real object 40 In consideration of conditions such as my floating population information, flow information of the avatar 60 within a preset distance from the virtual object 50 in the metaverse, and average user information for each time period, virtual value information for the corresponding virtual object 50 is calculated. will yield

Accordingly, the virtual value information may include advertisement effects expected in the metaverse in addition to including virtual value information on the virtual asset of the virtual object 50 .

In an embodiment, the processor 110 may determine the flow information of the avatar 60 within a preset distance from the virtual object 50 in the metaverse and the average user per time period for the zone to which the virtual object 50 belongs in the metaverse. The first change amount may be calculated by checking the information every preset time.

Then, the processor 110 acquires virtual value information on the virtual asset of the corresponding virtual object 50 based on the first change amount for each preset time and the second change amount for the demand of the virtual object 50 in the metaverse. can go out

Since the value of a real object (40, a representative example: a building) may change according to various conditions such as urban development and changes in people's interest in the real world, in the present disclosure, in order to implement these features in the metaverse, the above configuration is using

Therefore, the server 100 according to the embodiment of the present disclosure effectively calculates the value in the metaverse of the virtual object 50 through the above-described configurations, and reflects the change in the value of the virtual object 50 until recalculation. It has the effect of being able to do it.

5 is a diagram illustrating that instances registered in the metaverse are displayed in the virtual world.

In one embodiment, when a registration of an instance in the metaverse is requested, the processor 110 may include instance contract information including at least one of a display position and a display unit price of an instance in the metaverse based on the request information on the instance. create

Then, when the contract for the generated instance contract information is completed, the processor 110 displays the instance requested to be registered according to the instance contract information in the metaverse as shown in FIG. 5 .

In an embodiment of the present disclosure, an instance means outputting content that can be delivered through at least one of visual and auditory senses in the metaverse, and may correspond to an advertisement image and an advertisement voice in the real world.

In an embodiment of the present disclosure, the instance request information includes the type of instance, data for instance output (eg, audio, video data, etc.), request size, request location (eg, specific location or approximate area, etc.), instance output time, It may include at least one of the instance output maintenance period.

[Instance Display Unit Price Calculation Algorithm]

① Instance direct output method

In the embodiment of the present disclosure, the instance direct output method refers to a method of outputting an instance using a specific virtual object 50 , and may correspond to outputting an advertisement through a billboard or an electric billboard in the real world.

When the instance output request location included in the instance request information is a direct output using a specific virtual object 50 , the processor 110 calculates an instance display unit price based on the virtual value information calculated for the virtual object 50 . can do.

② Instance indirect output method

In the embodiment of the present disclosure, the instance indirect output method means outputting an instance in a method other than the direct output method.

When the instance output request position included in the instance request information is an indirect output that is indirectly influenced by the at least one virtual object 50 , the processor 110 extracts at least one virtual object 50 involved in the output request position. do.

In addition, the processor 110 may calculate the instance display unit price based on the extracted virtual value information of the at least one virtual object 50 and the avatar 60 flow information of the instance output time of the output request position.

[Instance Displayable Position Derivation Algorithm]

6 is a diagram illustrating real world information being displayed in the real world.

7 is a diagram illustrating an instance being displayed in the metaverse.

In the embodiment of the present disclosure, reference to displaying real information in the real world may mean displaying advertisement information in the real world.

In the real world, advertising in urban areas and on the street is generally carried out through means such as billboards and signs that can advertise.

Therefore, in the real world, the locations where advertisements can be performed in the downtown area and on the street are limited.

On the other hand, in the metaverse corresponding to the virtual world, there may be a position where an advertisement (instance) can be displayed even if it is not a position where the advertisement is displayed/output in the real world, and the embodiment of the present disclosure takes advantage of this point. do.

① 1st instance displayable position

In one embodiment, the processor 110 derives the first instance displayable position corresponding to the real information in the metaverse based on the display status of the real information being displayed using the real object 40 in the real world. It may be stored in the storage unit 150 .

The processor 110 may input the value of the real information of the real object 40 into the value calculation model 160 to calculate a unit price for displaying the first instance, and store it in the storage unit 150 .

In detail, the processor 110 is configured to provide virtual value information on the virtual assets of at least one virtual object 50 within a preset distance from the displayable location of the first instance, flow information of the avatars 60 in the corresponding area/region, The first instance display unit price may be calculated based on the average access information.

The ① first instance displayable position extracted in this way may correspond to the ① instance direct output method.

② Second instance displayable position

In one embodiment, the processor 110 may not display real information (advertisement) in the real world based on the placement information of the virtual object 50 in the metaverse and the flow information of the avatars 60 in the metaverse, but At least one second instance displayable position at which an instance is determined to be displayable in the bus may be derived and stored in the storage unit 150 .

6 and 7 , the processor 110 displays/outputs instances 71 , 72 , 73 , etc. in the metaverse of FIG. 7 at positions not displayed in the real world of FIG. 6 .

8 is a diagram exemplifying that a target-type instance is displayed to the avatar 60 connected in the metaverse.

9 is a diagram illustrating a change in the display angle of the instance 70 according to the movement of the viewpoint of the avatar 60 in FIG. 8 .

In this case, the displayable position of the second instance is not limited to a fixed position, and the position of the displayable position of the second instance may be set flexibly so that the position may be moved or rotated in real time.

Referring to FIG. 7 , it is exemplified that the processor 110 displays the instances 72 and 73 according to the gaze of the avatar 60 in front of the avatar 60 that is moving in the metaverse.

Comparing FIGS. 8 and 9 , it is exemplified that the processor 110 rotates the display/output angle of the instance according to the movement and gaze of the avatar 60 in the metaverse.

In one embodiment, when the specific avatar 60 in the metaverse looks at a specific instance being displayed in the metaverse for a preset time or longer, the processor 110 may be configured to maintain the corresponding instance in the gaze of the corresponding avatar 60 . A corresponding instance in the metaverse image provided to the virtual reality device 30 of the avatar 60 may be rendered to be rotated.

In some embodiments, the processor 110 may render the instance so that the display/output size is adjusted as well as rotating the instance.

The ② second instance displayable position extracted in this way may correspond to the ② instance indirect output method.

Additionally, in the embodiment of the present disclosure, importance of each virtual object 50 may be calculated and stored and managed.

In this case, the importance level may be set to a plurality of grades.

The processor 110 may calculate a first importance in the real world of the real object 40 based on real world information of the real object 40 .

In addition, the processor 110 may calculate a second importance of the corresponding virtual object 50 based on the calculated first importance.

At this time, the processor 110 may calculate the second importance based on the virtual value information on the virtual asset of the virtual object 50 and the first importance of the real object 40 corresponding to the virtual object 50 . have.

The processor 110 may delete the virtual object 50 corresponding to or less than a preset second importance level and set the corresponding position as the second instance displayable position.

For example, a virtual object 50 corresponding to a landmark such as 63 Building, Lotte World Tower, etc. may have a second importance of 1st grade, and a virtual object 50 such as a street tree, a ventilation fan, etc. may have a 5th grade. 2 The importance can be calculated. (Assume that the second importance is between 1 and 5 grades)

In this case, the processor 110 may set several virtual objects 50 having a second importance of 5 grades as second instance displayable positions, and display the instances at the corresponding positions when an instance is contracted.

Specifically, the processor 110 deletes a street tree corresponding to the second instance displayable position and displays the instance 71 .

In an embodiment, the processor 110 may receive the real value information of each of the real objects 40 every preset time, and may calculate a first price trend with respect to the real values of each real object 40 . .

The processor 110 calculates a second price trend for the virtual value information of the virtual asset for each virtual object 50 , and calculates the first price trend for the corresponding real object 40 and the virtual object 50 . and the second price trend may be compared, and the comparison result may be input to the value calculation model 160 to update virtual value information on the virtual asset.

The value calculation model 160 applies a preset correction factor to make up for the difference when a difference exceeding a preset threshold is generated in the difference between the first market price trend and the second market price trend to the corresponding virtual object ( 50), virtual value information for the virtual asset can be calculated.

The processor 110 compares the first market price trend with the second market price trend to preemptively select a market price trend in which the market price changes, and calculates an expected value of the remaining market price based on the price of the selected market price trend at every preset time. can

Through this, when the server 100 according to the embodiment of the present disclosure determines that the price of the virtual object 50 in the metaverse is rising first and then the price of the real object 40 is rising, the virtual object 50 is A change in the price of the real object 40 can be predicted in the future based on the price trend, and the opposite example is equally applicable.

Hereinafter, an additional description of the embodiments of the present disclosure will be made.

After S500, the following configurations may be further included.

At least one of an operation of the virtual avatar 60 in the metaverse and a control command of a virtual figure is determined based on the user's motion gesture of the virtual reality device 30 . (S700)

According to the determination result of S700, a metaverse image is rendered so that the virtual avatar 60 in the metaverse is operated, or an environment setting in the metaverse is controlled. (S800)

11 is a diagram illustrating that a user wears the virtual reality device 30 and takes a specific motion.

Referring to FIG. 11 , it is exemplified that a user wearing the virtual reality device 30 makes a motion gesture, and the determination unit 180 receives the operation signal of the virtual reality device 30 received through the communication unit 120 . It is possible to determine the user's motion gesture by analyzing it.

At this time, although the motion gesture is exemplified in a state in which the user wears or holds the virtual reality device 30 on the hand in FIG. 11 , the present invention is not limited thereto.

As another example, a hand gesture may be recognized by photographing the user's body or hand, or components such as AR glasses, HMD, and joystick may be included in the virtual reality device 30 to recognize the user's motion gesture.

Based on the motion gesture of the user of the virtual reality device 30 , the determination unit 180 determines whether the user's motion gesture is a signal for controlling the motion of the character of the virtual avatar 60 in the metaverse or for setting the metaverse environment. It is possible to determine/determine whether a control signal is input for a 3D UI-based virtual figure.

Specifically, the determiner 180 may determine the motion of the avatar 60 in the metaverse based on the motion coordinates of the virtual reality device 30 .

In addition, when the user's motion gesture does not correspond to the operation of the avatar 60 in the metaverse but corresponds to the calling operation for the virtual figure, the processor 110 provides the metaverse provided to the user's virtual reality device 30 . A metaverse image may be rendered so that a virtual figure is displayed in the image.

In the embodiment of the present disclosure, the following method may be applied to recognizing/determining a user's motion gesture, and any method capable of recognizing/determining a user's motion gesture may be applied.

① The server 100 receives motion coordinates or motion signals according to the user's motion gesture from the virtual reality device 30 worn by the user, and analyzes them to recognize and determine the user's motion gesture

② The virtual reality device 30 determines the user's motion gesture based on the motion coordinates according to the user's motion gesture, and provides the determined motion gesture result to the server 100 .

③ The server 100 receives the image data of the user's motion gesture, and analyzes the user's motion gesture by analyzing the received image data

In the embodiment of the present disclosure, the 3D UI-based virtual figure to which different control commands for environment settings in the metaverse are assigned are not displayed on the metaverse image in a general state where the environment settings are not controlled, and the user's calling operation is It can be rendered to be displayed in the metaverse video only when it is present.

As an embodiment, the server 100 may guide the user to a predetermined virtual figure calling operation.

However, the present invention is not limited thereto, and the server 100 may provide a function for each user to create and store a custom virtual figure call operation.

12 is a diagram exemplifying rendering of a virtual figure for environment setting in a metaverse image because a user's motion corresponds to a virtual figure call operation.

In an embodiment, the processor 110 determines that the user's motion gesture in the current metaverse image is not a motion gesture taken with respect to a specific virtual object 50 and corresponds to a preset virtual figure calling operation. It can be rendered so that a virtual figure is displayed on the .

This may be a motion taken with respect to a specific virtual object 50 in the metaverse even if it is determined that the user's motion gesture corresponds to a virtual figure calling operation. It means that it is determined that the motion gesture is a virtual figure calling action only when there is certainty that it is not.

In an embodiment, the virtual figure may be rotated in the metaverse based on at least one axis by the operation of the virtual reality device 30 .

Accordingly, when the user's motion gesture corresponds to a rotation operation based on a specific axis of the virtual figure, the processor 110 controls the rendering unit 140 according to the determination result of the determination unit 180 to create a virtual image within the metaverse image. You can render the shape to rotate.

13 is a diagram illustrating that different control signals are set to respective surfaces included in the virtual figure for different rotational states of the virtual figure.

Referring to FIG. 13 , in the virtual figure, it is possible to set different control signals for each surface included in the virtual figure for each of a plurality of different preset rotation states.

In one embodiment, when it is determined that the user's motion gesture does not correspond to a control signal input to a specific surface of the virtual figure displayed in the metaverse image, but corresponds to the rotation of the virtual figure, the processor 110 responds to the motion gesture. At least one of the rotation direction and the degree of rotation of the virtual figure may be determined based on at least one of the included motion direction, motion range, and motion acceleration.

In addition, the processor 110 may render a virtual figure in the metaverse image based on at least one of the determined rotation direction and rotation intensity.

At this time, when the motion acceleration included in the motion gesture is equal to or greater than the preset acceleration and there is a space in the motion direction in the metaverse image, the processor 110 renders the metaverse image so that the virtual figure is moved to the corresponding position where the space is located. can do.

For example, while the user controls the virtual reality device 30 to move the avatar 60 in the metaverse, it may be determined that the virtual figure obscures the user's view.

In this case, when the processor 110 determines that it is a motion gesture, such as moving the virtual figure to another location, as described above, the processor 110 renders the metaverse image as if the virtual figure is moved to the corresponding blank position. do.

In this case, the blank in the metaverse image may mean an area in which the virtual object 50 does not exist.

The processor 110 may display the virtual figure in consideration of the position of the blank in the metaverse image, and determine the display size of the virtual figure in consideration of the size of the blank.

In addition, although it has been described that different control signals can be set for each face included in the virtual figure in the embodiment of the present disclosure, it is not limited to setting one control signal for each face.

That is, one or more control signals can be set for each surface included in the virtual figure.

For example, different control signals can be set for three different motions, such as swiping up, swiping down, and touching the right side of a virtual figure that is a cube.

As a specific example, when a user using a cube as a virtual figure sets two control signals on each side of the cube, a total of 6 control modes x 5 faces x 2 control signals = a total of 60 different controls It is possible to set the signal.

The metaverse control server 100 based on a user's motion gesture and 3D UI according to an embodiment of the present disclosure can set a plurality of control signals using virtual figures through such a configuration and use them for environment setting in the metaverse. there is an effect

14 is a diagram illustrating rendering of a virtual figure at a position that does not overlap an instance in the metaverse.

Referring to FIG. 14 , the processor 110 interworks with the coordinates of the virtual figure calling operation and the viewpoint of the avatar 60 to provide at least one virtual object 50 included in the metaverse image provided to the virtual reality device 30 . ), at least one of a rendering position and a rendering size of a virtual figure in the metaverse image may be determined.

Also, when at least one instance in the metaverse image is being displayed, the processor 110 may determine a rendering position of the virtual figure from among positions that do not overlap the displayed instance.

In the embodiment of the present disclosure, the instance is a kind of advertisement to be output to the avatars 60 in the metaverse. If the virtual figure is rendered to cover the instance, the advertisement effect may be deteriorated, so the advertisement effect is operated as described above. can be maintained.

In an embodiment, when at least one other avatar 60 interacting with the user's avatar 60 exists in the metaverse image, the processor 110 overlaps the existing at least one other avatar 60 . It is possible to determine the rendering position of the virtual figure from among the positions that are not available.

Additionally, in the embodiment of the present disclosure, importance of each virtual object 50 may be calculated and stored and managed.

In this case, the importance level may be set to a plurality of grades.

The processor 110 may calculate a first importance in the real world of the real object 40 based on real world information of the real object 40 .

In addition, the processor 110 may calculate a second importance of the corresponding virtual object 50 based on the calculated first importance.

At this time, the processor 110 may calculate the second importance based on the virtual value information on the virtual asset of the virtual object 50 and the first importance of the real object 40 corresponding to the virtual object 50 . have.

Accordingly, the processor 110 may calculate an importance in the metaverse set for each virtual object 50 included in the metaverse, and store it in the storage unit 150 .

In addition, the processor 110 may determine the rendering position of the virtual figure from among the virtual objects 50 displayed in the metaverse image that do not overlap with the virtual object 50 having a preset importance or higher.

Through this configuration, the processor 110 renders the virtual figure on the metaverse image according to the virtual figure call operation within the metaverse image so that the user can set the environment in the metaverse using the avatar 60, This has the effect of preventing the virtual figure from blocking the view of an important object in the metaverse image.

The method according to an embodiment of the present disclosure described above may be implemented as a program (or application) to be executed in combination with a server, which is hardware, and stored in a medium.

The above-described program is C, C++, JAVA, machine language, etc. that a processor (CPU) of the computer can read through a device interface of the computer in order for the computer to read the program and execute the methods implemented as a program It may include code (Code) coded in the computer language of Such code may include functional code related to a function defining functions necessary for executing the methods, etc. can do. In addition, the code may further include additional information necessary for the processor of the computer to execute the functions or code related to memory reference for which location (address address) in the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server located remotely in order to execute the functions, the code uses the communication module of the computer to determine how to communicate with any other computer or server remotely. It may further include a communication-related code for whether to communicate and what information or media to transmit and receive during communication.

The storage medium is not a medium that stores data for a short moment, such as a register, a cache, a memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the program may be stored in various recording media on various servers accessible by the computer or in various recording media on the computer of the user. In addition, the medium may be distributed in a computer system connected by a network, and computer-readable codes may be stored in a distributed manner.

The steps of a method or algorithm described in relation to an embodiment of the present disclosure may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present disclosure pertains.

Above, although embodiments of the present disclosure have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present disclosure pertains can realize that the present disclosure can be embodied in other specific forms without changing its technical spirit or essential features. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

10: Asset Management System
30: virtual reality device
40: reality object
50: virtual object
60: Avatar
100: server
110: processor
120: communication department
130: object recognition unit
140: rendering unit
150: storage
160: Value creation model
170: Statistics Department
180: judgment unit
190: input/output unit

Claims (10)

a communication unit that receives an image obtained for the real world and provides an image of a metaverse generated as a digital twin for the real world to a user's virtual reality device;
an object recognition unit recognizing at least one real object in the received real world image and loading real world information of the recognized real object;
a rendering unit generating a virtual object based on the real object recognition result and real world information loaded with respect to the recognized real object to render the metaverse image;
a storage unit storing a value calculation model for calculating virtual value information to be applied to the metaverse based on the real value information on at least one real object in the real world and the real value information on the real object; and
a processor for calculating virtual value information on a virtual asset of the virtual object by using the value calculation model;
The processor is
Receive the real value information of each of the real objects every preset time,
Calculating a first market price trend for the actual value of each of the real objects,
calculating a second price trend for virtual value information of virtual assets for each of the virtual objects;
comparing the first market price trend and the second market price trend calculated for the same real object and virtual object;
updating the virtual value information on the virtual asset by inputting the comparison result into the value calculation model;
When the difference between the first market price trend and the second market price trend exceeds a preset threshold, a preset correction factor is applied to calculate virtual value information for the virtual asset of the virtual object to make up for the difference. do,
comparing the first market price trend with the second market price trend to preemptively select a market price trend in which the market price changes from among the first market price trend or the second market price trend;
Characterized in calculating the expected value of the remaining market price trend based on the selected preemptive price trend at every preset time,
Asset management server for virtual objects in metaverse based on artificial intelligence.
According to claim 1,
The value calculation model is
The real value information of the real object, the floating population information within a preset distance from the real object in the real world, the floating information of the avatar within a preset distance from the virtual object in the metaverse, and the virtual object to which the virtual object belongs in the metaverse characterized in that the virtual value information is calculated based on at least one of the average user information for each time zone for the zone,
Asset management server for virtual objects in metaverse based on artificial intelligence.
3. The method of claim 2,
The processor is
calculating the first change amount by checking the flow information of the avatar within a preset distance from the virtual object in the metaverse and average user information for each time zone in the metaverse for the zone to which the virtual object belongs at each preset time,
Recalculating the virtual value information on the virtual asset of the virtual object based on the first change amount and the second change amount for the demand of the virtual object in the metaverse at every preset time,
Asset management server for virtual objects in metaverse based on artificial intelligence.
According to claim 1,
The processor is
When an instance registration in the metaverse is requested, instance contract information including at least one of a display location and a display unit price of the instance in the metaverse is generated based on the request information on the instance,
When a contract for the generated instance contract information is completed, the instance requested to be registered according to the instance contract information is displayed in the metaverse,
Asset management server for virtual objects in metaverse based on artificial intelligence.
5. The method of claim 4,
The processor is
Based on the current status of real information being displayed using real objects in the real world, a first instance displayable position corresponding to the real information in the metaverse is derived and stored in the storage unit,
Characterized in that inputting the value of the real information in the real world into the value calculation model, calculating the first instance display unit price and storing the value in the storage unit,
Asset management server for virtual objects in metaverse based on artificial intelligence.
6. The method of claim 5,
The processor is
At least one second instance in which the real information is not displayed in the real world, but it is determined that the instance can be displayed in the metaverse based on the virtual object arrangement information in the metaverse and the flow information of the avatars in the metaverse Characterized in deriving a displayable position and storing it in the storage unit,
Asset management server for virtual objects in metaverse based on artificial intelligence.
5. The method of claim 4,
The processor is
When a specific avatar in the metaverse looks at a specific instance displayed in the metaverse for more than a preset time,
Rendering the specific instance in a metaverse image being provided to the virtual reality device of the user of the specific avatar to rotate so that the specific instance is maintained in the gaze of the avatar,
Asset management server for virtual objects in metaverse based on artificial intelligence.
delete A method performed by an asset management server, comprising:
Receiving an image acquired for the real world;
an object recognition step of recognizing at least one real object in the received real-world image and loading real-world information of the recognized real object;
rendering a metaverse image by generating a virtual object based on the real object recognition result and real world information loaded with respect to the recognized real object;
providing an image of the metaverse generated as a digital twin for the real world to a user's virtual reality device; and
calculating virtual value information on a virtual asset of the virtual object using a value calculation model,
The asset management server,
a storage unit storing a value calculation model for calculating virtual value information for application to the metaverse based on the real value information on at least one real object in the real world and the real value information on the real object;
Receive the real value information of each of the real objects every preset time,
Calculating a first market price trend for the actual value of each of the real objects,
calculating a second price trend for virtual value information of virtual assets for each of the virtual objects;
comparing the first market price trend and the second market price trend calculated for the same real object and virtual object;
updating the virtual value information on the virtual asset by inputting the comparison result into the value calculation model;
When the difference between the first market price trend and the second market price trend exceeds a preset threshold, a preset correction factor is applied to calculate virtual value information for the virtual asset of the virtual object to make up for the difference. do,
comparing the first market price trend with the second market price trend to preemptively select a market price trend in which the market price changes from among the first market price trend or the second market price trend;
Characterized in calculating the expected value of the remaining market price trend based on the selected preemptive price trend at every preset time,
Asset management method for virtual objects in metaverse based on artificial intelligence.
A computer-readable recording medium in which a program for executing the method of claim 9 is stored in combination with a computer as hardware.

Images