CN117826989A - Augmented reality immersive interaction method and device for electric power universe - Google Patents
Augmented reality immersive interaction method and device for electric power universe Download PDFInfo
- Publication number
- CN117826989A CN117826989A CN202311705801.3A CN202311705801A CN117826989A CN 117826989 A CN117826989 A CN 117826989A CN 202311705801 A CN202311705801 A CN 202311705801A CN 117826989 A CN117826989 A CN 117826989A
- Authority
- CN
- China
- Prior art keywords
- interaction
- mode
- power
- universe
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 69
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000003993 interaction Effects 0.000 title claims description 332
- 230000002452 interceptive effect Effects 0.000 claims abstract description 86
- 230000006870 function Effects 0.000 claims description 33
- 230000008569 process Effects 0.000 claims description 25
- 238000005457 optimization Methods 0.000 claims description 23
- 238000012360 testing method Methods 0.000 claims description 20
- 230000033001 locomotion Effects 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 13
- 230000009471 action Effects 0.000 claims description 12
- 230000016776 visual perception Effects 0.000 claims description 7
- 239000004984 smart glass Substances 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 10
- 238000004590 computer program Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 239000003550 marker Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The utility model discloses an immersive interactive method and device of electric power meta-universe, the comprehensive application of methods such as head-mounted display, gesture recognition technology, body tracking technology, virtual control console, virtual roaming, voice recognition and mark recognition and interactive feedback has been promoted to this scheme, the kind of interactive mode has been promoted, immersive interactive experience of augmented reality has provided more lifelike and natural immersive virtual electric power system experience for the user, thereby make the user know the running state of electric wire netting facility and the theory of operation of electric power network clearly, predict and simulate the electric power system behavior under different conditions intuitively.
Description
Technical Field
The application relates to the technical field of virtual reality, in particular to an extended reality immersive interaction method and device of an electric power meta-universe.
Background
The power meta-universe is a power system simulation platform based on the technologies of virtual reality, augmented reality, the Internet of things, cloud computing and the like. The method digitizes a physical model of the electric power facility, integrates various data and algorithms, and constructs a virtual electric power system similar to the real world. The user can use interactive modes such as gestures, voice, touch screens and the like in the power meta-universe to monitor, control and manage the power system in real time, simulate and test the power system, and further optimize the system operation.
In the related art, the existing interaction modes of the power universe are too simple, such as gesture, voice, touch screen and other interaction modes, and immersive experience cannot be provided for users, so that the users cannot clearly know the running state of power grid facilities and the working principle of a power network, and meanwhile, the running conditions of the power system under different conditions cannot be intuitively predicted and simulated.
Disclosure of Invention
The application aims at least solving the technical problems in the prior art, and for this reason, the first aspect of the application provides an extended reality immersive interaction method of an electric power meta-universe, which comprises the following steps:
acquiring a target interaction mode on a preset extended reality immersive interaction system of an electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And controlling the virtual power system in the power meta-universe based on the target interaction mode.
In one possible implementation, the construction process of the preset extended reality immersive interaction system of the power universe includes:
acquiring target information and demand information of a user for expanding reality immersive interaction in the power meta universe;
constructing various interactive functions based on the target information and the demand information; wherein the interactive function corresponds to a target interactive mode;
integrating various interaction functions and virtual power systems into a system of a power element universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power element universe;
and testing and optimizing the initial augmented reality immersive interactive system to obtain the preset augmented reality immersive interactive system of the electric power universe.
In one possible implementation, based on the target information and the demand information, a plurality of interactive functions are constructed, including:
determining a target hardware device and a target software system based on the target information; the target hardware device is used for interacting with a system of the power meta-universe, and the target software system is used for interacting with the hardware device of the power meta-universe;
Constructing a user interaction interface based on the target hardware equipment and the target software system;
and constructing various interactive functions according to the demand information and the user interactive interface.
In one possible implementation, the target hardware device includes at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor.
In one possible implementation, the head mounted display includes smart glasses and VR headset.
In one possible implementation, the target software system includes at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a marker control recognition module.
In one possible implementation manner, the optimizing process includes a first optimizing process and a second optimizing process, and the testing and optimizing process are performed on the initial augmented reality immersive interaction system to obtain a preset augmented reality immersive interaction system of the electric power universe, including:
before the initial extended reality immersive interactive system is used, testing and first optimizing processing are carried out on the initial extended reality immersive interactive system, and an intermediate extended reality immersive interactive system is obtained;
And performing second optimization processing on feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
The second aspect of the application proposes an augmented reality immersive interaction device of an electric power meta-universe, the device comprising:
the acquisition module is used for acquiring a target interaction mode on a preset extended reality immersive interaction system of the electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And the control module is used for controlling the virtual power system in the power universe based on the target interaction mode.
In one possible implementation, the above-mentioned augmented reality immersive interaction device of the power meta-universe is further configured to:
acquiring target information and demand information of a user for expanding reality immersive interaction in the power meta universe;
constructing various interactive functions based on the target information and the demand information; wherein the interactive function corresponds to a target interactive mode;
integrating various interaction functions and virtual power systems into a system of a power element universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power element universe;
and testing and optimizing the initial augmented reality immersive interactive system to obtain the preset augmented reality immersive interactive system of the electric power universe.
In one possible implementation, the above-mentioned augmented reality immersive interaction device of the power meta-universe is further configured to:
determining a target hardware device and a target software system based on the target information; the target hardware device is used for interacting with a system of the power meta-universe, and the target software system is used for interacting with the hardware device of the power meta-universe;
Constructing a user interaction interface based on the target hardware equipment and the target software system;
and constructing various interactive functions according to the demand information and the user interactive interface.
In one possible implementation, the target hardware device includes at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor.
In one possible implementation, the head mounted display includes smart glasses and VR headset.
In one possible implementation, the target software system includes at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a marker control recognition module.
In one possible implementation manner, the optimization process includes a first optimization process and a second optimization process, and the augmented reality immersive interaction device of the power universe is further configured to:
before the initial extended reality immersive interactive system is used, testing and first optimizing processing are carried out on the initial extended reality immersive interactive system, and an intermediate extended reality immersive interactive system is obtained;
and performing second optimization processing on feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
A third aspect of the present application proposes an electronic device, the electronic device comprising a processor and a memory, wherein at least one instruction, at least one section of program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one section of program, the code set or the instruction set is loaded and executed by the processor to implement the extended reality immersive interaction method of the power meta-universe according to the first aspect.
A fourth aspect of the present application proposes a computer readable storage medium having stored therein at least one instruction, at least one program, a set of codes or a set of instructions loaded and executed by a processor to implement the augmented reality immersive interaction method of the power universe according to the first aspect.
The embodiment of the application has the following beneficial effects:
the embodiment of the application provides an extended reality immersive interaction method of an electric power meta-universe, which comprises the following steps: the method comprises the steps of obtaining a target interaction mode on a preset augmented reality immersive interaction system of the power element universe, wherein the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual control console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode, the gesture recognition interaction mode is a mode of interacting through gesture information, the body tracking interaction mode is a mode of interacting through body action information, the virtual control console interaction mode is a mode of interacting through physical control equipment operation virtual control console, the virtual roaming interaction mode is a mode of interacting through body free movement information, the voice control recognition interaction mode is a mode of interacting through voice information, the mark control recognition interaction mode is a mode of interacting through superposition of virtual image information to actual power equipment, and finally, the virtual power system in the power element universe is controlled based on the target interaction mode. The method and the system improve the variety of interaction modes, expand the immersive interactive experience, and provide more realistic and natural immersive virtual power system experience for users through comprehensive application of methods such as a head-mounted display, a gesture recognition technology, a body tracking technology, a virtual console, virtual roaming, voice recognition, mark recognition, interactive feedback and the like, so that the users can clearly know the running state of power grid facilities and the working principle of a power network, and intuitively predict and simulate the running condition of the power system under different conditions.
Drawings
FIG. 1 is a block diagram of a computer device provided in an embodiment of the present application;
fig. 2 is a step flowchart of an extended reality immersive interaction method of an electric power meta-universe provided in an embodiment of the present application;
FIG. 3 is a flowchart of steps for constructing a preset augmented reality immersive interaction system according to an embodiment of the present application;
FIG. 4 is a flowchart illustrating steps for constructing multiple interactive functions according to an embodiment of the present application;
FIG. 5 is a flowchart of steps for testing and optimizing an initial augmented reality immersive interactive system according to an embodiment of the present application;
fig. 6 is an overall framework diagram of an extended reality immersive interaction method for a power meta-universe provided in an embodiment of the present application;
fig. 7 is a structural block diagram of an augmented reality immersive interaction device for a power universe provided in an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The terms "first" and "second" are used below for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the embodiments of the present disclosure, unless otherwise indicated, the meaning of "a plurality" is two or more. In addition, the use of "based on" or "according to" is intended to be open and inclusive in that a process, step, calculation, or other action "based on" or "according to" one or more of the stated conditions or values may in practice be based on additional conditions or beyond the stated values.
The augmented reality immersive interaction method of the electric power meta universe can be applied to computer equipment (electronic equipment), wherein the computer equipment can be a server or a terminal, the server can be one server or a server cluster consisting of a plurality of servers, the embodiment of the application is not particularly limited to the method, and the terminal can be but not limited to various personal computers, notebook computers, smart phones, tablet computers and portable wearable equipment.
Taking the example of a computer device being a server, FIG. 1 illustrates a block diagram of a server, as shown in FIG. 1, which may include a processor and memory connected by a system bus. Wherein the processor of the server is configured to provide computing and control capabilities. The memory of the server includes nonvolatile storage medium and internal memory. The nonvolatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The computer program, when executed by the processor, implements an augmented reality immersive interaction method for the universe of power elements.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 is merely a block diagram of a portion of the structure associated with the present application and does not constitute a limitation of the server to which the present application is applied, and that alternatively the server may include more or less components than those shown, or may combine some components, or have a different arrangement of components.
It should be noted that, the execution subject of the embodiment of the present application may be a computer device, or may be an extended reality immersive interaction device of the power universe.
Fig. 2 is a step flowchart of an extended reality immersive interaction method of a power meta-universe provided in an embodiment of the present application. As shown in fig. 2, the method comprises the steps of:
step 202, acquiring a target interaction mode on a preset extended reality immersive interaction system of the power universe.
The target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode.
The gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment.
In some optional embodiments, the preset augmented reality immersive interaction system of the power universe needs to be pre-built, optionally, as shown in fig. 3, fig. 3 is a flowchart of steps for building the preset augmented reality immersive interaction system, which includes:
And 302, acquiring target information and demand information of the user for expanding reality immersive interaction in the power universe.
Step 304, based on the target information and the requirement information, constructing various interactive functions.
And 306, integrating various interaction functions and virtual power systems into a system of the power meta-universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power meta-universe.
And 308, testing and optimizing the initial extended reality immersive interactive system to obtain the preset extended reality immersive interactive system of the electric power universe.
When the preset augmented reality immersive interaction system is constructed, target information and demand information of augmented reality immersive interaction performed by a user in the power meta-universe are required to be determined, namely, the demand information of operations, interactions and the like which the user wants to perform in the power meta-universe, and the target information of experience expected by the user and the like are required to be known. For example, to improve the efficiency of operation of the equipment, to provide a training simulation environment, or to monitor and control the power equipment in real time.
Then, the real world power system needs to be virtualized and modeled and mapped into the power meta-universe, which may include power equipment and its related information, environments, control interfaces, etc., ensuring accuracy and fidelity of the model to provide a more realistic experience, enhancing the user's sense of immersion, and thus obtaining a virtual power system. The technical means adopted for the virtualization in this embodiment is not particularly limited.
In addition, multiple interactive functions are required to be constructed based on the target information and the requirement information, wherein the interactive functions correspond to the target interaction mode. Optionally, as shown in fig. 4, fig. 4 is a flowchart of steps for constructing multiple interaction functions according to an embodiment of the present application, where the steps include:
step 402, determining a target hardware device and a target software system based on the target information.
Step 404, constructing a user interaction interface based on the target hardware device and the target software system.
Step 406, constructing a plurality of interactive functions according to the requirement information and the user interactive interface.
The target hardware devices are used for interacting with the system of the power meta-universe, namely proper target hardware devices are needed to be selected to support augmented reality immersive interaction, and the target hardware devices and the system of the power meta-universe are ensured to interact well.
In some alternative embodiments, the target hardware device includes at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor. Of course, other types of target hardware devices may be included, which are not specifically limited by the embodiments of the present application.
Alternatively, the head-mounted display may include, but is not limited to, smart glasses, VR helmets, etc., so that a realistic virtual reality experience may be provided, fully immersing the user in the power meta-universe. In addition, by using the head-mounted display, a user can see and interact with power equipment, lines and scenes in the virtual power system, and can also see real-time information such as virtual consoles, sensor data and the like, so that the operation response time is shortened.
The target software systems are used for interacting with hardware devices of the power meta-universe, namely, proper target software systems are required to be selected to support augmented reality immersive interaction, and good interaction between the target software systems and the hardware devices of the power meta-universe is ensured.
In some alternative embodiments, the target software system includes at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a mark control recognition module, and each module in the target software system may correspond to one interaction mode. Of course, other types of target software systems may be included, which are not specifically limited by the embodiments of the present application.
After the target hardware equipment and the target software system are determined, the corresponding software tools can be used for design and development based on the target hardware equipment and the target software system, so that a user interaction interface is constructed, a user can interact with the virtual power system, and the user interaction interface is ensured to be visual and easy to use.
Therefore, various interactive functions can be constructed according to the demand information and the user interactive interface, and various interactive modes of the user can be combined and considered when the various interactive functions are constructed.
Then, various interactive functions and virtual power systems can be integrated into the system of the power meta-universe, and real-time power related data are integrated into the scene of the virtual power system, so that the initial extended reality immersive interactive system of the power meta-universe is obtained. Wherein the real-time power related data may include, but is not limited to, power device data, sensor data, etc., to ensure that the user can see up-to-date information.
Finally, the initial extended reality immersive interactive system can be tested and optimized to obtain the preset extended reality immersive interactive system of the electric power universe.
In some optional embodiments, the optimization process may include a first optimization process and a second optimization process, where, when testing and optimizing the initial augmented reality immersive interactive system, as shown in fig. 5, fig. 5 is a flowchart of a step of testing and optimizing the initial augmented reality immersive interactive system provided in an embodiment of the present application, including:
step 502, testing and first optimizing the initial augmented reality immersive interactive system before using the initial augmented reality immersive interactive system to obtain an intermediate augmented reality immersive interactive system.
And step 504, performing second optimization processing on feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
Before the initial augmented reality immersive interactive system is actually used, testing and first optimization processing can be performed on the initial augmented reality immersive interactive system, so that the performance and stability of the augmented reality immersive interactive system are ensured to meet expectations. In addition, the technical means adopted in the test and the first optimization process in the embodiment of the present application are not particularly limited.
And then, training and guidance for using the power universe can be provided for the user, so that the user can correctly use the user interaction interface and the interaction function, and meanwhile, the feedback data of the user can be collected, so that the feedback data of the intermediate augmented reality immersive interaction system can be subjected to second optimization processing by the user, the interaction experience of the power universe is improved and optimized, and finally, the preset augmented reality immersive interaction system is obtained. In addition, the technical means adopted in the second optimization process in the embodiment of the present application is not particularly limited.
And 204, controlling the virtual power system in the power universe based on the target interaction mode.
After the target interaction mode is acquired, the virtual power system in the power universe can be controlled based on the target interaction mode.
The gesture recognition interaction mode is a mode of interaction through gesture information, namely, a user can interact with the virtual power equipment through simple gestures, so that the control and the operation of entities such as the power equipment are realized. The gesture information may be waving, pointing, etc. For example, a user may turn a switch on or off, adjust a parameter of the power device, etc. by a gesture. Therefore, if the target interaction mode is determined to be the gesture recognition interaction mode, the power equipment in the virtual power system can be controlled based on specific gesture information.
In addition, specific gesture information can be acquired through target hardware devices such as a visual perception sensor, a camera and the like aiming at the gesture recognition interaction mode.
The body tracking interaction mode is a mode of interaction through body motion information, namely, a more natural interaction mode can be realized by capturing body motion information such as motion and gesture of a user, so that the user can control virtual power equipment through body motions. For example, a user may adjust the direction or angle of the power device by turning the body. Therefore, if the target interaction mode is determined to be the body tracking interaction mode, the power equipment in the virtual power system can be controlled based on specific body action information.
The virtual console interaction mode is a mode of operating the virtual console to interact through actual control equipment, namely the virtual console is used for simulating the actual control equipment in the real world, and the actual control equipment is a handle and a touch screen in the target hardware equipment, so that a user can operate buttons, switches and regulators on the virtual console through the actual control equipment such as the handle, the touch screen and the like, and the running state of the power equipment is controlled. Therefore, if the target interaction mode is determined to be the virtual console interaction mode, the virtual console can be operated to control the power equipment in the virtual power system based on the actual control equipment.
The virtual roaming interaction mode is a mode of interaction through body free movement information, namely, a user can freely move in the power meta-universe, and the user can explore different scenes through movement of the body and interact with virtual power equipment. Therefore, if the target interaction mode is determined to be the virtual roaming interaction mode, the power equipment in the virtual power system can be controlled based on the body free movement information.
The voice control recognition interaction mode is a mode of interaction through voice information, namely, the voice of the user can be obtained and converted into an electric signal, and the user is allowed to interact with the power equipment directly by using voice instructions. Therefore, if the target interaction mode is determined to be the voice control recognition interaction mode, the power equipment in the virtual power system can be controlled based on specific voice information.
In addition, specific voice information can be collected through a microphone sensor aiming at the voice control recognition interaction mode.
The mark control recognition interaction mode is a mode of interaction by superposing virtual image information on actual power equipment, namely, an image based on an augmented reality technology (Augmented Reality, AR for short) is superposed on the actual power equipment, so that a user can intuitively and rapidly recognize the position, state information and the like of the power equipment. And if the target interaction mode is determined to be the mark control identification interaction mode, the virtual image information can be overlapped to the actual power equipment to control the power equipment in the virtual power system.
In some alternative embodiments, the user experience may also be enhanced by interactive feedback, which may give the user real-time feedback by way of tactile feedback, sound effects or visual effects, etc. to increase realism and immersion as the user operates the virtual power device.
In an embodiment of the present application, the method includes: the method comprises the steps of obtaining a target interaction mode on a preset augmented reality immersive interaction system of the power element universe, wherein the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual control console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode, the gesture recognition interaction mode is a mode of interacting through gesture information, the body tracking interaction mode is a mode of interacting through body action information, the virtual control console interaction mode is a mode of interacting through physical control equipment operation virtual control console, the virtual roaming interaction mode is a mode of interacting through body free movement information, the voice control recognition interaction mode is a mode of interacting through voice information, the mark control recognition interaction mode is a mode of interacting through superposition of virtual image information to actual power equipment, and finally, the virtual power system in the power element universe is controlled based on the target interaction mode. The method and the system improve the variety of interaction modes, expand the immersive interactive experience, and provide more realistic and natural immersive virtual power system experience for users through comprehensive application of methods such as a head-mounted display, a gesture recognition technology, a body tracking technology, a virtual console, virtual roaming, voice recognition, mark recognition, interactive feedback and the like, so that the users can clearly know the running state of power grid facilities and the working principle of a power network, and intuitively predict and simulate the running condition of the power system under different conditions.
The application also provides an overall flow of the augmented reality immersive interaction method of the power element universe, as shown in fig. 6, fig. 6 is an overall frame diagram of the augmented reality immersive interaction method of the power element universe provided by the embodiment of the application, and the variety of interaction modes is improved, the augmented reality immersive interaction experience is expanded, more vivid and natural immersive virtual power system experience is provided for a user, so that the user can clearly know the running state of power grid facilities and the working principle of a power network, and intuitively predict and simulate the running condition of the power system under different conditions through comprehensive application of the methods such as a head-mounted display, a gesture recognition technology, a body tracking technology, a virtual console, virtual roaming, voice recognition, mark recognition and interaction feedback.
It should be understood that, although the steps in the flowcharts related to the embodiments described above are sequentially shown as indicated by arrows, these steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the flowcharts described in the above embodiments may include a plurality of steps or a plurality of stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the steps or stages is not necessarily performed sequentially, but may be performed alternately or alternately with at least some of the other steps or stages.
Fig. 7 is a structural block diagram of an extended reality immersive interaction device of an electric power meta-universe provided in an embodiment of the present application.
As shown in fig. 7, the augmented reality immersive interaction device 700 of the power meta-universe includes:
the acquisition module 702 is configured to acquire a target interaction manner on a preset augmented reality immersive interaction system of the power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment.
And the control module 704 is used for controlling the virtual power system in the power universe based on the target interaction mode.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein. All or part of each module in the construction method of the electric power meta-universe augmented reality immersive interaction method can be realized by software, hardware and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may invoke and perform the operations of the above modules.
In one embodiment of the present application, a computer device is provided, the computer device comprising a memory and a processor, the memory having stored therein a computer program, the processor, when executing the computer program, performing the steps of:
acquiring a target interaction mode on a preset extended reality immersive interaction system of an electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And controlling the virtual power system in the power meta-universe based on the target interaction mode.
In one embodiment of the present application, the processor when executing the computer program further performs the steps of:
acquiring target information and demand information of a user for expanding reality immersive interaction in the power meta universe;
constructing various interactive functions based on the target information and the demand information; wherein the interactive function corresponds to a target interactive mode;
integrating various interaction functions and virtual power systems into a system of a power element universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power element universe;
and testing and optimizing the initial augmented reality immersive interactive system to obtain the preset augmented reality immersive interactive system of the electric power universe.
In one embodiment of the present application, the processor when executing the computer program further performs the steps of:
determining a target hardware device and a target software system based on the target information; the target hardware device is used for interacting with a system of the power meta-universe, and the target software system is used for interacting with the hardware device of the power meta-universe;
Constructing a user interaction interface based on the target hardware equipment and the target software system;
and constructing various interactive functions according to the demand information and the user interactive interface.
In one embodiment of the present application, the target hardware device includes at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor.
In one embodiment of the present application, a head mounted display includes smart glasses and VR headset.
In one embodiment of the present application, the target software system includes at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a tag control recognition module.
In one embodiment of the present application, the optimization process includes a first optimization process and a second optimization process, and the processor when executing the computer program further implements the following steps:
before the initial extended reality immersive interactive system is used, testing and first optimizing processing are carried out on the initial extended reality immersive interactive system, and an intermediate extended reality immersive interactive system is obtained;
and performing second optimization processing on feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
The computer device provided in the embodiments of the present application has similar implementation principles and technical effects to those of the above method embodiments, and will not be described herein.
In one embodiment of the present application, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a target interaction mode on a preset extended reality immersive interaction system of an electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the marking control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And controlling the virtual power system in the power meta-universe based on the target interaction mode.
In one embodiment of the present application, the computer program when executed by the processor further performs the steps of:
acquiring target information and demand information of a user for expanding reality immersive interaction in the power meta universe;
constructing various interactive functions based on the target information and the demand information; wherein the interactive function corresponds to a target interactive mode;
integrating various interaction functions and virtual power systems into a system of a power element universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power element universe;
and testing and optimizing the initial augmented reality immersive interactive system to obtain the preset augmented reality immersive interactive system of the electric power universe.
In one embodiment of the present application, the computer program when executed by the processor further performs the steps of:
determining a target hardware device and a target software system based on the target information; the target hardware device is used for interacting with a system of the power meta-universe, and the target software system is used for interacting with the hardware device of the power meta-universe;
Constructing a user interaction interface based on the target hardware equipment and the target software system;
and constructing various interactive functions according to the demand information and the user interactive interface.
In one embodiment of the present application, the target hardware device includes at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor.
In one embodiment of the present application, a head mounted display includes smart glasses and VR headset.
In one embodiment of the present application, the target software system includes at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a tag control recognition module.
In one embodiment of the present application, the optimization process includes a first optimization process and a second optimization process, and the computer program when executed by the processor further implements the steps of:
before the initial extended reality immersive interactive system is used, testing and first optimizing processing are carried out on the initial extended reality immersive interactive system, and an intermediate extended reality immersive interactive system is obtained;
and performing second optimization processing on feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
The computer readable storage medium provided in this embodiment has similar principles and technical effects to those of the above method embodiment, and will not be described herein.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. An augmented reality immersive interaction method of an electric power meta-universe, which is characterized by comprising the following steps:
acquiring a target interaction mode on a preset extended reality immersive interaction system of an electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the mark control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And controlling the virtual power system in the power universe based on the target interaction mode.
2. The method of claim 1, wherein the construction process of the preset augmented reality immersive interaction system of the power universe comprises:
acquiring target information and demand information of a user for performing augmented reality immersive interaction in the power universe;
constructing a plurality of interaction functions based on the target information and the demand information; wherein the interactive function corresponds to the target interactive mode;
integrating the multiple interaction functions and the virtual power system into a system of the power meta-universe, and integrating real-time power related data into a scene of the virtual power system to obtain an initial extended reality immersive interaction system of the power meta-universe;
and testing and optimizing the initial extended reality immersive interaction system to obtain the preset extended reality immersive interaction system of the electric power universe.
3. The method of claim 2, wherein the constructing a plurality of interactive functions based on the target information and the demand information comprises:
Determining a target hardware device and a target software system based on the target information; the target hardware device is used for interacting with a system of the power meta-universe, and the target software system is used for interacting with the hardware device of the power meta-universe;
constructing a user interaction interface based on the target hardware equipment and the target software system;
and constructing the plurality of interactive functions according to the demand information and the user interactive interface.
4. The method of claim 3, wherein the target hardware device comprises at least a head mounted display, a visual perception sensor, a camera, a touch screen, a handle, and a microphone sensor.
5. The method of claim 4, wherein the head mounted display comprises smart glasses and VR headset.
6. The method of any of claims 3-5, wherein the target software system comprises at least a gesture recognition module, a body tracking module, a virtual console module, a virtual roaming module, a voice control recognition module, and a mark control recognition module.
7. The method according to any one of claims 2-5, wherein the optimizing process includes a first optimizing process and a second optimizing process, and the testing and optimizing process are performed on the initial augmented reality immersive interactive system to obtain a preset augmented reality immersive interactive system of the power universe, including:
Before the initial extended reality immersive interactive system is used, testing the initial extended reality immersive interactive system and performing first optimization processing to obtain an intermediate extended reality immersive interactive system;
and carrying out the second optimization processing on the feedback data of the intermediate augmented reality immersive interaction system by a user to obtain the preset augmented reality immersive interaction system.
8. An augmented reality immersive interaction device of an electric power meta-universe, the device comprising:
the acquisition module is used for acquiring a target interaction mode on a preset extended reality immersive interaction system of the electric power universe; the target interaction mode at least comprises a gesture recognition interaction mode, a body tracking interaction mode, a virtual console interaction mode, a virtual roaming interaction mode, a voice control recognition interaction mode and a mark control recognition interaction mode; the gesture recognition interaction mode is a mode of interaction through gesture information, the body tracking interaction mode is a mode of interaction through body action information, the virtual console interaction mode is a mode of interaction through operation of a virtual console by actual control equipment, the virtual roaming interaction mode is a mode of interaction through free movement information of a body, the voice control recognition interaction mode is a mode of interaction through voice information, and the mark control recognition interaction mode is a mode of interaction through superposition of virtual image information to actual power equipment;
And the control module is used for controlling the virtual power system in the power meta-universe based on the target interaction mode.
9. An electronic device comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a set of codes, or a set of instructions, the at least one instruction, the at least one program, the set of codes, or the set of instructions being loaded and executed by the processor to implement the augmented reality immersive interaction method of the power universe of any one of claims 1-7.
10. A computer readable storage medium having stored therein at least one instruction, at least one program, code set, or instruction set loaded and executed by a processor to implement the extended reality immersive interaction method of the power universe of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311705801.3A CN117826989A (en) | 2023-12-13 | 2023-12-13 | Augmented reality immersive interaction method and device for electric power universe |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311705801.3A CN117826989A (en) | 2023-12-13 | 2023-12-13 | Augmented reality immersive interaction method and device for electric power universe |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117826989A true CN117826989A (en) | 2024-04-05 |
Family
ID=90523491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311705801.3A Pending CN117826989A (en) | 2023-12-13 | 2023-12-13 | Augmented reality immersive interaction method and device for electric power universe |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117826989A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118642602A (en) * | 2024-08-16 | 2024-09-13 | 学能通(山东)智能设备有限公司 | Immersive Ai functional cabin man-machine interaction system |
-
2023
- 2023-12-13 CN CN202311705801.3A patent/CN117826989A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118642602A (en) * | 2024-08-16 | 2024-09-13 | 学能通(山东)智能设备有限公司 | Immersive Ai functional cabin man-machine interaction system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7299414B2 (en) | Image processing method, device, electronic device and computer program | |
| CN103157281B (en) | Display method and display equipment of two-dimension game scene | |
| US9472119B2 (en) | Computer-implemented operator training system and method of controlling the system | |
| CN110568929B (en) | Virtual scene interaction method and device based on virtual keyboard and electronic equipment | |
| US10162737B2 (en) | Emulating a user performing spatial gestures | |
| CN109035415B (en) | Virtual model processing method, device, equipment and computer readable storage medium | |
| CN112669194B (en) | Animation processing method, device, equipment and storage medium in virtual scene | |
| CN110766788B (en) | Method and device for mapping virtual object to real world | |
| CN102651180A (en) | OSG-based (open scene graph-based) electric-electronic virtual experiment simulation system | |
| KR20150067096A (en) | Method, system and computer-readable recording medium for creating motion sequence of animation | |
| WO2018156087A1 (en) | Finite-element analysis augmented reality system and method | |
| CN113934630A (en) | Software testing method, device, equipment and medium based on image recognition | |
| CN117826989A (en) | Augmented reality immersive interaction method and device for electric power universe | |
| CN111080755A (en) | Motion calculation method and device, storage medium and electronic equipment | |
| CN111190826A (en) | Testing method and device for virtual reality immersive tracking environment, storage medium and equipment | |
| CN105706023B (en) | With the communication for the input equipment that do not support | |
| CN110757457A (en) | Processing simulation method, device and system of Internet of things robot | |
| CN115116295A (en) | Method, system, equipment and storage medium for displaying association interaction training | |
| CN110244842B (en) | VR model, VR scene processing method, VR training system, storage medium and electronic equipment | |
| US11822863B2 (en) | Model based system for virtual device simulation | |
| CN112233208A (en) | Robot state processing method and device, computing equipment and storage medium | |
| CN113808236B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN118534998A (en) | Virtual interaction method, device, equipment and medium | |
| CN117011428A (en) | Method and related device for redirecting motion | |
| US20220146262A1 (en) | Synchronization of a gyroscope in a virtual-reality environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |