CN118394245A - Three-dimensional visual data analysis and display system - Google Patents
Three-dimensional visual data analysis and display system Download PDFInfo
- Publication number
- CN118394245A CN118394245A CN202410858160.3A CN202410858160A CN118394245A CN 118394245 A CN118394245 A CN 118394245A CN 202410858160 A CN202410858160 A CN 202410858160A CN 118394245 A CN118394245 A CN 118394245A
- Authority
- CN
- China
- Prior art keywords
- data
- unit
- module
- intelligent
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 36
- 238000007405 data analysis Methods 0.000 title claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 57
- 238000004891 communication Methods 0.000 claims abstract description 44
- 230000003993 interaction Effects 0.000 claims abstract description 29
- 230000000694 effects Effects 0.000 claims abstract description 14
- 230000002159 abnormal effect Effects 0.000 claims abstract description 8
- 239000004973 liquid crystal related substance Substances 0.000 claims description 29
- 230000002452 interceptive effect Effects 0.000 claims description 27
- 238000007726 management method Methods 0.000 claims description 17
- 230000006870 function Effects 0.000 claims description 16
- 238000007781 pre-processing Methods 0.000 claims description 14
- 238000000034 method Methods 0.000 claims description 13
- 238000004140 cleaning Methods 0.000 claims description 12
- 238000013500 data storage Methods 0.000 claims description 12
- 230000008569 process Effects 0.000 claims description 11
- 238000009877 rendering Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000005286 illumination Methods 0.000 claims description 8
- 230000008676 import Effects 0.000 claims description 7
- 238000007654 immersion Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000013135 deep learning Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 claims description 4
- 238000003062 neural network model Methods 0.000 claims description 4
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 238000001514 detection method Methods 0.000 claims description 3
- 238000011161 development Methods 0.000 claims description 3
- 230000018109 developmental process Effects 0.000 claims description 3
- 210000001503 joint Anatomy 0.000 claims description 3
- 230000001795 light effect Effects 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 230000011218 segmentation Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 8
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 206010063385 Intellectualisation Diseases 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000006403 short-term memory Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
- G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G06N3/0455—Auto-encoder networks; Encoder-decoder networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Human Computer Interaction (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a three-dimensional visual data analysis and display system, which belongs to the field of data analysis and display systems, and the three-dimensional visual data analysis and display system is characterized in that through an intelligent man-machine interaction module and an intelligent switch control module which are arranged in the system, equipment control management in a factory is not only limited to a single control mode of manual background monitoring and mouse click control, an intention recognition unit can recognize abnormal sensor data signals output by a data processing and converting unit, and actively issues instructions to the intelligent switch control module, so that the effect of intelligent processing and control on data of equipment is achieved, system technicians and factory staff can enter the system to communicate and update at the same time, the platform editing and communication are integrated, communication delay caused by switching a communication platform is avoided, and convenience in later system updating is improved.
Description
Technical Field
The present invention relates to the field of data analysis display systems, and more particularly to three-dimensional visual data analysis and display systems.
Background
The three-dimensional visual data display system is used as a product of high fusion of a modern information technology and a graphic processing technology, has incomparable advantages and application potential in various fields in recent years, and is convenient and visual to manage by introducing various received data into the system, arranging various calculation display methods in the system and matching with a real-time updated display model.
The three-dimensional visual display system applied to the integrated management of the factory equipment at present has various use advantages through continuous iterative updating, but the inventor finds that the following defects exist in the actual use process:
1. although the existing three-dimensional visual display system applied to a factory is high in integration level, various sensors and intelligent control switches on internal equipment of the factory can be connected in an integrated manner, most of control of the three-dimensional visual display system still depends on manual monitoring and manual mouse clicking intervention control of a background digital liquid crystal display device (background computer), the degree of automation is low, and the whole intellectualization of the system is affected;
2. the existing three-dimensional visual display system has an editing function, but needs to be continuously switched back and forth between an editing page and a communication and exchange page when the editing and updating are performed, and the system lacks a collaborative editing function under the same platform system architecture, has certain delay and inconvenience in communication, and is inconvenient to use;
3. the existing three-dimensional visual display system still uses a display form of a digital liquid crystal large screen, and the display form has good data display effect, but lacks an immersive experience effect for participants;
we have therefore proposed a three-dimensional visual data analysis and presentation system to address the above-mentioned problems.
Disclosure of Invention
Aiming at the problems existing in the prior art, the invention aims to provide a three-dimensional visual data analysis and display system, which is characterized in that the three-dimensional visual display system in the existing factory is manually monitored and manually clicks a mouse to intervene and control according to a background digital liquid crystal display device (background computer), the automation degree is low, the intelligent existing technical problems of the whole system are affected, the intelligent man-machine interaction module and the intelligent switch control module are arranged in the system, the control and management of equipment in the factory are not only limited to the single control mode of monitoring at the background and utilizing the mouse to click control, after an operator exhaling control instruction is received by the intelligent man-machine interaction module, an intention recognition unit in the intelligent man-machine interaction module can actively transmit an instruction to the intelligent switch control module, the effect of controlling the equipment in the factory is achieved, and the intention recognition unit connected with the data acquisition and processing module is arranged in the intelligent man-machine interaction module, the recognition unit can recognize abnormal sensor data signals output by the data processing and conversion unit and actively transmit the instruction to the intelligent switch control module, and the effect of intelligent processing and intention control of the equipment are achieved;
The system comprises a three-dimensional visual display system, a communication platform, a multi-user collaboration module, a communication platform and a communication interaction platform, wherein the three-dimensional visual display system is characterized in that the three-dimensional visual display system comprises an editing function, but when the three-dimensional visual display system is edited and updated, the editing page and the communication interaction page are required to be continuously switched back and forth, the collaborative editing function under the same platform system architecture is lacked, the communication has a certain delay and inconvenience, the technical problem that the use is inconvenient exists is solved, and through the multi-user collaboration module mounted in the system, system technicians and factory staff can enter the system to perform communication and update at the same time, the convenience of the system in later updating is improved, and the internal interactive communication unit is utilized to perform communication in time, so that platform editing and communication are integrated, the communication delay brought by switching of the communication platform is avoided, and the convenience of the system in later updating is improved;
Then, aiming at the existing three-dimensional visual display system, the display form of the digital liquid crystal large screen still remains, and although the display form has a good data display effect, the technical problem that the immersive experience effect exists for the participants is lacking, and through arranging the immersive interactive data cabin system in the system, the participants wear intelligent equipment to simulate immersion in the data system and embody through holographic projection display equipment, so that the experience in the data display process is greatly improved.
In order to solve the problems, the invention adopts the following technical scheme:
The three-dimensional visual data analysis and display system comprises a basic data acquisition and processing system and an immersive interactive data cabin system, wherein the basic data acquisition and processing system and the immersive interactive data cabin system are operated through operation software in an operation server, and the basic data acquisition and processing system and the immersive interactive data cabin system are in an interactive data operation mode;
The basic data acquisition processing system comprises a three-dimensional modeling module, a data acquisition and processing module, an intelligent man-machine interaction module, an intelligent switch control module and a digital liquid crystal display device which is in communication connection with the operation server, wherein the three-dimensional modeling module, the data acquisition and processing module, the intelligent man-machine interaction module, the intelligent switch control module and the digital liquid crystal display device are connected through network signals, the digital liquid crystal display device is also connected with a multi-user cooperation module and a compatible expansion module through network signals, and a plurality of digital liquid crystal display devices are connected with the operation server through network signals;
The intelligent man-machine interaction module comprises a voice recognition unit, a text preprocessing unit, an intention recognition unit and a dialogue generation unit, wherein the voice recognition unit receives voice input of a user and converts the voice input into a text form, the text preprocessing unit performs preprocessing operations such as word segmentation, denoising, part-of-speech tagging and the like on the converted text, the intention recognition unit performs processing operations on the preprocessed text through a deep learning algorithm or a preset processing program to recognize the intention of the user and perform active automatic control, and the dialogue generation unit performs active dialogue on the text of the text preprocessing unit and feeds back the result of the active automatic control so that the user can know the processing result conveniently;
The immersion type interaction data cabin system comprises a holographic projection module, a touch feedback module, a data processing module, an environment sensing module and an intelligent analysis module, wherein a plurality of holographic projection interface units are arranged inside the holographic projection module, holographic projection display equipment is connected with network signals of the holographic projection interface units, a plurality of intelligent wearing equipment interface units are arranged inside the touch feedback module, the intelligent wearing equipment interface units are connected with intelligent wearing equipment through network signals, and a plurality of environment sensor interface units are arranged inside the environment sensing module.
Further, the three-dimensional modeling module comprises an image data acquisition unit, a geometric modeling unit and an illumination and rendering unit, wherein the image data acquisition unit is provided with a data transmission connection port of a laser scanning, photographing and measuring instrument, so that the acquired data can be conveniently uploaded, CAD, solidWorks, CATIA three-dimensional model modeling software is mounted in the geometric modeling unit and used for building an ideal facility model, and a subunit used for setting the position, the intensity, the color and other properties of a light source is arranged in the illumination and rendering unit, so that a vivid light effect is created, the stereoscopic impression and the sense of reality of the model built by the geometric modeling unit are enhanced, and the display effect of a later three-dimensional scene is improved;
The data acquisition and processing module comprises a sensor data acquisition unit, a data cleaning unit, a data storage unit and a data processing and conversion unit, wherein a sensor data transmission connection port is arranged in the sensor data acquisition unit, data captured by various sensors are conveniently received, the data cleaning unit denoises the received data, processes missing values and abnormal values, corrects data inconsistency and ensures data quality, the data storage unit designs, manages and stores the data processed by the data cleaning unit, and the data storage unit also stores preset standard data, so that the data is conveniently compared with the newly received data in the later running process to ensure normal running or early warning of the equipment monitored by the sensor, and the data processing and conversion unit applies algorithms or rules to calculate, aggregate, sort, filter and the like the data so as to facilitate subsequent further operation or meet specific purposes.
Furthermore, the intention recognition unit is integrated with a pre-trained deep neural network model, such as a BERT or a Transformer architecture, so as to realize deeper semantic understanding and generalization capability, and the intention recognition unit is also integrated with a context understanding unit inside, and a circulating neural network (RNN) or a long and short term memory network (LSTM) is used for tracking and analyzing the dialogue history to realize accurate response under continuous dialogue scene.
Further, the multi-user collaboration module comprises a real-time synchronization unit, a right management and access control unit, a collaboration editing unit and an interactive communication unit, wherein the real-time synchronization unit enables a plurality of user terminals to be connected under the same local area network, realizes the technology of real-time data and state synchronization, ensures that all participants view the same and latest three-dimensional model view, editing operation, annotation and discussion content in real time, integrates a right management system with the right management and access control unit, supports an administrator to allocate different levels of access rights for different users, such as viewing, editing, comment and the like, and ensures the orderly progress of data security and project management.
Furthermore, the collaborative editing unit is internally integrated with an editing function area, allows multiple users to edit the same three-dimensional model at the same time, adopts a conflict detection and resolution algorithm to automatically or prompt the users to resolve editing conflicts and keep the consistency and the integrity of model data, and the interactive communication unit is internally integrated with a communication chat software function area to provide text chat, voice communication and video conference functions, provide convenient instant communication means for the users and promote effective communication and coordination among team members.
Furthermore, an external data import port is arranged in the compatible expansion module, so that externally imported graphic data and sensing data can be subjected to seamless butt joint, and the data import and export and the subsequent upgrading and custom development of system functions are facilitated.
Further, the sensor data acquisition unit is connected with a plurality of sensors through a network signal of the access switch I, the sensors are respectively arranged on a plurality of different monitored devices, and the access switch I is connected with the digital liquid crystal display device through the network signal.
Further, the intelligent switch control module is connected with a plurality of intelligent control switches through a second network signal of the access switch, the intelligent control switches are respectively arranged on a plurality of different monitored devices, and the second network signal of the access switch is connected with the digital liquid crystal display device.
Compared with the prior art, the invention has the advantages that:
(1) According to the scheme, through the intelligent man-machine interaction module and the intelligent switch control module which are arranged in the system, equipment control management in a factory is not only limited to a single control mode of manual background monitoring and mouse click control, after an operator exhalate control instruction is received by the intelligent man-machine interaction module, an intention recognition unit in the intelligent man-machine interaction module can actively send the instruction to the intelligent switch control module, the effect of equipment control in the factory is achieved, and as the intention recognition unit connected with the data acquisition and processing module is arranged in the intelligent man-machine interaction module, the intention recognition unit can recognize abnormal sensor data signals output by the data processing and conversion unit and actively send the instruction to the intelligent switch control module, and the data intelligent processing and control effect of equipment are achieved;
(2) According to the scheme, the multi-user cooperative module is mounted in the system, so that system technicians and factory workers can enter the system to carry out communication update at the same time, the convenience of the system in later updating is improved, the internal interactive communication unit can be utilized to communicate in time during communication, the platform editing and communication are integrated, communication delay caused by switching the communication platform is avoided, and the convenience of the system in later updating is improved;
(3) According to the scheme, the immersion type interaction data cabin system is arranged in the system, so that the participants can wear intelligent equipment to simulate immersion in the data system, the immersion type interaction data cabin system is reflected through holographic projection display equipment, and the experience in the data display process is greatly improved.
Drawings
Fig. 1 is a schematic diagram of a data transmission device architecture of the present invention;
Fig. 2 is a schematic diagram of a data transmission device architecture according to the present invention;
FIG. 3 is a schematic diagram of a main system architecture of the present invention;
FIG. 4 is a schematic diagram of a unit system in a basic data acquisition and processing system according to the present invention;
FIG. 5 is a schematic diagram of a second unit system in the basic data acquisition and processing system of the present invention;
FIG. 6 is a schematic diagram of a unit system in the basic data acquisition and processing system of the present invention;
FIG. 7 is a schematic diagram of a unit system in a basic data acquisition and processing system according to the present invention;
fig. 8 is a schematic diagram of a unit system in the immersive interactive data pod system of the present invention.
The reference numerals in the figures illustrate:
1. A three-dimensional modeling module; 101. an image data acquisition unit; 102. a geometric modeling unit; 103. an illumination and rendering unit;
2. A data acquisition and processing module; 201. a sensor data acquisition unit; 202. a data cleaning unit; 203. a data storage unit; 204. a data processing and converting unit;
3. An intelligent man-machine interaction module; 301. a voice recognition unit; 302. a text preprocessing unit; 303. an intention recognition unit; 3031. a deep neural network model; 3032. a context understanding unit; 304. a dialogue generating unit;
4. An intelligent switch control module;
5. a digital liquid crystal display device;
6. A multi-user collaboration module; 601. a real-time synchronization unit; 602. a rights management and access control unit; 603. a collaborative editing unit; 604. an interactive communication unit; 6041. communication chat software functional areas;
7. A compatible expansion module; 701. an external data import port;
8. Operating a server;
9. A basic data acquisition and processing system;
10. An immersive interactive data pod system; 1001. a holographic projection module; 1011. a holographic projection interface unit; 1021. holographic projection display equipment; 1002. a haptic feedback module; 1012. an intelligent wearable device interface unit; 1022. an intelligent wearable device; 1003. a data processing module; 1004. an environment sensing module; 1014. an environmental sensor interface unit; 1005. and an intelligent analysis module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings of the present invention; it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments, and that all other embodiments obtained by persons of ordinary skill in the art without making creative efforts based on the embodiments in the present invention are within the protection scope of the present invention.
Examples
Referring to fig. 1-8, the three-dimensional visual data analysis and display system comprises a basic data acquisition and processing system 9 and an immersive interactive data cabin system 10, wherein the basic data acquisition and processing system 9 and the immersive interactive data cabin system 10 operate through operation software in an operation server 8, and the basic data acquisition and processing system 9 and the immersive interactive data cabin system 10 are in an interactive data operation mode;
The basic data acquisition and processing system 9 comprises a three-dimensional modeling module 1, a data acquisition and processing module 2, an intelligent man-machine interaction module 3, an intelligent switch control module 4 and a digital liquid crystal display device 5, wherein the three-dimensional modeling module 1, the data acquisition and processing module 2, the intelligent man-machine interaction module 3, the intelligent switch control module 4 and the digital liquid crystal display device 5 are connected through network signals, the digital liquid crystal display device 5 is also connected with a multi-user collaboration module 6 and a compatible expansion module 7 through network signals, an external data import port 701 is arranged in the compatible expansion module 7, so that externally imported graphic data and sensing data can be subjected to seamless butt joint, and the data import export and the subsequent upgrading and custom development of system functions are facilitated, and an operation server 8 is connected between a plurality of digital liquid crystal display devices 5 through network signals;
the three-dimensional modeling module 1 comprises an image data acquisition unit 101, a geometric modeling unit 102 and an illumination and rendering unit 103, wherein the image data acquisition unit 101 is provided with a data transmission connection port of laser scanning, photographic shooting and measuring instruments, so that the acquired data can be conveniently uploaded, CAD, solidWorks, CATIA three-dimensional model modeling software is arranged in the geometric modeling unit 102 and used for building an ideal facility model, a subunit used for setting the position, the intensity, the color and other attributes of a light source is arranged in the illumination and rendering unit 103, a vivid light effect is built, the stereoscopic impression and the sense of reality of the model built by the geometric modeling unit 102 are enhanced, and the display effect of a later three-dimensional scene is improved;
The data acquisition and processing module 2 comprises a sensor data acquisition unit 201, a data cleaning unit 202, a data storage unit 203 and a data processing and converting unit 204, wherein a sensor data transmission connection port is configured in the sensor data acquisition unit 201, so that various data captured by sensors can be conveniently received, the data cleaning unit 202 denoises the received data, missing values and abnormal values are processed, data inconsistency is corrected, the data quality is ensured, the data storage unit 203 designs, manages and stores the data processed by the data cleaning unit 202, the data storage unit 203 also stores preset standard data, the data is conveniently compared with the newly received data in the later operation, so that the normal operation or early warning of the equipment monitored by the sensors is ensured, the data processing and converting unit 204 performs operations such as calculation, aggregation, sequencing and filtering on the data by applying algorithms or rules, so that the subsequent further operation or specific application is met, the sensor data acquisition unit 201 is connected with a plurality of sensors through a network signal access switch, the plurality of sensors are respectively installed on a plurality of different monitored equipment, and the liquid crystal display device is connected with a digital signal display network 5 through the liquid crystal display device; the intelligent switch control module 4 is connected with a plurality of intelligent control switches through a second network signal of the access switch, the intelligent control switches are respectively arranged on a plurality of different monitored devices, and the second network signal of the access switch is connected with the digital liquid crystal display device 5.
1. The basic data acquisition processing system of the three-dimensional visual data analysis and display system adopts the following principle:
when the three-dimensional visual data analysis and display system initial modeling is performed, a system technician enters into system operation software carried by the system initial modeling through the digital liquid crystal display device 5, initial modeling is performed on a factory through the three-dimensional modeling module 1, the initial modeling comprises modeling on geographical positions of the factory, scaled patterns of the factory and the like, corresponding factory equipment layout and connection of pipeline lines, rendering and image quality enhancement are performed through the enhancement geometric modeling unit 102 and the illumination and rendering unit 103 after the modeling is completed, so that the sense of reality of the model is improved, modeling can be performed in a mode which is more required to be selected appropriately, for example, modeling can be performed on relatively large objects such as factory buildings directly by utilizing CAD, solidWorks, CATIA three-dimensional model modeling software in the geometric modeling unit 102, and data uploading modeling can be performed on equipment, sensors and corresponding control switches directly by utilizing laser scanners, photographic cameras and measuring instruments which can be connected with the image data acquisition unit 101, so that the modeling efficiency is improved;
When the three-dimensional visual data analysis and display system runs after the modeling work is finished, firstly, each sensor used for monitoring whether the equipment runs normally is connected with the first access switch by using a connecting wire, then, the first access switch is connected with the digital liquid crystal display device 5 by using a network cable, so that a sensor data acquisition unit 201 inside the digital liquid crystal display device 5 can receive monitoring signals transmitted by each sensor in real time, in the process, a data cleaning unit 202 denoises signal data, processes missing values and abnormal values, corrects data inconsistency, ensures data quality, and simultaneously, a data storage unit 203 designs, manages and stores the data processed by the data cleaning unit 202, and simultaneously, the data storage unit 203 sets stored standard data in advance and compares the received sensor data so as to conveniently judge whether the received data is normal, if the data is abnormal, a worker can issue a control instruction through the digital liquid crystal display device 5 (the form of issuing the instruction comprises clicking control through the digital liquid crystal display device 5 or calling the intelligent mouse interaction module 3), and the intelligent mouse control module 4 can issue the control instruction until the intelligent mouse is in a state corresponding to the intelligent mouse control equipment is further restored to the normal state.
Examples
In view of the above embodiment 1, further description is made, referring to fig. 6, the intelligent human-computer interaction module 3 includes a speech recognition unit 301, a text preprocessing unit 302, an intention recognition unit 303, and a dialogue generation unit 304, where the speech recognition unit 301 receives a speech input of a user and converts the speech input into a text form, the text preprocessing unit 302 performs preprocessing operations such as word segmentation, denoising, part-of-speech tagging, etc. on the converted text, the intention recognition unit 303 performs processing operations on the preprocessed text by a deep learning algorithm or a preset processing program, so as to recognize the intention of the user and perform active automatic control, and the dialogue generation unit 304 performs active dialogue on the text of the text preprocessing unit 302 and feeds back the result of the active automatic control, so that the user can learn the result of the processing;
The intention recognition unit 303 is integrated with a pre-trained deep neural network model 3031, such as BERT or Transformer architecture, to realize deeper semantic understanding and generalization capability, and the intention recognition unit 303 is also integrated with a context understanding unit 3032, which tracks and analyzes the dialogue history by using a Recurrent Neural Network (RNN) or a Long Short Term Memory (LSTM), so as to realize accurate response under continuous dialogue scene.
2. The intelligent man-machine interaction principle of the three-dimensional visual data analysis and display system is as follows:
When a worker issues a control instruction in the form of a voice call through the intelligent man-machine interaction module 3, firstly, voice is received by the voice recognition unit 301 and is converted into a voice text format by the text preprocessing unit 302, at the moment, the intention recognition unit 303 can recognize the generated text content and execute the instruction to issue, and then the dialog generation unit 304 feeds back the execution structure of the instruction, and because the intention recognition unit 303 executes processing operation on the preprocessed text through a deep learning algorithm or a preset processing program, the later-needed command can be actively distinguished in the running process to automatically issue the instruction, so that the intention of the user is recognized and active automatic control is performed, the intention of the worker can be issued without on-site control, and the intellectualization of the system running is improved.
Examples
In view of the foregoing embodiment 1 and embodiment 2, as further described with reference to fig. 7, the multi-user collaboration module 6 includes a real-time synchronization unit 601, a rights management and access control unit 602, a collaborative editing unit 603, and an interactive communication unit 604, where the real-time synchronization unit 601 enables a plurality of user terminals to be connected under the same local area network, so as to implement a technique of synchronizing real-time data and status, ensure that all participants view the same and up-to-date three-dimensional model view, edit operation, annotate, and discuss content in real time, and the rights management and access control unit 602 integrates a rights management system, and supports an administrator to allocate access rights of different levels such as view, edit, comment, and the like to different users, so as to ensure that data security and project management proceed orderly;
The collaborative editing unit 603 is internally integrated with an editing function area, allows multiple users to edit the same three-dimensional model at the same time, adopts a conflict detection and resolution algorithm, automatically or prompting the users to resolve editing conflicts, keeps consistency and integrity of model data, and the interactive communication unit 604 is internally integrated with a communication chat software function area 6041, provides text chat, voice conversation and video conference functions, provides a convenient instant communication means for the users, and promotes effective communication and coordination among team members.
3. The team cooperation principle of the three-dimensional visual data analysis and display system is as follows:
When the system needs to be updated according to the change of a factory in the later period, system team personnel and factory staff can be simultaneously connected with the same operation server 8 to enter the multi-user cooperation module 6, at the moment, the factory staff can open the authority management and access control unit 602 and the real-time synchronization unit 601 for online editing and updating of multiple people, and in the editing and updating process, the system team personnel and the factory staff communicate in real time by utilizing the same-platform interactive communication unit 604 of the system, so that the effect that the system technician can edit and communicate with the factory staff at the same time is achieved, the use requirement of the user can be met after the system is updated in the later period, and the process is convenient.
Examples
In view of the above embodiments 1, 2 and 3, referring to fig. 8, the immersive interactive data cabin system 10 includes a holographic projection module 1001, a haptic feedback module 1002, a data processing module 1003, an environment sensing module 1004 and an intelligent analysis module 1005, in which a plurality of holographic projection interface units 1011 are disposed inside the holographic projection module 1001, and the holographic projection interface units 1011 are connected with a holographic projection display device 1021 through network signals, a plurality of intelligent wearable device interface units 1012 are disposed inside the haptic feedback module 1002, and the intelligent wearable device interface units 1012 are connected with an intelligent wearable device 1022 through network signals, and a plurality of environment sensor interface units 1014 are disposed inside the environment sensing module 1004.
4. The immersive data interaction principle of the three-dimensional visual data analysis and display system is as follows:
After the basic data acquisition and processing system 9 completes initial data and scene model building, a user enters the immersive interactive data cabin system 10 through wearing the intelligent wearing equipment 1022, meanwhile, related data and model information are displayed on the holographic projection display equipment 1021 connected with the holographic projection module 1001, a sense of sounding to the user is given, then the user can make a viewing gesture or action through wearing the intelligent wearing equipment 1022, and an effect of viewing data is achieved through the internal tactile feedback module 1002, the data processing module 1003, the environment perception module 1004 and the intelligent analysis module 1005.
The above description is only of the preferred embodiments of the present invention; the scope of the invention is not limited in this respect. Any person skilled in the art, within the technical scope of the present disclosure, may apply to the present invention, and the technical solution and the improvement thereof are all covered by the protection scope of the present invention.
Claims (8)
1. The three-dimensional visual data analysis and display system comprises a basic data acquisition and processing system (9) and an immersive interactive data cabin system (10), and is characterized in that: the basic data acquisition and processing system (9) and the immersive interactive data cabin system (10) are operated through operation software in an operation server (8), and the basic data acquisition and processing system (9) and the immersive interactive data cabin system (10) are in an interactive data operation mode;
The basic data acquisition processing system (9) comprises a three-dimensional modeling module (1), a data acquisition and processing module (2), an intelligent man-machine interaction module (3), an intelligent switch control module (4) and a digital liquid crystal display device (5) which is in communication connection with an operation server (8), wherein the three-dimensional modeling module (1), the data acquisition and processing module (2), the intelligent man-machine interaction module (3), the intelligent switch control module (4) and the digital liquid crystal display device (5) are connected through network signals, the digital liquid crystal display device (5) is also connected with a multi-user cooperative module (6) and a compatible expansion module (7) through a network, and a plurality of digital liquid crystal display devices (5) are connected with the operation server (8) through network signals;
The intelligent human-computer interaction module (3) comprises a voice recognition unit (301), a text preprocessing unit (302), an intention recognition unit (303) and a dialogue generation unit (304), wherein the voice recognition unit (301) receives voice input of a user and converts the voice input into a text form, the text preprocessing unit (302) carries out preprocessing operations such as word segmentation, denoising, part-of-speech tagging and the like on the converted text, the intention recognition unit (303) carries out processing operations on the preprocessed text through a deep learning algorithm or a preset processing program to realize intention recognition of the user and active automatic control, and the dialogue generation unit (304) carries out active dialogue on the text of the text preprocessing unit (302) and feeds back the result of the active automatic control so that the user can know the processing result;
The immersion type interaction data cabin system (10) comprises a holographic projection module (1001), a touch feedback module (1002), a data processing module (1003), an environment sensing module (1004) and an intelligent analysis module (1005), wherein a plurality of holographic projection interface units (1011) are arranged inside the holographic projection module (1001), holographic projection display equipment (1021) is connected with holographic projection interface units (1011) through network signals, a plurality of intelligent wearing equipment interface units (1012) are arranged inside the touch feedback module (1002), intelligent wearing equipment interface units (1012) are connected with intelligent wearing equipment (1022) through network signals, and a plurality of environment sensor interface units (1014) are arranged inside the environment sensing module (1004).
2. The three-dimensional visual data analysis and display system of claim 1, wherein: the three-dimensional modeling module (1) comprises an image data acquisition unit (101), a geometric modeling unit (102) and an illumination and rendering unit (103), wherein the image data acquisition unit (101) is provided with a data transmission connection port of laser scanning, photographic shooting and measuring instruments, so that the acquired data can be conveniently uploaded, CAD, solidWorks, CATIA three-dimensional model modeling software is arranged in the geometric modeling unit (102) and used for building an ideal facility model, subunits used for setting the position, the intensity, the color and other attributes of a light source are arranged in the illumination and rendering unit (103), a vivid light effect is built, the stereoscopic impression and the sense of reality of the model built by the geometric modeling unit (102) are enhanced, and the display effect of a later three-dimensional scene is improved;
The data acquisition and processing module (2) comprises a sensor data acquisition unit (201), a data cleaning unit (202), a data storage unit (203) and a data processing and converting unit (204), wherein a sensor data transmission connection port is configured in the sensor data acquisition unit (201) to facilitate the reception of data captured by various sensors, the data cleaning unit (202) denoises the received data, processes missing values and abnormal values, corrects data inconsistency and ensures data quality, the data storage unit (203) designs, manages and stores the data processed by the data cleaning unit (202), the data storage unit (203) also stores preset standard data, facilitates the comparison with the data newly received in later operation so as to ensure the normal operation or emission of equipment monitored by the sensor, and the data processing and converting unit (204) applies algorithms or rules to calculate, aggregate, sort and filter the data so as to facilitate subsequent further operation or meet specific purpose.
3. The three-dimensional visual data analysis and display system of claim 1, wherein: the intention recognition unit (303) is integrated with a pre-trained deep neural network model (3031), such as a BERT or a transducer architecture, so as to realize deeper semantic understanding and generalization capability, and the intention recognition unit (303) is also integrated with a context understanding unit (3032) inside, so that a circulating neural network (RNN) or a long-short-term memory network (LSTM) is used for tracking and analyzing conversation histories, and accurate response under continuous conversation scenes is realized.
4. The three-dimensional visual data analysis and display system of claim 1, wherein: the multi-user collaboration module (6) comprises a real-time synchronization unit (601), a right management and access control unit (602), a collaboration editing unit (603) and an interactive communication unit (604), wherein the real-time synchronization unit (601) enables a plurality of user terminals to be connected under the same local area network, realizes the technology of real-time data and state synchronization, ensures that all participants view the same and latest three-dimensional model view, editing operation, annotation and discussion content in real time, the right management and access control unit (602) integrates a right management system, supports an administrator to allocate different levels of access rights such as viewing, editing, comment and the like for different users, and ensures orderly progress of data security and project management.
5. The three-dimensional visual data analysis and display system of claim 4, wherein: the collaborative editing unit (603) is internally integrated with an editing function area, allows multiple users to edit the same three-dimensional model at the same time, adopts a conflict detection and resolution algorithm to automatically or prompt the users to resolve editing conflicts and keep consistency and integrity of model data, and the interactive communication unit (604) is internally integrated with a communication chat software function area (6041) to provide text chat, voice communication and video conference functions, provide a convenient instant communication means for the users and promote effective communication and coordination among team members.
6. The three-dimensional visual data analysis and display system of claim 1, wherein: the compatible expansion module (7) is internally provided with an external data import port (701) which can carry out seamless butt joint on externally imported graphic data and sensing data, thereby being convenient for data import and export and subsequent upgrading and custom development of system functions.
7. The three-dimensional visual data analysis and display system of claim 2, wherein: the sensor data acquisition unit (201) is connected with a plurality of sensors through network signals of the access switch I, the sensors are respectively arranged on a plurality of different monitored devices, and the access switch I is connected with the digital liquid crystal display device (5) through network signals.
8. The three-dimensional visual data analysis and display system of claim 1, wherein: the intelligent switch control module (4) is connected with a plurality of intelligent control switches through a second network signal of the access switch, the intelligent control switches are respectively arranged on a plurality of different monitored devices, and the second network signal of the access switch is connected with the digital liquid crystal display device (5).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410858160.3A CN118394245B (en) | 2024-06-28 | 2024-06-28 | Three-dimensional visual data analysis and display system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410858160.3A CN118394245B (en) | 2024-06-28 | 2024-06-28 | Three-dimensional visual data analysis and display system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118394245A true CN118394245A (en) | 2024-07-26 |
| CN118394245B CN118394245B (en) | 2024-08-30 |
Family
ID=91985308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410858160.3A Active CN118394245B (en) | 2024-06-28 | 2024-06-28 | Three-dimensional visual data analysis and display system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118394245B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
| CN103760780A (en) * | 2014-02-17 | 2014-04-30 | 中国航空无线电电子研究所 | Universal simulation platform of cockpit display control system |
| CN108052250A (en) * | 2017-12-12 | 2018-05-18 | 北京光年无限科技有限公司 | Virtual idol deductive data processing method and system based on multi-modal interaction |
| CN109923512A (en) * | 2016-09-09 | 2019-06-21 | 上海海知智能科技有限公司 | The system and method for human-computer interaction |
| US20190391724A1 (en) * | 2014-12-18 | 2019-12-26 | Ultrahaptics IP Two Limited | User interface for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments |
-
2024
- 2024-06-28 CN CN202410858160.3A patent/CN118394245B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
| CN103760780A (en) * | 2014-02-17 | 2014-04-30 | 中国航空无线电电子研究所 | Universal simulation platform of cockpit display control system |
| US20190391724A1 (en) * | 2014-12-18 | 2019-12-26 | Ultrahaptics IP Two Limited | User interface for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments |
| CN109923512A (en) * | 2016-09-09 | 2019-06-21 | 上海海知智能科技有限公司 | The system and method for human-computer interaction |
| CN108052250A (en) * | 2017-12-12 | 2018-05-18 | 北京光年无限科技有限公司 | Virtual idol deductive data processing method and system based on multi-modal interaction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118394245B (en) | 2024-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108268128A (en) | A kind of safety in production emergency preplan 3DVR virtual reality drilling systems | |
| CN103092432A (en) | Trigger control method and system of man-machine interaction operating instruction and laser emission device | |
| CN111679740A (en) | Method for carrying out remote intelligent diagnosis on power station equipment by using Augmented Reality (AR) technology | |
| CN113240778B (en) | Method, device, electronic equipment and storage medium for generating virtual image | |
| CN108388711A (en) | A kind of engineering design based on BIM and management system | |
| CN115480923B (en) | Multi-mode intelligent classroom edge computing control system | |
| CN115933868A (en) | Three-dimensional comprehensive teaching field system of turnover platform and working method thereof | |
| CN114935916A (en) | Method for realizing industrial meta universe by using Internet of things and virtual reality technology | |
| WO2015008932A1 (en) | Digilog space creator for remote co-work in augmented reality and digilog space creation method using same | |
| CN114970177A (en) | Immersive ship dynamic simulation interactive system based on CAVE | |
| CN111429578B (en) | Three-dimensional model generation method and three-dimensional virtual overhaul system for thermal power plant unit | |
| CN118394245B (en) | Three-dimensional visual data analysis and display system | |
| CN111367221A (en) | Transformer substation intelligent operation inspection auxiliary system man-machine interaction method based on mixed reality technology | |
| CN114282021A (en) | Three-dimensional big data visualization system | |
| CN108388399A (en) | The method of state management and system of virtual idol | |
| CN113128716A (en) | Operation guidance interaction method and system | |
| CN115314684B (en) | Method, system and equipment for inspecting railroad bridge and readable storage medium | |
| CN117742261A (en) | Man-machine collaborative mixed decision intelligent assembly system based on XR | |
| CN111834021A (en) | Data interaction method, device, equipment and storage medium | |
| CN116563499A (en) | Intelligent interaction system of transformer substation based on meta-universe technology | |
| CN111660294B (en) | Augmented reality control system of hydraulic heavy-duty mechanical arm | |
| CN114004577A (en) | VR-based simulation training system for high-altitude operation of power transmission line | |
| CN113194140A (en) | Integrated remote monitoring system based on fire-fighting robot | |
| TWI845192B (en) | Operation assistant system | |
| CN112686990A (en) | Three-dimensional model display method and device, storage medium and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |