CN106095108B - A kind of augmented reality feedback method and equipment - Google Patents
A kind of augmented reality feedback method and equipment Download PDFInfo
- Publication number
- CN106095108B CN106095108B CN201610458015.1A CN201610458015A CN106095108B CN 106095108 B CN106095108 B CN 106095108B CN 201610458015 A CN201610458015 A CN 201610458015A CN 106095108 B CN106095108 B CN 106095108B
- Authority
- CN
- China
- Prior art keywords
- feedback
- status data
- device status
- augmented reality
- affiliated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of augmented reality feedback method and equipment, in this method, the device status data of physical equipment is obtained；According to preset rules and the device status data of the acquisition, augmented reality sensory feedback is carried out；Wherein, the augmented reality sensory feedback includes at least one of vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell enhancing feedback.Can be convenient user's quicklook through the invention knows equipment state.
Description
Technical field
The present invention relates to augmented reality fields more particularly to a kind of augmented reality (Augmented Reality, AR) to feed back
Method and apparatus.
Background technique
AR technology is a kind of technology by real world information and virtual world information Seamless integration-, is by sensing, counting
Calculate and the science and technology such as figure script is difficult in the certain time spatial dimension of real world the vision experienced, sound,
The entity informations such as taste and tactile are superimposed after analog simulation, again by virtual Information application to real world, by human sensory institute
Perception, to reach the sensory experience of exceeding reality.
Currently, being fed back at present using status informations such as augmented reality feedback device present position and failures
Device status information mainly passes through the machine vision exhibition method such as progress literal expression in the display interface and is fed back.Example
When such as failure excessively high using augmented reality feedback central processing unit (Central Processing Unit, CPU) temperature,
Usually temperature value information is directly superimposed upon on graphic interface and is shown, as shown in Figure 1.
In the mode of above-mentioned carry out equipment state feedback, by machine vision feedback device state, simple passes through text
Information is fed back, and can not make user's quicklook knows equipment state.
Summary of the invention
The embodiment of the present invention provides a kind of augmented reality feedback method and equipment, to facilitate knowing for user's quicklook to set
Standby state.
In a first aspect, providing a kind of augmented reality feedback method, preset in the method for device status data
The rule for carrying out augmented reality sensory feedback, after augmented reality equipment gets the device status data of physical equipment, according to pre-
If rule and the device status data of the acquisition, carry out augmented reality sensory feedback.The augmented reality sensory feedback can
Be in vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell enhancing feedback it is a kind of, be also possible to it is a variety of,
Therefore augmented reality equipment carries out augmented reality sensory feedback in the embodiment of the present invention, feedback system multiplicity is abundant, and can be based on
The device status data of acquisition carries out vivider feedback to equipment state, and can facilitate user's quicklook knows equipment shape
State.
It may include device status data type, device status data rank in the preset rules in the embodiment of the present invention
Corresponding relationship between augmented reality sensory feedback, the device status data type include but is not limited to temperature anomaly (temperature
Spend too high or too low), leak, electric leakage, pressure anomaly (hypertonia or too low), handling capacity be excessive, equipment suspension, packet loss mistake
It is big etc..The device status data rank generally comprises at least two ranks.Each rank of device status data is corresponding to fix
Augmented reality sensory feedback, different stage have different augmented reality sensory feedbacks.Each type and each rank
The augmented reality sensory feedback of the corresponding fixation of device status data can be vision enhancement feedback, tactile enhancing feedback, the sense of hearing
It is a kind of in enhancing feedback and smell enhancing feedback, it is also possible to a variety of.
Device status data described in the embodiment of the present invention includes but is not limited to throughput condition data, network connection state
Data, temperature-status data, moisture condition data, pressure state data and power state data.What augmented reality equipment obtained
Device status data can be one or more of devices listed above status data.
It, can be according to the device status data of the acquisition, really when carrying out augmented reality sensory feedback in the embodiment of the present invention
Surely the affiliated type of the device status data obtained and affiliated rank, and according to the determining affiliated type of device status data
And affiliated rank searches preset rules, determines and corresponds to the affiliated type of the device status data and affiliated rank obtained
Augmented reality sensory feedback, to the device status data of acquisition carry out the affiliated type of device status data of corresponding determination with
And the augmented reality sensory feedback of affiliated rank, different augmented reality sense organs is carried out to different device status datas to realize
Feedback.
The affiliated type of device status data and affiliated grade of the correspondence acquisition determined in the embodiment of the present invention
It is anti-that other augmented reality sensory feedback can be vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell enhancing
One of feedback, is also possible to a variety of.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include that vision enhancement is fed back in feedback, then can call and be matched belonging to the device status data of the determination from preset shape library
The vision enhancement of type and affiliated rank feeds back figure, is fed back by the vision enhancement that the calling is presented in image display device
Figure carries out vision enhancement feedback to the device status data of the acquisition, reaches from color, shape, transparency and physics
Phenomenon etc. carries out the effect of visual enhancement to device status data.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include that Augmented audio is fed back in feedback, then can call the device status data for matching the determination from preset sound library file
The sound sensation of affiliated type and affiliated rank enhancing feedback audio file, the audio text of the calling is played by audio frequency apparatus
Part carries out sound sensation enhancing feedback to the device status data of the acquisition, reaches with sound such as sound of the wind, the underwater sound, fiery sound to equipment
Status data carries out the effect of simulation enhancing.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
It include tactile enhancing feedback in feedback, then can control the temperature of heating equipment is to match belonging to the device status data of the determination
It is anti-to carry out tactile enhancing to the device status data of the acquisition for the temperature of the tactile of type and affiliated rank enhancing feedback
Feedback achievees the effect that carry out simulation enhancing to device status data by temperature sense of touch.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include smell enhancing feedback in feedback, then can control fragrance diffusion device to distribute belonging to the device status data for matching the determination
It is anti-to carry out smell enhancing to the device status data of the acquisition for the smell of the smell enhancing feedback of type and affiliated rank
Feedback achievees the effect that carry out simulation enhancing to device status data with smell.
Second aspect provides a kind of augmented reality feedback device, which, which has, realizes above-mentioned enhancing
The repertoire of real feedback method, the function can also execute corresponding software by hardware realization by hardware
It realizes.The hardware or software include one or more modules corresponding with above-mentioned function.The module can be software and/
Or hardware.
In a kind of possible design, the augmented reality feedback device may include acquiring unit and processing unit, described to obtain
Unit is taken, for obtaining the device status data of physical equipment；The processing unit, for according to preset rules and acquisition
The device status data carries out augmented reality sensory feedback.
In alternatively possible design, the augmented reality feedback device may include processor and communication interface, the place
Reason device is configured as that augmented reality feedback device is supported to execute corresponding function in the above method, and the communication interface is for supporting
Communication between augmented reality feedback device and physical equipment.Further, the augmented reality feedback device can also include
Memory, the memory save the necessary program instruction of augmented reality feedback device and data for coupling with processor.
In the embodiment of the present invention, the augmented reality feedback device may also include image display device, audio frequency apparatus, heating
One of equipment and fragrance diffusion device are a variety of.The determining equipment of the matching that described image display device is called for rendering
The vision enhancement of the affiliated type of status data and affiliated rank feeds back figure, carries out vision increasing to the device status data of acquisition
Strong feedback.The audio frequency apparatus is used to play the determining affiliated type of device status data and affiliated rank of the matching called
Sound sensation enhancing feedback audio file carries out sound sensation enhancing feedback to the device status data of acquisition.The heating equipment is for controlling
Temperature processed is the temperature of the tactile enhancing feedback of the determining affiliated type of device status data of matching and affiliated rank, to acquisition
Device status data carry out tactile enhancing feedback.The fragrance diffusion device is used to distribute the determining device status data of matching
The smell of the smell enhancing feedback of affiliated type and affiliated rank, carries out smell enhancing to the device status data of acquisition
Feedback.
The third aspect, the embodiment of the present invention also provide a kind of computer storage medium, for being stored as above-mentioned augmented reality
Computer software instructions used in feedback device, it includes share journey involved in equipment for executing above-mentioned aspect media file
Sequence.
Augmented reality feedback method and augmented reality feedback device provided in an embodiment of the present invention, increase equipment state
Strong reality sensory feedback, feedback system multiplicity is abundant, and can the device status data based on acquisition equipment state is carried out more
The feedback of image, facilitate user's quicklook knows equipment state.
Detailed description of the invention
Fig. 1 is the effect diagram of augmented reality feedback in the prior art；
Fig. 2 is the system construction drawing of augmented reality feedback method provided in an embodiment of the present invention application；
Fig. 3 be the present embodiments relate to physical equipment structural schematic diagram；
Fig. 4 be the present embodiments relate to augmented reality equipment structural schematic diagram；
Fig. 5 is a kind of implementation method flow figure of augmented reality feedback provided in an embodiment of the present invention；
Fig. 6 is a kind of implementation process schematic diagram provided in an embodiment of the present invention for obtaining device status data；
Fig. 7 is another implementation process schematic diagram provided in an embodiment of the present invention for obtaining device status data；
Fig. 8 is the implementation method flow figure provided in an embodiment of the present invention that augmented reality feedback is carried out according to preset rules；
Fig. 9 is the implementation method flow figure provided in an embodiment of the present invention for carrying out vision enhancement feedback；
Figure 10 is a kind of effect picture of augmented reality sensory feedback provided in an embodiment of the present invention；
Figure 11 is another effect picture of augmented reality sensory feedback provided in an embodiment of the present invention；
Figure 12 is another effect picture of augmented reality sensory feedback provided in an embodiment of the present invention；
Figure 13 A to Figure 13 D is the structural schematic diagram of augmented reality sensory feedback equipment provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical solution in the embodiment of the present invention is described.
The network architecture and business scenario of description of the embodiment of the present invention are to more clearly illustrate implementation of the present invention
The technical solution of example, does not constitute the restriction for technical solution provided in an embodiment of the present invention, those of ordinary skill in the art
It is found that technical solution provided in an embodiment of the present invention is for similar with the differentiation of the network architecture and the appearance of new business scene
The technical issues of, it is equally applicable.
Fig. 2 show the system construction drawing of augmented reality feedback method application provided in an embodiment of the present invention.In Fig. 2, object
Reason equipment is the equipment that user needs to detect operating status, and the augmented reality equipment that user wears is mainly used for realizing augmented reality
Function and detection function.Data association is carried out by network between physical equipment and augmented reality equipment.Augmented reality feedback
It further include having system server (Fig. 2 is not shown) in the system structure of method application, the system server is for collecting and handling
Data caused by physical equipment, and data are sent to augmented reality equipment by treated.
The embodiment of the present invention hereinafter, will be realized to the technology of the present invention in the physical equipment that is applied to and augmented reality equipment into
Row illustrates respectively:
Physical equipment:
The equipment that physical equipment in the embodiment of the present invention is primarily referred to as operating status to be detected, in laboratory or data
The interchanger, router, cabinet etc. in face at heart.Fig. 3 show the present embodiments relate to physical equipment structural schematic diagram, such as
Shown in Fig. 3, the physical equipment can functionally be divided into sensor data acquisition modules A 100, processing module A201, communication
Modules A 301 and Object Identification Module A401.Sensor data acquisition modules A 100 can detect measured in the embodiment of the present invention
Information, and the information that can be will test is for conversion into electric signal or the information output of other required forms according to certain rules, with
Meet the requirement such as transmission, processing, storage, display, record and control of information.Sensor data acquisition modules A 100 is mainly by hard
Part data acquisition module A110 and software data acquisition module A120 composition.Hardware data acquisition module A110 is by multiple sensors
Composition, including but not limited to temperature sensor A111, pressure sensor A112, humidity sensor A113, audio sensor A115
It is formed, the main physical features for acquiring physical equipment include but is not limited to temperature, pressure, humidity and sound, and e.g., temperature passes
Sensor A111 can be used for whether detecting devices temperature is higher or lower than preset threshold, and pressure sensor A112 is for detecting devices
Whether pressure value is higher or lower than preset threshold, equipment leak.Software data acquisition module A120 includes but is not limited to data packet
Acquisition module A121 and variable-frequency power sensor A122, the data transmission characteristics of the main software module for acquiring physical equipment, example
Such as, main to pass through software realization detection including but not limited to data throughout, network connection status, packet loss, power etc..This hair
Processing module A201 is sent out for receiving from hardware data acquisition module A110 and software data acquisition module A120 in bright embodiment
The device data brought, and data are analyzed and handled by multisensor Data Fusion technology, according to fixed in advance
Device status data needed for user is sent to augmented reality equipment by the rule of justice.Processing module A201 can also be existing according to enhancing
Real device directive is transferred, and is issued, and is updated or newdata and is saved.Honeycomb can be used in communication module A301, and Ethernet is wireless to protect
Very (Wireless Fidelity, wifi), bluetooth, infrared equal communication modes receive the command information that other equipment are sent, can also
The data of physical equipment are sent to cloud or other equipment.Object Identification Module A401, may include physical tag, can
See optical signature or non-visible signature, closely identify physical equipment for augmented reality equipment,.It, can in some embodiments
Object Identification Module A401 to be arranged on the surface of physical equipment, the physics paster mark of two dimensional code or bar code is such as printed
Label, set every physics using radio frequency identification (Radio Frequency Identification, RFID) radio-frequency unit
It is standby to carry out digital mark, to distinguish different physical equipments.
Augmented reality equipment:
Augmented reality equipment involved in the embodiment of the present invention can be set in wearable intelligent equipment, wearable intelligent
Equipment is the general name for the equipment that can be dressed for carrying out intelligentized design to daily wearing using wearable technology and developing,
Such as glasses, gloves, wrist-watch, dress ornament and shoes.The augmented reality equipment can be wear-type augmented reality equipment (Head-
Mounted displays, HMD), by head-mounted display, NI Vision Builder for Automated Inspection, these three components of mobile computer are integrated into
It in one unit, is placed in the equipment bound with belt, the head of user is worn over by way of wearing, which can incite somebody to action
The information of augmented reality class is transmitted on the display similar to common spectacles or is projected to be shown in the eyeball of user, is used
To enhance the visual immersion of user.
Fig. 4 show the present embodiments relate to augmented reality equipment structural schematic diagram, as shown in figure 4, of the invention
The augmented reality equipment that embodiment is related to includes sense organ enhancing module C100 on the basis of existing augmented reality module C200.
The equipment state number that sense organ enhancing module C100 is used to handle sensor data acquisition modules A 100 and processing module A201 is sent
According to, and the augmented reality sensory feedback of more sense organ dimensions is carried out according to device status data of the preset rules to the acquisition,
In, the augmented reality sensory feedback includes that vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell enhancing are anti-
At least one of feedback.As shown in figure 4, sense organ enhancing module C100 may include vision enhancement module C101, Augmented audio module
C102, tactile enhancing module C103 and smell enhance module C104.Wherein, vision enhancement module C101 is by vision enhancement application journey
Sequence software and shape library are formed, and the device status data and preset rules for being sent according to physical equipment are called corresponding
Figure achievees the effect that carry out visual enhancement to device status data from color, shape, transparency and physical phenomenon etc..
Augmented audio module C102 is formed by Augmented audio application software and such as existing audio frequency apparatuses such as earpiece, loudspeakers,
Device status data and preset rules for being sent according to physical equipment call corresponding sound library file, reach and use wind
The sound such as sound, the underwater sound, fiery sound carry out the effect of simulation enhancing to device status data.Tactile enhancing module C103 is enhanced by tactile
Application software and heating equipment composition, heating equipment are usually the device being made of heating element and attachment, are used for root
According to device status data and preset rules that physical equipment is sent, heating equipment is controlled by software module and carries out temperature control
System achievees the effect that carry out simulation enhancing to device status data by temperature sense of touch.Smell enhances module C104 by that can dissipate
Get angry taste fragrance diffusion device composition, device status data and preset rules for being sent according to physical equipment, control
Fragrance diffusion device discharges corresponding smell, achievees the effect that carry out simulation enhancing to device status data with smell.
As shown in figure 4, existing augmented reality module C200 include machine vision module C201, image display C202,
Communication module C203, communication port C204, processing module C205 and acquisition module C206.Wherein, machine vision module C201 packet
It including and is not limited by machine vision image-pickup device, depth information capturing apparatus will be ingested target and be converted into picture signal,
It sends graphics computer system to, obtains the shape information of target subject, according to the information such as pixel distribution and brightness, color, turn
Become digitized signal；Picture system carries out various operations to these signals to extract clarification of objective, and then according to differentiation
As a result all kinds of instructions are generated, machine vision module C201 is mainly used for the physics that identification is broken down in embodiments of the present invention
Equipment.Image display C202 includes the display device of all kinds of achievable augmented reality functions, such as liquid crystal display, infrared light
Shadow grenade instrumentation.More specifically, the penetration projection display screen as used in head-mounted display apparatus based on optical principle with
And the display device of the transmissive display technology based on Video Composition technology.Image display in embodiments of the present invention
C202, the image information mainly issued vision enhancement module C101 is presented, and the operation knot of Real-time Feedback user's operation
Fruit.Communication module C203, usable honeycomb, Ethernet, wifi, bluetooth, infrared equal communication modes receive what other equipment were sent
Command information, while the data of augmented reality equipment can also be sent to cloud or other equipment.Communication port C204 makes
With transmission control protocol (Transmission Control Protocol, TCP)/Internet Protocol (Internet
Protocol, IP) standard agreement as network communication, so that augmented reality equipment is had individual IP address, for obtaining
The device status data sended over from network.Processing module C205 is used to control each section hardware device of augmented reality equipment
With application software etc., it is mainly used for receiving the data sended over from sense organ enhancing module C100 in the embodiment of the present invention,
Image display C202 is issued to after being handled in conjunction with the machine vision module C201 data fed back.Acquisition module
C206, is used primarily for camera, and the sensor devices such as microphone acquire the data such as audio-video, pass through camera, infrared biography
The gesture of the acquisition user such as sensor, touch screen.
Technology involved in realizing to the technology of the present invention below the embodiment of the present invention is illustrated respectively.
Machine vision technique:
Machine vision is exactly to replace human eye with machine to measure and judge.NI Vision Builder for Automated Inspection, which refers to, passes through machine vision
Product (image-pickup device) will be ingested target and be converted into picture signal, send dedicated image processing system to, obtain by
The shape information for taking the photograph target is transformed into digitized signal according to the information such as pixel distribution and brightness, color；Picture system is to this
A little signals carry out various operations to extract clarification of objective, and then the device action at scene is controlled according to the result of differentiation.Machine
The characteristics of device vision system is the flexibility and the degree of automation for improving production.In some dangerous works for being not suitable for manual work
Environment or artificial vision are difficult in the occasion met the requirements, substitute artificial vision commonly using machine vision.
Image superposition display technology:
Image superposition shows to be real-time operation ability by computer, makes figure, attribute pre-generated and store,
Feature etc. is called and is superimposed on a fundamental figure or process or method on real-world object, in embodiments of the present invention, main
To apply its ability by prefabricated Graphics overlay on real-world object.
Multisensor Data Fusion technology:
Fusion may be summarized to be the multiple similar or inhomogeneity sensor institute for being distributed in different location
Local data's resource of offer is integrated, and is analyzed it using computer technology, and eliminating can between multi-sensor information
Redundancy and contradiction existing for energy, are subject to complementation, reduce its not certainty, and the consistency for obtaining measurand is explained and description, from
And the rapidity and correctness of the system decision-making, planning, reaction are improved, so that system is obtained more fully information.
Hereinafter, by the present embodiments relate to augmented reality feedback method be described in detail.
Fig. 5 show the method flow that augmented reality feedback device provided in an embodiment of the present invention carries out augmented reality feedback
Figure, wherein the augmented reality feedback device can be augmented reality equipment.In Fig. 5 with augmented reality feedback device be enhancing
It is illustrated for real world devices, as shown in figure 5, augmented reality feedback method provided in an embodiment of the present invention includes:
S101: the device status data of augmented reality equipment acquisition physical equipment.
Device status data described in the embodiment of the present invention includes but is not limited to throughput condition data, network connection state
Data, temperature-status data, moisture condition data, pressure state data and power state data.What augmented reality equipment obtained
Device status data can be one or more of devices listed above status data.
S102: augmented reality equipment carries out augmented reality according to preset rules and the device status data of the acquisition
Sensory feedback.
In the embodiment of the present invention, the rule that augmented reality sensory feedback is carried out for device status data can be preset,
It include pair between device status data type, device status data rank and augmented reality sensory feedback in the preset rules
It should be related to.
In the embodiment of the present invention, device status data type include but is not limited to temperature anomaly (too high or too low for temperature),
Leak, electric leakage, pressure anomaly (hypertonia or too low), handling capacity be excessive, equipment suspension, packet loss are excessive etc..
In the embodiment of the present invention, device status data rank generally comprises at least two ranks, certainly can be according to practical feelings
Condition divides the affiliated rank of equipment state, such as the affiliated rank of the device status data includes low level and two kinds high-level,
It may include low level, middle rank and three kinds high-level, can also include low level, middle rank, high-level, emergency level and tight
Other five kinds of heavy duty.
In the embodiment of the present invention, augmented reality sensory feedback can be vision enhancement feedback, tactile enhancing feedback, sense of hearing increasing
It is a kind of in strong feedback and smell enhancing feedback, it is also possible to a variety of.Each augmented reality sensory feedback in the embodiment of the present invention
Figure, sound, sense of touch and the smell presented is the form for meeting equipment state and being presented on real physical world, such as
The vision enhancement feedback that temperature-status data is carried out, it may include issue feux rouges, give off sparks, flow out lava, to state of temperature
Data carry out Augmented audio feedback include beep, crack spark sound, to leak status data carry out Augmented audio
Feedback includes issuing stream sound, waterfall sound, sound of sea wave etc..
It include device status data type, device status data rank and augmented reality sensory feedback in the embodiment of the present invention
Between the preset rules of corresponding relationship can be as shown in table 1:
Table 1
As shown in Table 1, in the embodiment of the present invention, the corresponding fixed augmented reality sense organ of each rank of device status data
Feedback, the augmented reality sensory feedback of the corresponding fixation of the device status data of each type and each rank can be view
Feel a kind of in enhancing feedback, tactile enhancing feedback, Augmented audio feedback and smell enhancing feedback, is also possible to a variety of.
As shown in Table 1, when carrying out augmented reality sensory feedback in the embodiment of the present invention, the figure of augmented reality sensory feedback
Shape, sound, sense of touch and smell different stage have different feedback forms, for example, in the excessively high situation of state of temperature, from low level
Feed back to high-level corresponding different vision enhancements is to issue feux rouges, give off sparks, flow out lava, audio feedback.Leak state
It frightens, to be clipped to high-level corresponding different sense of hearing sensory feedbacks be to issue stream sound, waterfall sound, sound of sea wave etc. from rudimentary.
It should be noted that when carrying out augmented reality sensory feedback in the embodiment of the present invention, augmented reality sensory feedback institute
Figure, sound, sense of touch and the smell of feedback can be the actual physical phenomenon exaggeration than situation of physical equipment, to be easier to draw
Rise user's note that improve user positioning failure efficiency, for example, by taking temperature is excessively high as an example, physical equipment actual conditions are
It is not on fire, but the figure of augmented reality sensory feedback, sound, sense of touch and smell can be corresponding physical phenomenon on fire.
In the embodiment of the present invention, each device status data type corresponds at least two ranks of device status data, if
The corresponding fixed augmented reality sensory feedback of each rank of standby status data, carries out different device status datas with realizing
Different augmented reality sensory feedbacks.
Augmented reality equipment is fed back by vision enhancement feedback, tactile enhancing feedback, Augmented audio in the embodiment of the present invention
It is enriched with progress augmented reality sensory feedback, feedback system multiplicity such as smell enhancing feedbacks, and can be based on the equipment shape of acquisition
State data carry out vivider feedback to equipment state, and can facilitate user's quicklook knows equipment state.
In general, augmented reality feedback device is used to feed back the abnormal operating condition of physical equipment, therefore in the embodiment of the present invention
The device status data of the acquisition can be the device status data of reflection equipment running status exception.Wherein, equipment is run
Abnormal state includes but is not limited to temperature anomaly, leak, electric leakage and suspension etc..
In the embodiment of the present invention, the device status data that augmented reality equipment obtains physical equipment be can be used such as under type:
In a kind of possible embodiment, the operating status of itself is identified by physical equipment, and the physics recognized is set
The device status data of received shipment row abnormal state is sent to augmented reality equipment by network, and augmented reality equipment can pass through network
Obtain physical equipment send device status data, specific implementation process is seen shown in Fig. 6, in Fig. 6, physical equipment it is hard
The device status data of part data acquisition module A110 and software data acquisition module A120 acquisition physical equipment, and it is sent to object
Manage the processing module A201 of equipment.Wherein, the device status data of hardware data acquisition module A110 acquisition may include temperature
Status data, smell status data, ambient humidity status data etc..The equipment state number of software data acquisition module A120 acquisition
According to may include throughput condition data, network connection state data, packet loss status data etc..Processing module A201 receives hard
After the device status data that part data acquisition module A110 and software data acquisition module A120 is sent, pass through multi-sensor data
Integration technology judges whether the device status data is the device status data for reflecting equipment running status exception, if so,
The device status data is sent to the processing module C205 of augmented reality equipment by the processing module A201 of physical equipment.If
No, then the processing module of physical equipment is not processed, and continues to hardware data acquisition module A110 and software data acquisition mould
The device status data that block A120 is sent.After the processing module C205 of augmented reality equipment receives the device status data,
The sense organ that the device status data is sent to augmented reality equipment is enhanced into module C100, is increased by the sense organ of augmented reality equipment
Strong module C100 carries out augmented reality sensory feedback according to preset rules, and by the image display C202 of augmented reality equipment
The effect of augmented reality sensory feedback is presented.
In alternatively possible embodiment, network environment can not also be passed through, but by augmented reality equipment Direct Recognition
The operating status of physical equipment simultaneously obtains device status data, and implementation process schematic diagram is seen shown in Fig. 7.Reality shown in Fig. 7
During now, augmented reality equipment realizes that the treatment process of augmented reality sensory feedback is similar with treatment process shown in fig. 6,
This is repeated no more.
In the embodiment of the present invention, augmented reality equipment is carried out according to preset rules and the device status data of the acquisition
Implementation as shown in Figure 8 can be used in augmented reality sensory feedback, as shown in Figure 8, comprising:
S1021: according to the device status data of the acquisition, determine the affiliated type of the device status data of the acquisition with
And affiliated rank.
S1022: preset rules are searched according to the affiliated type of the device status data of the determination and affiliated rank, are determined
The affiliated type of device status data of the corresponding acquisition and the augmented reality sensory feedback of affiliated rank.
S1023: correspond to the device status data of the acquisition the affiliated type of device status data of the determination
And the augmented reality sensory feedback of affiliated rank.
The embodiment of the present invention, the affiliated type of device status data of the correspondence acquisition determined in S1022 and
The augmented reality sensory feedback of affiliated rank can be vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell
One of enhancing feedback, is also possible to a variety of.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include that vision enhancement is fed back in feedback, then can call and be matched belonging to the device status data of the determination from preset shape library
The vision enhancement of type and affiliated rank feeds back figure, is fed back by the vision enhancement that the calling is presented in image display device
Figure carries out vision enhancement feedback to the device status data of the acquisition.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include that Augmented audio is fed back in feedback, then can call the device status data for matching the determination from preset sound library file
The sound sensation of affiliated type and affiliated rank enhancing feedback audio file, the audio text of the calling is played by audio frequency apparatus
Part carries out sound sensation enhancing feedback to the device status data of the acquisition.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
It include tactile enhancing feedback in feedback, then can control the temperature of heating equipment is to match belonging to the device status data of the determination
It is anti-to carry out tactile enhancing to the device status data of the acquisition for the temperature of the tactile of type and affiliated rank enhancing feedback
Feedback.
If it is determined that the correspondence acquisition the affiliated type of device status data and affiliated rank augmented reality sense organ
Include smell enhancing feedback in feedback, then can control fragrance diffusion device to distribute belonging to the device status data for matching the determination
It is anti-to carry out smell enhancing to the device status data of the acquisition for the smell of the smell enhancing feedback of type and affiliated rank
Feedback.
The augmented reality sensory feedback that the embodiment of the present invention is related to above-described embodiment below in conjunction with practical application it is specific
Realization process is illustrated.
The embodiment of the present invention is illustrated for carrying out vision enhancement feedback.
Fig. 9 show a kind of implementation flow chart that the embodiment of the present invention realizes vision enhancement feedback, as shown in Figure 9, comprising:
S201: the processing module C205 of augmented reality equipment obtains the device status data of physical equipment, and identifies equipment
The affiliated type of status data and affiliated rank.
The reflection equipment running status that can be will identify that by the processing module A201 of physical equipment in the embodiment of the present invention is different
Normal device status data is sent to system server, and device status data is sent to augmented reality by system server and is set
Standby processing module C205.
The processing module C205 of augmented reality equipment is identified belonging to the device status data of acquisition in the embodiment of the present invention
It include that vision enhancement is fed back in corresponding augmented reality sensory feedback in type and affiliated rank, then to augmented reality equipment
Vision enhancement module C101 sends the command information for carrying out vision enhancement feedback.For example, the device status data is temperature shape
State data, the device status data type that the processing module C205 of augmented reality equipment is identified are that temperature is excessively high, equipment state
Data-level is medium rank, then can be by inquiring preset rules (such as table 1), and determination needs to carry out vision enhancement feedback.
S202: the processing module C205 of augmented reality equipment is according to the affiliated type of the device status data identified and institute
Belong to rank, sends the command information for carrying out vision enhancement feedback to corresponding vision enhancement module C101.
S203: vision enhancement module C101 feeds back according to vision enhancement corresponding in preset rules, calls from shape library
Corresponding vision enhancement feeds back graph data, and the vision enhancement of calling feedback graph data is sent to processing module C205.
After S204: processing module C205 receives the vision enhancement feedback figure that vision enhancement module C101 is sent, to machine
Vision module C201 sends the instruction information of the Object Identification Module A401 of identification physical equipment.
S205: if machine vision module C201 recognizes the Object Identification Module A401 of physical equipment, processing module
C205 by the vision enhancement feed back figure and Object Identification Module A401 identification physical equipment mark (such as characterization position
Information) it is sent to image display C202.If the unidentified Object identifying mould to physical equipment of machine vision module C201
Block A401, then vision enhancement feedback figure is sent to image display C202 by processing module C205.
S206: image display C202, which is presented the vision enhancement, feeds back figure.
In the embodiment of the present invention, image display C202 carries out the processing of color, shape and transparency to display figure,
To form the display figure of the corresponding vision enhancement feedback figure.
Further, if image display C202 receives Object Identification Module A401 identification in the embodiment of the present invention
Physical equipment mark is then presented the vision enhancement at the position of physical equipment mark and feeds back figure.
The implementation of Augmented audio feedback, tactile enhancing feedback and smell enhancing feedback is realized in the embodiment of the present invention
Journey, similar with the process for realizing vision enhancement feedback, difference, which is that, specifically carries out applied equipment when enhancing is fed back
Difference, such as when realization Augmented audio feedback, need to call sound sensation enhancing feedback audio file from sound library file, and pass through
The audio frequency apparatuses such as existing earpiece and loudspeaker play the audio file of the calling, for another example realizing that tactile enhancing is anti-
When feedback, without calling file, but feedback is enhanced by the Temperature Matching tactile of control heating equipment, it is anti-to carry out tactile enhancing
Feedback.When realizing smell enhancing feedback, without calling file, but by control fragrance diffusion device giving forth fragrance, smelt
Feel enhancing feedback.
Device therefor when augmented reality feedback is carried out in the embodiment of the present invention, it can be real if being equipped in augmented reality equipment
The equipment of existing corresponding function, then using the existing equipment having been provided with, such as when progress sound sensation enhancing feedback, existing have been equipped with is listened
Cylinder then carries out sound broadcasting using existing earpiece.If the equipment for being not equipped with corresponding function in augmented reality equipment can increase newly
Equipment with corresponding function, such as when progress tactile enhancing feedback, the equipment that resistance wire etc. can generate heat can be increased newly, into
Row touch feedback.
Augmented reality equipment carries out carrying out augmented reality sense organ to the device status data got in the embodiment of the present invention
Feedback may include the sensory feedback of various dimensions, such as temperature-status data, can be with when carrying out augmented reality sensory feedback
The vision enhancement feedback shown including progress flame as shown in Figure 10 can also include beeping or crack spark sound
Sound sensation enhance feedback.In another example may include such as Figure 11 institute when carrying out augmented reality sensory feedback for leak status data
The vision enhancement feedback that the flowing water effect shown is shown, can also include the sound sensation enhancing feedback of flowing water sound effect, and the sound sensation increases
Strong feedback can also have a different sound effects such as brook, waterfall, sea according to the affiliated rank of leak status data, or can be with
According to the sound effect of the different volumes of the distance between user and physical equipment embodiment, (the remote then sound of distance is small, the nearly then sound of distance
Greatly).It may include display as shown in figure 12 when carrying out augmented reality sensory feedback again for example for throughput condition data
Device shaped is too fat to move and color becomes pale display effect, can also include the sound sensation enhancing feedback for issuing buzz.
It should be noted that effect picture shown in Figure 10, Figure 11 and Figure 12 of the embodiment of the present invention is only schematically to be said
It is bright, do not regard it as and be limited, such as Figure 10, can be presented not according to the rank of temperature-status data in the embodiment of the present invention
With vision enhancement feed back figure, such as spark performance is presented when lower rank, when higher level is presented lava and the figures such as sprays.
Augmented reality equipment is fed back by vision enhancement feedback, tactile enhancing feedback, Augmented audio in the embodiment of the present invention
It is enriched with progress augmented reality sensory feedback, feedback system multiplicity such as smell enhancing feedbacks, and can be based on the equipment shape of acquisition
State data carry out vivider feedback to equipment state, and facilitate user's quicklook knows equipment state.
It is above-mentioned that mainly augmented reality feedback method provided in an embodiment of the present invention is described.It is understood that
The each corresponding hardware knot of function of execution is contained for realizing the augmented reality feedback device of above-mentioned augmented reality feedback method
Structure and/or software module.In conjunction with disclosed in this invention embodiment describe each exemplary unit and algorithm steps, the present invention
Embodiment can be realized with the combining form of hardware or hardware and computer software.Some function is still calculated with hardware actually
The mode of machine software-driven hardware executes, specific application and design constraint depending on technical solution.Art technology
Personnel can realize described function to each specific application using different methods, but this realization should not be recognized
For the range of the technical solution beyond the embodiment of the present invention.
The embodiment of the present invention can be according to above method example to the augmented reality for realizing above-mentioned augmented reality feedback method
Feedback device carries out the division of functional unit, for example, each functional unit of each function division can be corresponded to, it can also be by two
Or more than two functions are integrated in a processing unit.Above-mentioned integrated unit both can take the form of hardware realization,
It can also realize in the form of software functional units.It should be noted that being to show to the division of unit in the embodiment of the present invention
Meaning property, only a kind of logical function partition, there may be another division manner in actual implementation.
Using integrated unit, Figure 13 A shows a kind of possible enhancing provided in an embodiment of the present invention
The structural schematic diagram of real feedback device.Augmented reality feedback device 100 provided in an embodiment of the present invention includes acquiring unit 101
With processing unit 102, wherein the acquiring unit 101 is used to obtain the device status data of physical equipment.The processing unit
102, for the device status data according to preset rules and acquisition, carry out augmented reality sensory feedback, for example, described
Processing unit 102 is for supporting the augmented reality feedback device to execute the process S1021 in process S102, Fig. 8 in Fig. 2 extremely
Process S1023, and/or other processes for techniques described herein.
Wherein, processing unit 102 can be processor or controller, such as can be central processing unit (Central
Processing Unit, CPU), general processor, digital signal processor (Digital Signal Processor, DSP),
Specific integrated circuit (Application-Specific Integrated Circuit, ASIC), field programmable gate array
It is (Field Programmable Gate Array, FPGA) or other programmable logic device, transistor logic, hard
Part component or any combination thereof.It may be implemented or execute to combine and various illustratively patrol described in the disclosure of invention
Collect box, module and circuit.The processor is also possible to realize the combination of computing function, such as includes one or more micro- places
Manage device combination, DSP and the combination of microprocessor etc..Acquiring unit 101 can be communication interface, transceiver, transmission circuit etc.,
Wherein, communication interface is to be referred to as, and may include one or more interfaces.
The augmented reality feedback device may also include storage unit 103, for storing the augmented reality feedback device
100 program code and data, as shown in Figure 13 B.
In specific implementation process, the augmented reality feedback device 100 may also include image display device 104, audio is set
Standby 105, one of heating equipment 106 and fragrance diffusion device 107 or a variety of.Figure 13 C is increasing provided in an embodiment of the present invention
Strong reality feedback device 100 includes that above-mentioned image display device 104, audio frequency apparatus 105, heating equipment 106 and odor dispersion are set
Standby 107 structural schematic diagram.
Wherein, the corresponding affiliated type of device status data and affiliated rank obtained that the processing unit 102 determines
Augmented reality sensory feedback in include vision enhancement feedback under, the processing unit 102 can be from preset shape library
The vision enhancement of the affiliated type of device status data and affiliated rank of calling matching determining feeds back figure, passes through described image
Display device 104 is presented the vision enhancement called and feeds back figure, carries out vision increasing to the device status data of acquisition
Strong feedback.
The enhancing for the corresponding affiliated type of device status data and affiliated rank obtained that the processing unit 102 determines
It include under Augmented audio feedback in real sensory feedback, the processing unit 102 can be adjusted from preset sound library file
With the sound sensation enhancing feedback audio file of the determining affiliated type of device status data of matching and affiliated rank, pass through the sound
Frequency equipment 105 plays the audio file called, carries out sound sensation enhancing feedback to the device status data of acquisition.
The enhancing for the corresponding affiliated type of device status data and affiliated rank obtained that the processing unit 102 determines
In the case where in real sensory feedback including tactile enhancing feedback, the processing unit 102 can control the heating equipment 106
Temperature be the determining affiliated type of device status data of matching and affiliated rank tactile enhancing feedback temperature, to acquisition
The device status data carry out tactile enhancing feedback.
What the processing unit 102 determined corresponds to the affiliated type of the device status data and affiliated rank obtained
In the case where in augmented reality sensory feedback including smell enhancing feedback, the processing unit 102 can control the odor dispersion
Equipment 107 distributes the smell of the smell enhancing feedback of the determining affiliated type of device status data of matching and affiliated rank, right
The device status data obtained carries out smell enhancing feedback.
When the above-mentioned integrated unit of the embodiment of the present invention uses formal implementation of hardware, processing unit 102 is processor, is obtained
Taking unit 101 is communication interface, and the storage unit 103 is memory, the feedback of augmented reality involved in the embodiment of the present invention
Equipment can be augmented reality feedback device shown in Figure 13 D.
Refering to fig. 1 shown in 3D, which includes: processor 1001, communication interface 1002, storage
Device 1003.Optionally, augmented reality feedback device 1000 can also include bus 1004.Wherein, communication interface 1002, processor
1001 and memory 1003 can be connected with each other by bus 1004；Bus 1004 can be Peripheral Component Interconnect standard
(Peripheral Component Interconnect, abbreviation PCI) bus or expanding the industrial standard structure (Extended
Industry Standard Architecture, abbreviation EISA) bus etc..The bus 1004 can be divided into address bus,
Data/address bus, control bus etc..Only to be indicated with a thick line in Figure 13 C, it is not intended that an only bus convenient for indicating
Or a type of bus.
Augmented reality feedback device described in the embodiment of the present invention can be augmented reality involved in above-described embodiment and set
Standby, functional for realizing the institute of augmented reality feedback method involved in above method embodiment, specific implementation process can
With the associated description referring to above method embodiment, details are not described herein again.
The embodiment of the present invention also provides a kind of computer storage medium, for being stored as above-mentioned augmented reality feedback device institute
Computer software instructions, it includes for executing program involved in above-mentioned aspect augmented reality feedback device.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
Claims (12)
1. a kind of augmented reality feedback method, which is characterized in that the described method includes:
Obtain the device status data of physical equipment；
According to preset rules and the device status data of acquisition, augmented reality sensory feedback is carried out；
Wherein, the augmented reality sensory feedback includes vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell
At least one of enhancing feedback；
It is described according to preset rules and the device status data of acquisition, carry out augmented reality sensory feedback, comprising:
According to the device status data of the acquisition, the affiliated type of the device status data and affiliated grade obtained is determined
Not；
Preset rules are searched according to the determining affiliated type of device status data and affiliated rank, determine the described of corresponding acquisition
The augmented reality sensory feedback of the affiliated type of device status data and affiliated rank includes equipment state in the preset rules
Corresponding relationship between data type, device status data rank and augmented reality sensory feedback, wherein each equipment state number
At least two ranks of device status data, the corresponding fixed augmented reality of each rank of device status data are corresponded to according to type
Sensory feedback；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback.
2. the method as described in claim 1, which is characterized in that the corresponding affiliated type of device status data obtained determined with
It and include vision enhancement feedback in the augmented reality sensory feedback of affiliated rank；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback, comprising:
The vision enhancement of the affiliated type of device status data and affiliated rank of calling matching determining from preset shape library
Feed back figure；
The vision enhancement called is presented by image display device and feeds back figure, to the device status data of acquisition into
Row vision enhancement feedback.
3. the method as described in claim 1, which is characterized in that the corresponding affiliated type of device status data obtained determined with
It and include Augmented audio feedback in the augmented reality sensory feedback of affiliated rank；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback, comprising:
The sound sensation of the affiliated type of device status data and affiliated rank of calling matching determining from preset sound library file
Enhancing feedback audio file；
The audio file called is played by audio frequency apparatus, it is anti-to carry out sound sensation enhancing to the device status data of acquisition
Feedback.
4. the method as described in claim 1, which is characterized in that the corresponding affiliated type of device status data obtained determined with
It and include tactile enhancing feedback in the augmented reality sensory feedback of affiliated rank；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback, comprising:
The temperature of control heating equipment is the tactile enhancing of the determining affiliated type of device status data of matching and affiliated rank
The temperature of feedback carries out tactile enhancing feedback to the device status data of acquisition.
5. the method as described in claim 1, which is characterized in that the corresponding affiliated class of the device status data obtained determined
It include smell enhancing feedback in the augmented reality sensory feedback of type and affiliated rank；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback, comprising:
Control fragrance diffusion device distributes the smell enhancing of the determining affiliated type of device status data of matching and affiliated rank
The smell of feedback carries out smell enhancing feedback to the device status data of acquisition.
6. such as method described in any one of claim 1 to 5, which is characterized in that the device status data of acquisition includes gulping down
The amount of spitting status data, network connection state data, temperature-status data, moisture condition data, pressure state data and electric power shape
At least one of state data.
7. a kind of augmented reality feedback device, which is characterized in that the augmented reality feedback device includes:
Acquiring unit, for obtaining the device status data of physical equipment；
Processing unit carries out augmented reality sensory feedback for the device status data according to preset rules and acquisition；
Wherein, the augmented reality sensory feedback includes vision enhancement feedback, tactile enhancing feedback, Augmented audio feedback and smell
At least one of enhancing feedback；
The processing unit specifically in the following way according to preset rules and the device status data of acquisition, is increased
Strong reality sensory feedback:
According to the device status data of the acquisition, the affiliated type of the device status data and affiliated grade obtained is determined
Not；
Preset rules are searched according to the determining affiliated type of device status data and affiliated rank, determine the described of corresponding acquisition
The augmented reality sensory feedback of the affiliated type of device status data and affiliated rank includes equipment state in the preset rules
Corresponding relationship between data type, device status data rank and augmented reality sensory feedback, wherein each equipment state number
At least two ranks of device status data, the corresponding fixed augmented reality of each rank of device status data are corresponded to according to type
Sensory feedback；
The device status data of acquisition is carried out to correspond to the determining affiliated type of device status data and affiliated rank
Augmented reality sensory feedback.
8. augmented reality feedback device as claimed in claim 7, which is characterized in that the corresponding acquisition that the processing unit determines
The affiliated type of device status data and affiliated rank augmented reality sensory feedback in include vision enhancement feed back；
The augmented reality feedback device further includes image display device；
The processing unit specifically carries out the equipment shape of corresponding determination to the device status data of acquisition in the following way
The augmented reality sensory feedback of the affiliated type of state data and affiliated rank:
The vision enhancement of the affiliated type of device status data and affiliated rank of calling matching determining from preset shape library
Feed back figure；
The vision enhancement called is presented by described image display device and feeds back figure, to the equipment state number of acquisition
According to progress vision enhancement feedback.
9. augmented reality feedback device as claimed in claim 7, which is characterized in that the corresponding acquisition that the processing unit determines
The affiliated type of device status data and affiliated rank augmented reality sensory feedback in include Augmented audio feed back；
The augmented reality feedback device further includes audio frequency apparatus；
The processing unit specifically carries out the equipment shape of corresponding determination to the device status data of acquisition in the following way
The augmented reality sensory feedback of the affiliated type of state data and affiliated rank:
The sound sensation of the affiliated type of device status data and affiliated rank of calling matching determining from preset sound library file
Enhancing feedback audio file；
The audio file called is played by the audio frequency apparatus, sound sensation increasing is carried out to the device status data of acquisition
Strong feedback.
10. augmented reality feedback device as claimed in claim 7, which is characterized in that the correspondence that the processing unit determines obtains
It include tactile enhancing feedback in the augmented reality sensory feedback of the affiliated type of the device status data taken and affiliated rank；
The augmented reality feedback device further includes heating equipment；
The processing unit specifically carries out the equipment shape of corresponding determination to the device status data of acquisition in the following way
The augmented reality sensory feedback of the affiliated type of state data and affiliated rank:
The temperature for controlling the heating equipment is the tactile of the determining affiliated type of device status data of matching and affiliated rank
The temperature for enhancing feedback carries out tactile enhancing feedback to the device status data of acquisition.
11. augmented reality feedback device as claimed in claim 7, which is characterized in that the correspondence that the processing unit determines obtains
It include smell enhancing feedback in the augmented reality sensory feedback of the affiliated type of the device status data and affiliated rank that take；
The augmented reality feedback device further includes fragrance diffusion device；
The processing unit specifically carries out the equipment shape of corresponding determination to the device status data of acquisition in the following way
The augmented reality sensory feedback of the affiliated type of state data and affiliated rank:
Control the smell that the fragrance diffusion device distributes the determining affiliated type of device status data of matching and affiliated rank
The smell for enhancing feedback carries out smell enhancing feedback to the device status data of acquisition.
12. such as the described in any item augmented reality feedback devices of claim 7 to 11, which is characterized in that the acquiring unit, tool
Body for obtaining the device status data of physical equipment as follows:
Obtain the throughput condition data of physical equipment, network connection state data, temperature-status data, moisture condition data,
At least one of pressure state data and power state data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610458015.1A CN106095108B (en) | 2016-06-22 | 2016-06-22 | A kind of augmented reality feedback method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610458015.1A CN106095108B (en) | 2016-06-22 | 2016-06-22 | A kind of augmented reality feedback method and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106095108A CN106095108A (en) | 2016-11-09 |
| CN106095108B true CN106095108B (en) | 2019-02-05 |
Family
ID=57238880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610458015.1A Active CN106095108B (en) | 2016-06-22 | 2016-06-22 | A kind of augmented reality feedback method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106095108B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| MY194754A (en) * | 2017-01-13 | 2022-12-15 | Antunes Nuno | System and method of acquisition, registration and multimedia management |
| CN107564107A (en) * | 2017-07-19 | 2018-01-09 | 中国农业大学 | A kind of design method and equipment of augmented reality implementation tool |
| CN107733755B (en) * | 2017-09-30 | 2020-05-26 | 联想(北京)有限公司 | Processing method and system and computing system thereof |
| CN108243247B (en) * | 2018-01-03 | 2019-03-12 | 上海宏贯投资有限公司 | A kind of data center's intelligent robot inspection tour system |
| CN108845745A (en) * | 2018-07-04 | 2018-11-20 | 百度在线网络技术（北京）有限公司 | Triggering method, device, electronic equipment and the storage medium of augmented reality |
| CN109448155A (en) * | 2018-10-15 | 2019-03-08 | 国网河南省电力公司济源供电公司 | Equipment-patrolling method based on AR technology |
| CN110244582A (en) * | 2019-05-05 | 2019-09-17 | 浙江乌镇街科技有限公司 | A kind of digitlization smell data correlation platform |
| CN110427103B (en) * | 2019-07-10 | 2022-04-26 | 佛山科学技术学院 | Virtual-real fusion simulation experiment multi-channel interaction method and system |
| CN112783316A (en) * | 2019-11-08 | 2021-05-11 | 浙江商汤科技开发有限公司 | Augmented reality-based control method and apparatus, electronic device, and storage medium |
| CN111914789A (en) * | 2020-08-13 | 2020-11-10 | 杭州云笔智能科技有限公司 | Method and system for determining running state of target equipment |
| CN112634462A (en) * | 2020-12-21 | 2021-04-09 | 上海影创信息科技有限公司 | Temperature matching augmented reality method and system for AR glasses |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923669A (en) * | 2008-07-18 | 2010-12-22 | 史迪芬·凯斯 | Intelligent adaptive design |
| CN102592484A (en) * | 2010-11-16 | 2012-07-18 | 韩国电子通信研究院 | Reconfigurable platform management apparatus for virtual reality-based training simulator |
| CN102789313A (en) * | 2012-03-19 | 2012-11-21 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN103793063A (en) * | 2014-03-11 | 2014-05-14 | 哈尔滨工业大学 | Multi-channel augmented reality system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2951811A4 (en) * | 2013-01-03 | 2016-08-17 | Meta Co | Extramissive spatial imaging digital eye glass for virtual or augmediated vision |
| JP6219504B2 (en) * | 2013-10-25 | 2017-10-25 | インテル コーポレイション | Apparatus and method for capturing and generating user experiences |
-
2016
- 2016-06-22 CN CN201610458015.1A patent/CN106095108B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101923669A (en) * | 2008-07-18 | 2010-12-22 | 史迪芬·凯斯 | Intelligent adaptive design |
| CN102592484A (en) * | 2010-11-16 | 2012-07-18 | 韩国电子通信研究院 | Reconfigurable platform management apparatus for virtual reality-based training simulator |
| CN102789313A (en) * | 2012-03-19 | 2012-11-21 | 乾行讯科（北京）科技有限公司 | User interaction system and method |
| CN103793063A (en) * | 2014-03-11 | 2014-05-14 | 哈尔滨工业大学 | Multi-channel augmented reality system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106095108A (en) | 2016-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106095108B (en) | A kind of augmented reality feedback method and equipment | |
| US10593025B2 (en) | Method and system for reconstructing obstructed face portions for virtual reality environment | |
| CN107066082B (en) | Display methods and device | |
| KR101930657B1 (en) | System and method for immersive and interactive multimedia generation | |
| CN110046546B (en) | Adaptive sight tracking method, device and system and storage medium | |
| EP3166319A1 (en) | Information processing device, information processing method, and program | |
| CN105190685B (en) | Method and apparatus for providing the self-adapting data path for being used for computer vision application program | |
| US10739952B2 (en) | Multiple sensors processing system for natural user interface applications | |
| US20170083083A1 (en) | Image processing virtual reality controller system and method | |
| JP2021056678A5 (en) | ||
| JP2015219892A (en) | Visual line analysis system and visual line analysis device | |
| CN107085902A (en) | A kind of intelligent video multi-point monitoring method and system | |
| CN108563327A (en) | Augmented reality method, apparatus, storage medium and electronic equipment | |
| CN107609946A (en) | A kind of display control method and computing device | |
| JP7419003B2 (en) | Information display device, information display method, and information display system | |
| CN109104619A (en) | Image processing method and device for live streaming | |
| KR20140003107A (en) | Apparatus and method for providing augmented reality | |
| CN110414596B (en) | Video processing method, video processing device, model training method, model training device, storage medium and electronic device | |
| JP6849097B2 (en) | Information processing equipment, control methods, and programs | |
| CN108734712A (en) | The method, apparatus and computer storage media of background segment | |
| CN116778550A (en) | Personnel tracking method, device and equipment for construction area and storage medium | |
| CN107783639A (en) | Virtual reality leisure learning system | |
| US20210385299A1 (en) | Method and apparatus for augmented reality interaction and presentation | |
| KR20220077242A (en) | Power plant maintenance system using augmented reality | |
| CN109117735A (en) | A kind of cargo recognition system of self-service machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |