CN102508562B - Three-dimensional interaction system - Google Patents
Three-dimensional interaction system Download PDFInfo
- Publication number
- CN102508562B CN102508562B CN2011103435980A CN201110343598A CN102508562B CN 102508562 B CN102508562 B CN 102508562B CN 2011103435980 A CN2011103435980 A CN 2011103435980A CN 201110343598 A CN201110343598 A CN 201110343598A CN 102508562 B CN102508562 B CN 102508562B
- Authority
- CN
- China
- Prior art keywords
- hook stick
- unit
- dimensional
- operated
- indentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 74
- 230000006698 induction Effects 0.000 claims abstract description 112
- 238000012545 processing Methods 0.000 claims abstract description 36
- 238000004891 communication Methods 0.000 claims abstract description 28
- 238000001514 detection method Methods 0.000 claims abstract description 13
- 238000004364 calculation method Methods 0.000 claims abstract description 8
- 238000007373 indentation Methods 0.000 claims description 160
- 210000003128 head Anatomy 0.000 claims description 89
- 210000004027 cell Anatomy 0.000 claims description 32
- 230000008859 change Effects 0.000 claims description 26
- 238000009877 rendering Methods 0.000 claims description 26
- 238000004088 simulation Methods 0.000 claims description 13
- 230000033001 locomotion Effects 0.000 claims description 11
- 238000012360 testing method Methods 0.000 claims description 8
- 230000009471 action Effects 0.000 claims description 7
- 230000003213 activating effect Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000009434 installation Methods 0.000 claims description 4
- 230000008447 perception Effects 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 abstract 3
- 238000000034 method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 239000007787 solid Substances 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000005684 electric field Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 210000000518 sarcolemma Anatomy 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to a three-dimensional interaction system, which comprises operated equipment and an operating rod, wherein the operated equipment comprises an induction screen which can display a three-dimensional image of an operated unit, an interaction control device, a communication device for realizing information interaction between the interaction control device and the operating rod, and an image processing device. The interaction control device comprises a first position determination unit and a virtual touch detection unit, wherein the first position determination unit is used for determining a three-dimensional position of a touch part of the operating rod; and the virtual touch detection unit is used for judging whether the operating rod is in virtual touch with the operated unit in real time, and if yes, an optical parallax adjustment unit in the image processing device is activated. The image processing device comprises a depth calculation unit and the optical parallax adjustment unit, wherein the depth calculation unit is used for determining the depth of the surface of the operated unit relative to the induction screen, and informing the virtual touch detection unit; and the optical parallax adjustment unit is used for simulating depth variation of the operated unit when the operated unit is pressed. According to the invention, the three-dimensional interaction showed by combining three-dimensional display is realized, and a user can gain more sense of reality.
Description
Technical field
The present invention relates to three-dimensional interaction technique, relate in particular to a kind of Three-dimensional interaction system.
Background technology
The various solutions of present man-machine interactive system mostly are based on the basis that 2D shows, that is to say that the direct display effect that user's operation brings represents with 2D.Further, adopt shade, the near big and far smaller sensation that waits transparent effect to come a kind of solid of approximate simulation.
Along with the development of 3D display technique, this display interface based on 2D will bring a series of operating result that does not meet convention.Because 3D brings operator's display effect directly perceived, all operation interfaces are to protrude, perhaps, and recessed screen.The finger of at present commonplace touch-screen or operating pen all can only carry out at screen the operation of two dimension, for real 3D operation interface, float over the interface of aerial or recessed screen, this traditional mode all can allow the operator feel really not touch actual interface.
Although being arranged in present virtual reality (VR) technology, data glove utilized etc. goes the technology that the object in the space is operated.But the realization of this technology is complicated, such as needing the very high data glove of precision, can to the computer system of whole Virtual Space modeling, sometimes also need the special demonstration helmet could shield actual environment to the interference of virtual environment.Correspondingly, the user uses inconvenience, and cost is also quite expensive.Therefore at a lot of equipment particularly on the mobile device and be not suitable for using.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of hook stick that uses when coming simulating stereo mutual in conjunction with stereo display.
In order to address the above problem, the invention provides a kind of hook stick, comprise shell, also comprise:
The telescopic head that is connected with described shell in telescopic mode;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment; And
Positioning unit is used for detecting in real time hook stick in position and/or the attitude in space, and sends the three dimensional local information that detects to the communication unit transmission.
Preferably, this hook stick also comprises:
Flexible sensing unit is used for detecting in real time the indentation length of hook stick telescopic head and sends the information of the indentation length that detects to communication unit and sends.
Preferably, this hook stick also comprises:
The force feedback unit is used for the force feedback instruction according to described communication unit reception, carries out the action of analog force feedback.
Preferably,
Described positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in take plane, display screen place as the reference system of benchmark under the hook stick original state.
Preferably,
Described telescopic head comprises the operation caput and is resisted against elastomeric element between this operation caput and the flexible induction installation;
Described flexible sensing unit adopts pressure sensing mode to realize, is used for responding to the pressure of described elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
Preferably,
Described force feedback unit adopts electro-mechanical device to realize, is used for simulating one and being operated really the vibrations that the unit is pressed after receiving the force feedback instruction.
Preferably,
Described telescopic head is a tip away from an end of shell.
The hook stick that such scheme provides possesses positioning unit and telescopic head, can know locus and the attitude of hook stick, thereby can obtain simulating stereo needed various parameters when mutual, and indentation can occur behind contact screen, so that touch control operation allows the user feel the more sense of reality.
The another technical matters that the present invention will solve provides a kind ofly can be come the mutual three-dimensional exchange method of simulating stereo and be operated accordingly equipment in conjunction with stereo display.
In order to address the above problem, the invention provides a kind of three-dimensional exchange method, be used for being operated equipment simulation hook stick to responding to the operation that is operated the unit of stereo display on the screen, this solid exchange method comprises:
Determine to be operated cell surface with respect to the degree of depth of screen according to the parallax of the stereo-picture that is operated the unit;
Determine the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, the three-dimensional position of compare operation rod contact site and the shown three-dimensional position that is operated cell surface, real-time judge hook stick whether be operated the unit virtual touching occur;
Touch such as the decision operation rod and to be operated the unit, by the parallax adjustment to the stereo-picture that is operated the unit, the change in depth when simulation is operated the unit and is pressed.
Preferably,
The three-dimensional position of described hook stick contact site all adopts relative coordinate to represent with the three-dimensional position that is operated cell surface, and this relative coordinate is determined take induction plane, screen place as reference system.
Preferably,
The three dimensional local information of described hook stick contact site according to Real-time Obtaining is determined the three-dimensional position of hook stick contact site, comprise: at least when described hook stick does not touch described induction screen, the three-dimensional position of described hook stick contact site obtains according to the three-dimensional coordinate information of the hook stick contact site that receives, perhaps, calculate according to the azimuth information of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and the contact site intrinsic distance to this another position.
Preferably,
The three dimensional local information of described hook stick contact site according to Real-time Obtaining is determined the three-dimensional position of hook stick contact site, comprise: when described hook stick touched described induction screen, the three-dimensional position of described hook stick contact site calculated according to the indentation length of hook stick head, the position angle of hook stick and the touch location of hook stick and induction screen.
Preferably, the indentation length of described hook stick head is Real-time Obtaining in the following manner:
The information of the indentation length of sending according to described hook stick is determined; Perhaps
Testing result according to the pressure sensitive device on the described induction screen calculates; Perhaps
Determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
Preferably,
Described by the parallax adjustment to the stereo-picture that is operated the unit, the change in depth when simulation is operated the unit and is pressed comprises:
With the hook stick contact site of Real-time Obtaining with respect to the degree of depth of screen as the degree of depth that is operated cell surface, and be operated the parallax of unit on stereo-picture according to this degree of depth adjustment.
Preferably,
Touch such as the decision operation rod and to be operated the unit, the described equipment that is operated also sends the force feedback instruction to described hook stick.
Preferably,
The decision operation rod touch be operated the unit after, also according to the change in depth that is operated cell surface, whether the decision operation rod has been finished being operated the clicking operation of unit, in this way, then generates the click order that this is operated the unit.
Correspondingly, the present invention also provides the equipment that is operated in a kind of Three-dimensional interaction system, comprises induction screen, communicator and image processing apparatus, it is characterized in that, also comprises interaction control device, wherein:
Described induction screen is used for showing the stereo-picture that is operated the unit;
Described communicator is used for the information interaction between realization interaction control device and the hook stick;
Described interaction control device comprises:
Position determination unit is used for determining according to the three dimensional local information of the hook stick contact site of Real-time Obtaining the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches, be used for according to the three-dimensional position of hook stick contact site and the shown three-dimensional position that is operated cell surface, the real-time judge hook stick whether be operated the unit virtual touching occur, in this way, activate the parallax adjustment unit in the image processing apparatus;
Described image processing apparatus comprises:
The depth calculation unit is used for determining to be operated cell surface with respect to the degree of depth of induction screen according to the parallax that is operated the stereo-picture of unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for by the parallax adjustment to the stereo-picture that is operated the unit, the change in depth when simulation is operated the unit and is pressed.
Preferably,
Described position determination unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick does not touch described induction screen, obtain the three-dimensional position of described hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site calculates described hook stick contact site to the intrinsic distance at this another position the three-dimensional position at another position on the hook stick that receives.
Preferably,
Described interaction control device also comprises: the actual detecting unit that touches is used for after detecting hook stick and touching screen, with the touch location notice position determination unit that detects;
Described position determination unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick touches described induction screen, calculate the three-dimensional position of described hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
Preferably,
Indentation length that described position determination unit is calculated the described hook stick head that the three-dimensional position of described hook stick contact site uses is Real-time Obtaining in the following manner:
The information of the indentation length of sending according to described hook stick is determined; Perhaps
Testing result according to the pressure sensitive device on the described induction screen calculates; Perhaps
Determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
Preferably,
Described parallax adjustment unit is by the parallax adjustment to the stereo-picture that is operated the unit, change in depth when simulation is operated the unit and is pressed, comprise: with the hook stick contact site of Real-time Obtaining with respect to the degree of depth of screen as the degree of depth that is operated cell surface, and be operated the parallax of unit on stereo-picture according to this degree of depth adjustment.
Preferably,
Described virtual touch detecting unit the decision operation rod touch be operated the unit after, also according to the change in depth that is operated cell surface, whether the decision operation rod has been finished being operated the clicking operation of unit, in this way, then generates the click order that this is operated the unit.
Preferably,
The described virtual detecting unit real-time judge hook stick that touches touches when being operated the unit, also sends the force feedback instruction by described communicator to described hook stick.
Preferably,
The described equipment that is operated is smart mobile phone or panel computer.
Such scheme can the simulated operation rod to the operation that is operated the unit of stereo display on the induction screen, allow the user feel the more sense of reality, the hook stick of experiencing and screen more realistic alternately.
The another technical matters that the present invention will solve provides another kind and can come the mutual three-dimensional exchange method of simulating stereo and be operated accordingly equipment in conjunction with stereo display.
In order to address the above problem, the invention provides a kind of three-dimensional exchange method, for being operated the operation of stretching into the induction screen on the equipment by stereo display simulated operation rod, this solid exchange method comprises:
Detect hook stick and whether touch described induction screen;
When hook stick touches described induction screen, according to the three dimensional local information of the hook stick indentation of Real-time Obtaining part and the touch location of hook stick and induction screen, calculate described hook stick indentation virtual three-dimensional position partly;
According to the virtual three-dimensional position of hook stick indentation part, the image of real-time rendering hook stick indentation part, and this image that will draw is presented on the described induction screen.
Preferably,
Described hook stick indentation three dimensional local information partly according to Real-time Obtaining calculates hook stick indentation virtual three-dimensional position partly, comprising:
Indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate virtual three-dimensional position more at least on the hook stick indentation part, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably, the indentation length of described hook stick head is Real-time Obtaining in the following manner:
The information of the indentation length of sending according to described hook stick is determined; Perhaps
Testing result according to the pressure sensitive device on the described induction screen calculates; Perhaps
Determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
Preferably,
Described hook stick indentation three dimensional local information partly according to Real-time Obtaining calculates hook stick indentation virtual three-dimensional position partly, comprising:
Three dimensional local information according to the hook stick of real-time reception, obtain or calculate the three-dimensional position of hook stick contact site, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly.
Preferably,
The image of the hook stick indentation part of described real-time rendering is stereo-picture, this stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera, to respond to screen as the parallax free face, draw out left image and the right image of described hook stick indentation part.
Preferably,
It is that the relative coordinate that reference system is determined represents that the three-dimensional position of using in the described three-dimensional exchange method adopts to respond to plane, screen place.
Correspondingly, the present invention also provides the equipment that is operated in a kind of Three-dimensional interaction system, comprises induction screen, communicator and image processing apparatus, it is characterized in that, also comprises interaction control device, wherein:
Described induction screen is used for showing the stereo-picture that is operated the unit;
Described communicator is used for the information interaction between realization interaction control device and the hook stick;
Described interaction control device comprises:
Position determination unit is used for calculating hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining and the touch location of hook stick and induction screen;
The actual detecting unit that touches is used for activating the Image Rendering unit in the image processing apparatus when detecting hook stick and touch the induction screen, and with the touch location notice position determination unit of hook stick and induction screen;
Described image processing apparatus comprises:
The Image Rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the described induction screen.
Preferably,
Described position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate virtual three-dimensional position more at least on the hook stick indentation part, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
Described position determination unit is the indentation length of the described hook stick head of Real-time Obtaining in the following manner:
The information of the indentation length of sending according to described hook stick is determined; Perhaps
Testing result according to the pressure sensitive device on the described induction screen calculates; Perhaps
Determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
Preferably,
Described position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Three dimensional local information according to the hook stick of real-time reception, obtain or calculate the three-dimensional position of hook stick contact site, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The image of the hook stick indentation part of described Image Rendering unit real-time rendering is stereo-picture, this stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera, to respond to screen as the parallax free face, draw out left image and the right image of described hook stick indentation part.
Preferably,
The described equipment that is operated is smart mobile phone or panel computer.
Such scheme can stretch into by stereo display simulated operation rod the operation of induction screen, allows the user feel the more sense of reality, the hook stick of experiencing and screen more realistic alternately.
Another technical matters that the present invention will solve provides and a kind ofly can allow the user feel the Three-dimensional interaction system that represents in conjunction with stereo display of more senses of reality.
In order to address the above problem, the invention provides a kind of Three-dimensional interaction system, comprise the equipment of being operated and hook stick;
The described equipment that is operated comprises induction screen, the interaction control device that can show the stereo-picture that is operated the unit, the communicator that is used for realizing information interaction between interaction control device and the hook stick, and image processing apparatus;
Described interaction control device comprises:
The primary importance determining unit is used for determining according to the three dimensional local information of the hook stick contact site of Real-time Obtaining the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches, be used for according to the three-dimensional position of hook stick contact site and the shown three-dimensional position that is operated cell surface, the real-time judge hook stick whether be operated the unit virtual touching occur, in this way, activate the parallax adjustment unit in the image processing apparatus;
Described image processing apparatus comprises:
The depth calculation unit is used for determining to be operated cell surface with respect to the degree of depth of induction screen according to the parallax that is operated the stereo-picture of unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for by the parallax adjustment to the stereo-picture that is operated the unit, the change in depth when simulation is operated the unit and is pressed.
Preferably, described hook stick comprises:
Positioning unit is used for detecting in real time hook stick in position and/or the attitude in space, and sends the three dimensional local information that detects to the communication unit transmission;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment;
The three dimensional local information of the hook stick contact site of described primary importance determining unit Real-time Obtaining is that the positioning unit in the described hook stick sends.
Preferably,
Described positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in take plane, display screen place as the reference system of benchmark under the hook stick original state.
Preferably, described Three-dimensional interaction system also comprises:
Positioning auxiliary device is used for the real-time perception hook stick with respect to the three-dimensional position of induction screen, and the information of the three-dimensional position that perceives is sent to described primary importance determining unit.
Preferably,
Described primary importance determining unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick does not touch described induction screen, obtain the three-dimensional position of described hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site calculates described hook stick contact site to the intrinsic distance at this another position the three-dimensional position at another position on the hook stick that receives.
Preferably,
Described interaction control device also comprises: the actual detecting unit that touches is used for after detecting hook stick and touching screen, with the touch location notice primary importance determining unit that detects;
Described primary importance determining unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick touches described induction screen, calculate the three-dimensional position of described hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
Preferably,
Described primary importance determining unit is calculated the indentation length of the described hook stick head that the three-dimensional position of described hook stick contact site uses, be that the three-dimensional position of this hook stick of sending according to hook stick or positioning auxiliary device and the information of attitude are determined the degree of depth of hook stick contact site and the angle of hook stick and induction screen, then calculate the indentation length of described hook stick head.
Preferably,
Described parallax adjustment unit is by the parallax adjustment to the stereo-picture that is operated the unit, change in depth when simulation is operated the unit and is pressed, comprise: with the hook stick contact site of Real-time Obtaining with respect to the degree of depth of screen as the degree of depth that is operated cell surface, and be operated the parallax of unit on stereo-picture according to this degree of depth adjustment.
Preferably,
Described virtual touch detecting unit the decision operation rod touch be operated the unit after, also according to the change in depth that is operated cell surface, whether the decision operation rod has been finished being operated the clicking operation of unit, in this way, then generates the click order that this is operated the unit.
Preferably,
Described hook stick comprises:
The force feedback unit is used for the force feedback instruction according to described communication unit reception, carries out the action of analog force feedback;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment;
The described virtual detecting unit real-time judge hook stick that touches touches when being operated the unit, also sends the force feedback instruction by described communicator to described hook stick.
Preferably,
Described hook stick comprises a telescopic head;
Described interaction control device also comprises:
Second place determining unit is used for obtaining hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining and the touch location of hook stick and induction screen;
The actual detecting unit that touches is used for activating the Image Rendering unit in the image processing apparatus when detecting hook stick and touch the induction screen, and with the touch location notice second place determining unit of hook stick and induction screen;
Described image processing apparatus also comprises:
The Image Rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the described induction screen.
Preferably,
Described second place determining unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate virtual three-dimensional position more at least on the hook stick indentation part, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The indentation length of the hook stick head that uses during the virtual three-dimensional position of described second place determining unit calculating operation rod indentation part obtains in the following manner: determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
Preferably,
Described hook stick comprises:
Telescopic head;
Flexible sensing unit is used for detecting in real time the indentation length of hook stick telescopic head and sends the information of the indentation length that detects to communication unit and sends;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment.
Preferably,
Described telescopic head comprises the operation caput and is resisted against elastomeric element between this operation caput and the flexible induction installation;
Described flexible sensing unit adopts pressure sensing mode to realize, is used for responding to the pressure of described elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
Preferably,
Described hook stick comprises telescopic head;
Described induction screen surface has been set up a pressure sensitive device, for detection of hook stick and induction screen when touching pressure and testing result sent to interaction control device, this pressure is corresponding with the indentation length of hook stick head.
Preferably,
Described position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Three dimensional local information according to the hook stick of real-time reception, obtain or calculate the three-dimensional position of hook stick contact site, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The image of the hook stick indentation part of described Image Rendering unit real-time rendering is stereo-picture, this stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera, to respond to screen as the parallax free face, draw out left image and the right image of described hook stick indentation part.
Preferably,
The described equipment that is operated is smart mobile phone or panel computer.
Preferably,
The head of described hook stick is a tip away from an end of shell, and this tip has consisted of described hook stick contact site.
Such scheme uses a kind of special hook stick in conjunction with the equipment that is operated that has accordingly three-dimensional display function, realized that a kind of solid that shows in conjunction with stereo display is mutual, allow the user feel the more sense of reality, the hook stick of experiencing be operated the more realistic alternately of unit.
Description of drawings
Fig. 1 is that the embodiment of the invention is to the synoptic diagram of the touch control operation of the button of protrusion screen;
Fig. 2 is that the embodiment of the invention is to the synoptic diagram of the touch control operation of the button of recessed screen;
Fig. 3 a is the structural representation of the embodiment of the invention one hook stick;
Fig. 3 b is the connection diagram of each unit in the embodiment of the invention one hook stick;
Fig. 4 is the structural representation that the embodiment of the invention one is operated equipment;
Fig. 5 is the processing flow chart of a pair of touching operation that is operated the unit of stereo display on screen of the embodiment of the invention;
Fig. 6 a and Fig. 6 b are the synoptic diagram of the relation of the parallax of pixel and the degree of depth;
Fig. 7 is the embodiment of the invention one stretches into the operation of induction screen by stereo display simulated operation rod processing flow chart;
Fig. 8 is the synoptic diagram that detects the indentation length of hook stick by the pressure sensitive device on the screen.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, hereinafter in connection with accompanying drawing embodiments of the invention are elaborated.Need to prove that in the situation of not conflicting, the embodiment among the application and the feature among the embodiment be combination in any mutually.
Embodiment one
As depicted in figs. 1 and 2, Three-dimensional interaction system of the present invention comprises hook stick and is operated equipment that this is operated equipment and comprises the induction screen that can carry out stereo display, as is smart mobile phone, panel computer etc.The operating unit (take button as example, also can be button or other icons) of responding to screen (being designated hereinafter simply as screen) but going up stereo display may be to protrude and recessed screen In the view of the user.For being shown as when protruding being operated the unit and carrying out touch control operation of screen, in order to allow the user feel the more sense of reality, reach at the head of hook stick and to be operated cell surface, when virtual touching namely occurs, can simulate this visible change when being operated the unit and being pressed, simultaneously can also give the certain force feedback of user, the hook stick that the user is experienced is more realistic to the touch-control that is operated the unit.And when being shown as being operated the unit and carrying out touch control operation of recessed screen, the head of hook stick will touch screen before reaching and being operated cell surface, in order to allow the user feel the more sense of reality, can be telescopic with the head design of hook stick, draw indentation part and the stereo display on screen of hook stick, calculate simultaneously the three-dimensional position of this head when flexible, judge whether virtual touching can occur, the servo-actuated demonstration and the force feedback that occur can adopt above-mentioned identical mode to be operated the unit after virtual the touching are processed.
In the literary composition, three dimensional local information can be three-dimensional position or any information such as attitude, indentation length etc. for the Calculation of Three Dimensional position.Three-dimensional position can represent such as x with three-dimensional coordinate, y, z coordinate or the polar coordinates that represent with length and position angle.It is that reference system is determined that the coordinate of expression three-dimensional position can be responded to plane, screen place, namely is the relative coordinate with respect to the induction screen.Take smart mobile phone as example, can but be not limited to the mid point of screen or certain end points as true origin, the direction of normal to screen is Z axis, the plane at screen place is the plane that the XY coordinate axis represents.
Please refer to the synoptic diagram of the structural representation shown in Fig. 3 a and each unit connection shown in Fig. 3 b, this hook stick comprises shell 101, telescopic head 102, communication unit 103, positioning unit 104, force feedback unit 105 and flexible sensing unit 106, wherein:
The aforesaid operations rod can also comprise such as servicing units such as battery, charging devices, introduces no longer one by one here.
As shown in Figure 4, be operated equipment and comprise induction screen 10, communicator 20 and image processing apparatus 30.Wherein:
Interaction control device 30 comprises:
Primary importance determining unit 301 is used for determining according to the three dimensional local information of the hook stick contact site of Real-time Obtaining the three-dimensional position of hook stick contact site., can obtain according to the three-dimensional coordinate information of the hook stick contact site that receives not during contact screen at described hook stick; Perhaps, calculate according to the azimuth information of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and the contact site intrinsic distance to this another position.When the hook stick contact screen, can calculate according to the indentation length of hook stick head, the position angle of hook stick and the touch location of hook stick and induction screen, wherein, the information of the indentation length that can send according to hook stick again of the indentation length of hook stick head is determined.Need to prove that before hook stick touched screen, the three-dimensional position of hook stick contact site was physical location, after hook stick touched screen, the three-dimensional position of hook stick contact site was virtual location, and other places no longer specify in the literary composition.
The virtual detecting unit 302 that touches, be used for according to the three-dimensional position of hook stick contact site and the shown three-dimensional position that is operated cell surface, the real-time judge hook stick whether be operated the unit virtual touching occur, in this way, activate the parallax adjustment unit in the image processing apparatus, and can send the force feedback instruction to hook stick by communicator.In addition, can also be according to the change in depth that is operated cell surface, whether the decision operation rod has been finished being operated the clicking operation of unit, in this way, then generates the click order that this is operated the unit.
The actual detecting unit 303 that touches is used for activating the Image Rendering unit in the image processing apparatus when detecting hook stick contact induction screen, and notifies primary importance determining unit and second place determining unit with the touch location of hook stick and induction screen.
Second place determining unit 304 is used for the three-dimensional position according to the hook stick contact site, and binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
The three dimensional local information of the hook stick indentation part of Real-time Obtaining and the touch location of hook stick and induction screen calculate hook stick indentation virtual three-dimensional position partly.For example, indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate on the hook stick indentation part the more at least virtual three-dimensional position of (such as contact site), binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Wherein, the virtual three-dimensional position of contact site also can obtain or calculate according to the three-dimensional position of the hook stick of Real-time Obtaining and the information of attitude; The indentation length of hook stick head is determined according to the information of the indentation length that hook stick is sent.
Image processing apparatus 40 comprises again:
The image that above-mentioned image processing apparatus may also need the stereo-picture that will show to be carried out other is processed, and only the unit relevant with present embodiment is described here.
The below introduces hook stick to the treatment scheme of the touching operation that is operated the unit of stereo display on screen, as shown in Figure 5, comprising:
Step 310 determines to be operated cell surface with respect to the degree of depth of screen according to the parallax of the stereo-picture that is operated the unit;
Present embodiment is the parallax formation stereo display effect by the left image of stereo-picture and right image.Fig. 6 a and Fig. 6 b are respectively that the pixel P with parallax d shows as synoptic diagram recessed and the protrusion screen when stereo display, wherein, what parallax d was pixel P at the left image of stereo-picture and the coordinate on the right image is poor, according to the parallax d of pixel and the three-dimensional position of user's images of left and right eyes, just can calculate easily pixel P is vertical range with respect to the degree of depth of screen.The degree of depth just can got when being operated the relative screen protrusion in unit, can get negative, perhaps opposite when recessed.
The spacing of user's images of left and right eyes and viewing location can be set with reference to the empirical value of this area, no longer discuss in detail here.If the head tracking device is arranged, the three-dimensional position of the images of left and right eyes that also can detect with tracking dynamically calculates parallax, and is more accurate.
Because it is known being operated the position of cell surface on screen, after this step is determined to be operated the degree of depth of the relative screen of cell surface, has obtained being operated the three-dimensional position of cell surface.
Step 320 is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining;
The three dimensional local information of the hook stick contact site that hook stick sends can be the three-dimensional coordinate of hook stick contact site in the space, also can be other information that can extrapolate this three-dimensional coordinate.At hook stick not during contact screen, the three-dimensional position of hook stick contact site can obtain according to the three-dimensional coordinate information of the hook stick contact site that receives, perhaps, calculate according to the azimuth information (such as angle and the projection of hook stick on screen and the angle of X-axis or Y-axis of hook stick and screen) of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and the contact site intrinsic distance to this another position.This calculating can be finished in the positioning unit of hook stick, also can finish in being operated equipment.
During the hook stick contact screen, also can adopt the mode of epimere to determine the three-dimensional position of hook stick contact site.Because behind the hook stick contact screen, there are the touch location of hook stick and screen and the parameters such as indentation length of hook stick head to use, therefore can be according to the three-dimensional position of the excellent contact site of touch location calculating operation of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen, the result is more accurate.Wherein, the information of the indentation length that can send according to described hook stick of the indentation length of hook stick head is determined.
Usually, when overlapping or pass through with the three-dimensional position that is operated cell surface, the three-dimensional position of hook stick contact site thinks that virtual touching occurs for both.
In this step, can also be according to the change in depth that is operated cell surface, whether the decision operation rod has been finished the clicking operation that is operated the unit (some button be depressed certain position then just be considered as choosing), in this way, then generates the click order that this is operated the unit.
In this step, can be with the hook stick contact site of Real-time Obtaining with respect to the degree of depth of screen as the degree of depth that is operated cell surface, and be operated the parallax of unit on stereo-picture according to this degree of depth adjustment, process as this pixel coordinate that is operated the unit on left image and/or the left image being carried out translation.What demonstrate is operated the unit and can simulates change in depth when being operated the unit and being pressed.In another embodiment, if indentation length is less, can simplify the demonstration of pilot process, directly show the stereo-picture when being operated the unit is pressed stop position.In another embodiment, can also show one by one and be operated the be pressed stereo-picture of stop position and middle some positions of unit.
Please refer to Fig. 7, is the processing flow chart that stretches into the operation of induction screen by stereo display simulated operation rod, comprising:
Step 410 detects hook stick and whether touches screen, in this way, and execution in step 420, otherwise continue to detect;
Step 420 according to the three dimensional local information of the hook stick indentation of Real-time Obtaining part and the touch location of hook stick and induction screen, calculates hook stick indentation virtual three-dimensional position partly;
During the virtual three-dimensional position of calculating operation rod indentation part, can be according to indentation length, the position angle of hook stick and the touch location of hook stick and induction screen of the hook stick head of Real-time Obtaining, calculate on the hook stick indentation part the more at least virtual three-dimensional position of (such as contact site), binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Also can be according to the three dimensional local information of the hook stick of real-time reception, obtain or calculate the three-dimensional position of hook stick contact site, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly.Wherein, the information of the indentation length that can send according to described hook stick of the indentation length of hook stick head is determined.
Step 430, according to the virtual three-dimensional position of hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part is presented at this stereo-picture of drawing on the screen.
When drawing, the three-dimensional position of images of left and right eyes will be responded to screen as the parallax free face as left and right camera in the time of the user who sets or tracking obtains can being watched screen, can draw out respectively the left and right sides image of this indentation part.Finish after this step, screen is the stereo-picture of display operation rod indentation part, really visit into the screen as hook stick so that the user looks, strengthened the three-dimensional sense of reality when mutual of user.
Can find out that from such scheme present embodiment has been realized a kind of touch control operation of showing in conjunction with stereo display.In order to allow the user feel the more sense of reality, and the hook stick of experiencing and screen is more realistic alternately, is provided with the positioning unit that hook stick is carried out motion detection in hook stick, can detect in real time position and the attitude of hook stick.Referring again to shown in Figure 1, for being shown as the button that protrudes screen, also there is not contact screen but human eye perceives during contact screen at hook stick, detect the demonstration of knowing and change this button by virtual touching, so that it as really being pressed, can award user's sense of touch by the force feedback unit simultaneously.And for the button that is shown as recessed screen, referring again to Fig. 2, at hook stick contact screen but human eye perceives when also not contacting button, the hook stick head can carry out automatically along with operator's action indentation, and send the information of indentation length to terminal device, terminal device is drawn out the stereo-picture of this indentation part and is shown at screen, the user feels as if that this hook stick really stretches into screen and goes click keys the same, simultaneously when hook stick is made other actions, such as move left and right, the pseudo operation rod also will move simultaneously.Stretch into behind the screen can by virtual touch to detect learn that hook stick point has suffered button, then can carry out to being operated the unit processing of parallax adjustment and force feedback.
As the example of the change after simplification of present embodiment, can cancel and the force feedback related content, the force feedback unit is not set in hook stick, in being operated equipment, do not carry out relevant treatment yet.Other embodiment herewith.
Under certain application scenarios, only relate to the operation that is operated the unit of protruding screen to being shown as, then the embodiment for this application scenarios can be simplified on the basis of present embodiment, can cancel device and the processing relevant with flexible operation, can cancel such as the telescopic head in the hook stick and flexible sensing unit, the second place determining unit, the Image Rendering unit that are operated in the image processing apparatus of equipment can be cancelled, and can cancel the processing of calculating indentation length, drawing pseudo operation rod etc.
Under certain application scenarios, only relate to being shown as the operation that is operated the unit of recessed screen, then the embodiment for this application scenarios can be simplified on the basis of present embodiment, positioning unit in the hook stick can be cancelled the sensor of doing the movement locus detection, because only need to by means of the touch location of the attitude of hook stick, indentation length and induction screen and hook stick, can finish the virtual detection of touching.
Embodiment two
Different from embodiment one is, the three-dimensional hook stick that do not relate to alternately of present embodiment is to the touching operation that is operated the unit of stereo display on screen, and only relates to the processing of stretching into the operation of induction screen by stereo display simulated operation rod.Therefore can carry out some simplification on the basis of embodiment one.
The structure of hook stick can be identical with the hook stick of embodiment one.Also can do some simplification, for example, positioning unit can include only the sensor that gestures and detect.
The equipment that is operated comprises induction screen, communicator and image processing apparatus equally.The induction screen is identical with embodiment one with communicator.
Interaction control device comprises:
The actual detecting unit that touches is used for activating the Image Rendering unit in the image processing apparatus when detecting hook stick contact induction screen, and notifies position determination unit with the touch location of hook stick and induction screen.
Position determination unit is used for calculating hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining and the touch location of hook stick and induction screen.For example, indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate on the hook stick indentation part the more at least virtual three-dimensional position of (such as contact site), binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Wherein, the virtual three-dimensional position of contact site also can obtain or calculate according to the three-dimensional position of the hook stick of Real-time Obtaining and the information of attitude; The indentation length of hook stick head is determined according to the information of the indentation length that hook stick is sent.
Image processing apparatus comprises:
The Image Rendering unit with the Image Rendering unit among the embodiment one, is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the induction screen.
Present embodiment stretches into the treatment scheme of the operation of responding to screen with embodiment one by stereo display simulated operation rod.
Embodiment three
Present embodiment and embodiment one are basic identical, and difference is in the detection to the three-dimensional position of hook stick.In the present embodiment, not for detection of the positioning unit of position and attitude, need to use other the three-dimensional coordinate of the common positioning action rod of positioning auxiliary device in the space in the hook stick.
This positioning auxiliary device is used for the sense operation rod and sends to the equipment of being operated with respect to the three-dimensional position of induction screen and with the three dimensional local information that perceives, its mode can but be not limited to be:
(a) tracking means, such as video camera (camera), by this video camera hook stick is carried out Tracking Recognition, determine the three dimensional local information of hook stick and send to that this three dimensional local information can comprise azimuthal information of three-dimensional position and the hook stick of hook stick contact site or miscellaneous part.
(b) infrared inductor all will have this device on hook stick and the operated equipment, and one as generating means, and one as receiving device, by the three dimensional local information that is operated equipment or hook stick and calculates hook stick.
Above-mentioned positioning auxiliary device can directly send three dimensional local information to the interaction control device that is operated equipment, also can send to first the communicator that is operated the unit, offers this interaction control device by this communicator.
Present embodiment also can be used for change example and the embodiment two of embodiment one to the detection of the three-dimensional position of hook stick.Under the simplest a kind of mode, but hook stick does not have indentation head and flexible induction mechanism, positioning unit and force feedback unit, just as common lettering pen.Position and the attitude of hook stick are detected by positioning auxiliary device, when solid is mutual, only need to simulate protruding the touch control operation that is operated the unit of screen, be operated therefore on the equipment that partly relevant location and unit and the processing of drafting all can be omitted with the hook stick indentation.
Embodiment four
Present embodiment and embodiment one are basic identical, and difference is not arrange in the hook stick indentation sensing unit.Touch indentation length behind the screen for hook stick, calculate by another way.
As shown in Figure 8, present embodiment has increased the special pressure sensitive device 101 of one deck on the surface of the induction screen 10 that is operated equipment.For example, this pressure sensitive device can be a kind of special capacitance plate, and after hook stick touched this capacitance plate, this capacitance plate can change and the change of generation electric field along with the pressure of hook stick, after the change of this electric field is detected, can send to interaction control device.Because the indentation length of pressure and hook stick head has corresponding relation, the variation of the capacitance voltage of perception screen just can calculate the indentation length of hook stick head.And then the three-dimensional position of definite hook stick contact site.Also namely, the indentation length of hook stick head also can calculate according to the testing result of the pressure sensitive device on the induction screen.
Present embodiment also can be used for change example and the embodiment two of embodiment one to the detection of the indentation length of hook stick.
Embodiment five
Present embodiment and embodiment one are basic identical, and difference is not arrange in the hook stick indentation sensing unit.Touch the three-dimensional position of the hook stick contact site behind the screen for hook stick, calculate by another way.
Because there is not the indentation sensing unit, so the present embodiment hook stick touches the information that can not obtain the indentation length of the hook stick head that detects behind the screen.But, because the positioning unit in the hook stick can detect position and the attitude of hook stick in real time, therefore, can calculate indentation length according to the testing result of positioning unit.
The three-dimensional position of the hook stick that detects according to positioning unit and the information of attitude can obtain the degree of depth of hook stick contact site and the angle of hook stick and induction screen, can calculate the indentation length of hook stick head according to this degree of depth and angle.After obtaining this indentation length, the touch location of the position angle of binding operation rod and hook stick and induction screen can calculate the three-dimensional position of hook stick contact site.This mode combines the data of positioning unit and the data of actual touch location, can guarantee bearing accuracy, can avoid the appearance of the bad display effects such as hook stick disconnection.
Present embodiment also can be used for the change example of embodiment one to the detection of the indentation length of hook stick.Understand easily, the three-dimensional position of the hook stick that the present embodiment positioning unit detects in real time and the information of attitude also can utilize the servicing unit among the embodiment two to provide.
One of ordinary skill in the art will appreciate that all or part of step in the said method can come the instruction related hardware to finish by program, described program can be stored in the computer-readable recording medium, such as ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of above-described embodiment can realize with one or more integrated circuit that also correspondingly, each the module/unit in above-described embodiment can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (20)
1. a Three-dimensional interaction system is characterized in that, comprises the equipment of being operated and hook stick;
The described equipment that is operated comprises induction screen, the interaction control device that can show the stereo-picture that is operated the unit, the communicator that is used for realizing information interaction between interaction control device and the hook stick, and image processing apparatus;
Described interaction control device comprises:
The primary importance determining unit is used for determining according to the three dimensional local information of the hook stick contact site of Real-time Obtaining the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches, be used for according to the three-dimensional position of hook stick contact site and the shown three-dimensional position that is operated cell surface, the real-time judge hook stick whether be operated the unit virtual touching occur, in this way, activate the parallax adjustment unit in the image processing apparatus;
Described image processing apparatus comprises:
The depth calculation unit is used for determining to be operated cell surface with respect to the degree of depth of induction screen according to the parallax that is operated the stereo-picture of unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for by the parallax adjustment to the stereo-picture that is operated the unit, the change in depth when simulation is operated the unit and is pressed.
2. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described hook stick comprises:
Positioning unit is used for detecting in real time hook stick in position and/or the attitude in space, and sends the three dimensional local information that detects to the communication unit transmission;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment;
The three dimensional local information of the hook stick contact site of described primary importance determining unit Real-time Obtaining is that the positioning unit in the described hook stick sends.
3. Three-dimensional interaction system as claimed in claim 2 is characterized in that:
Described positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in take plane, display screen place as the reference system of benchmark under the hook stick original state.
4. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Also comprise: positioning auxiliary device is used for the real-time perception hook stick with respect to the three-dimensional position of induction screen, and the information of the three-dimensional position that perceives is sent to described primary importance determining unit.
5. as claimed in claim 1 or 2 or 3 or 4 Three-dimensional interaction system is characterized in that:
Described primary importance determining unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick does not touch described induction screen, obtain the three-dimensional position of described hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site calculates described hook stick contact site to the intrinsic distance at this another position the three-dimensional position at another position on the hook stick that receives.
6. as claimed in claim 1 or 2 or 3 or 4 Three-dimensional interaction system is characterized in that:
Described interaction control device also comprises: the actual detecting unit that touches is used for after detecting hook stick and touching screen, with the touch location notice primary importance determining unit that detects;
Described primary importance determining unit is determined the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site of Real-time Obtaining, comprise: when described hook stick touches described induction screen, calculate the three-dimensional position of described hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
7. Three-dimensional interaction system as claimed in claim 6 is characterized in that:
Described primary importance determining unit is calculated the indentation length of the described hook stick head that the three-dimensional position of described hook stick contact site uses, be that the three-dimensional position of this hook stick of sending according to hook stick or positioning auxiliary device and the information of attitude are determined the degree of depth of hook stick contact site and the angle of hook stick and induction screen, then calculate the indentation length of described hook stick head.
8. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described parallax adjustment unit is by the parallax adjustment to the stereo-picture that is operated the unit, change in depth when simulation is operated the unit and is pressed, comprise: with the hook stick contact site of Real-time Obtaining with respect to the degree of depth of screen as the degree of depth that is operated cell surface, and be operated the parallax of unit on stereo-picture according to this degree of depth adjustment.
9. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described virtual touch detecting unit the decision operation rod touch be operated the unit after, also according to the change in depth that is operated cell surface, whether the decision operation rod has been finished being operated the clicking operation of unit, in this way, then generates the click order that this is operated the unit.
10. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described hook stick comprises:
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment;
The force feedback unit is used for the force feedback instruction according to described communication unit reception, carries out the action of analog force feedback;
The described virtual detecting unit real-time judge hook stick that touches touches when being operated the unit, also sends the force feedback instruction by described communicator to described hook stick.
11. Three-dimensional interaction system as claimed in claim 1 or 2 or 3 or 4 is characterized in that:
Described hook stick comprises a telescopic head;
Described interaction control device also comprises:
Second place determining unit is used for obtaining hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining and the touch location of hook stick and induction screen;
The actual detecting unit that touches is used for activating the Image Rendering unit in the image processing apparatus when detecting hook stick and touch the induction screen, and with the touch location notice second place determining unit of hook stick and induction screen;
Described image processing apparatus also comprises:
The Image Rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the described induction screen.
12. Three-dimensional interaction system as claimed in claim 11 is characterized in that:
Described second place determining unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Indentation length, the position angle of hook stick and the touch location of hook stick and induction screen according to the hook stick head of Real-time Obtaining, calculate virtual three-dimensional position more at least on the hook stick indentation part, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
13. Three-dimensional interaction system as claimed in claim 12 is characterized in that:
The indentation length of the hook stick head that uses during the virtual three-dimensional position of described second place determining unit calculating operation rod indentation part obtains in the following manner: determine the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, then calculate the indentation length of described hook stick head.
14. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described hook stick comprises:
Telescopic head;
Flexible sensing unit is used for detecting in real time the indentation length of hook stick telescopic head and sends the information of the indentation length that detects to communication unit and sends;
Communication unit be used for to be realized hook stick and is operated information interaction between the equipment.
15. Three-dimensional interaction system as claimed in claim 14 is characterized in that:
Described telescopic head comprises the operation caput and is resisted against elastomeric element between this operation caput and the flexible induction installation;
Described flexible sensing unit adopts pressure sensing mode to realize, is used for responding to the pressure of described elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
16. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
Described hook stick comprises telescopic head;
Described induction screen surface has been set up a pressure sensitive device, for detection of hook stick and induction screen when touching pressure and testing result sent to interaction control device, this pressure is corresponding with the indentation length of hook stick head.
17. Three-dimensional interaction system as claimed in claim 11 is characterized in that:
Described position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of Real-time Obtaining, comprising:
Three dimensional local information according to the hook stick of real-time reception, obtain or calculate the three-dimensional position of hook stick contact site, binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
18. Three-dimensional interaction system as claimed in claim 11 is characterized in that:
The image of the hook stick indentation part of described Image Rendering unit real-time rendering is stereo-picture, this stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera, to respond to screen as the parallax free face, draw out left image and the right image of described hook stick indentation part.
19. Three-dimensional interaction system as claimed in claim 1 is characterized in that:
The described equipment that is operated is smart mobile phone or panel computer.
20. such as claim 1 or 2 or 10 or 14 described Three-dimensional interaction systems, it is characterized in that:
The head of described hook stick is a tip away from an end of shell, and this tip has consisted of described hook stick contact site.
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103435980A CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
| US13/567,904 US20130117717A1 (en) | 2011-11-03 | 2012-08-06 | 3d user interaction system and method |
| KR1020120117778A KR101518727B1 (en) | 2011-11-03 | 2012-10-23 | A stereoscopic interaction system and stereoscopic interaction method |
| TW101139929A TWI530858B (en) | 2011-11-03 | 2012-10-29 | A three-dimensional interactive system and three-dimensional interactive method |
| JP2012239871A JP2013097805A (en) | 2011-11-03 | 2012-10-31 | Three-dimensional interactive system and three-dimensional interactive method |
| EP12190884.2A EP2590060A1 (en) | 2011-11-03 | 2012-10-31 | 3D user interaction system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103435980A CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102508562A CN102508562A (en) | 2012-06-20 |
| CN102508562B true CN102508562B (en) | 2013-04-10 |
Family
ID=46220662
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103435980A Expired - Fee Related CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102508562B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9971408B2 (en) | 2016-01-27 | 2018-05-15 | Ebay Inc. | Simulating touch in a virtual environment |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853364A (en) * | 2012-11-29 | 2014-06-11 | 联想(北京)有限公司 | Tactile feedback method, electronic device and tactile feedback system |
| CN106951074B (en) * | 2013-01-23 | 2019-12-06 | 青岛海信电器股份有限公司 | method and system for realizing virtual touch calibration |
| CN103995584B (en) * | 2014-04-29 | 2017-11-17 | 深圳超多维光电子有限公司 | Stereo interaction method and its display device, operation stick and system |
| CN104134235B (en) * | 2014-07-25 | 2017-10-10 | 深圳超多维光电子有限公司 | Real space and the fusion method and emerging system of Virtual Space |
| CN106371736B (en) * | 2016-01-08 | 2019-11-08 | 北京智谷睿拓技术服务有限公司 | Exchange method, interactive device and operation stick |
| CN105578174B (en) * | 2016-01-26 | 2018-08-24 | 神画科技（深圳）有限公司 | Interactive 3D display system and its 3D rendering generation method |
| CN107885432A (en) * | 2017-11-24 | 2018-04-06 | 杭州荔宝信息技术有限公司 | A kind of fetus three-dimension virtual reality man-machine interaction method and system |
| CN109491565B (en) * | 2018-10-30 | 2020-10-02 | 武汉思普崚技术有限公司 | Method and equipment for displaying component information of object in three-dimensional scene |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN101587386A (en) * | 2008-05-21 | 2009-11-25 | 深圳华为通信技术有限公司 | Method for processing cursor, Apparatus and system |
| CN102184063A (en) * | 2011-06-17 | 2011-09-14 | 北京欧顿科技有限公司 | Man-machine interactive system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100832355B1 (en) * | 2004-10-12 | 2008-05-26 | 니폰 덴신 덴와 가부시끼가이샤 | 3d pointing method, 3d display control method, 3d pointing device, 3d display control device, 3d pointing program, and 3d display control program |
| US8279168B2 (en) * | 2005-12-09 | 2012-10-02 | Edge 3 Technologies Llc | Three-dimensional virtual-touch human-machine interface system and method therefor |
-
2011
- 2011-11-03 CN CN2011103435980A patent/CN102508562B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101587386A (en) * | 2008-05-21 | 2009-11-25 | 深圳华为通信技术有限公司 | Method for processing cursor, Apparatus and system |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN102184063A (en) * | 2011-06-17 | 2011-09-14 | 北京欧顿科技有限公司 | Man-machine interactive system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9971408B2 (en) | 2016-01-27 | 2018-05-15 | Ebay Inc. | Simulating touch in a virtual environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102508562A (en) | 2012-06-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102426486B (en) | Stereo interaction method and operated apparatus | |
| CN102508562B (en) | Three-dimensional interaction system | |
| TWI530858B (en) | A three-dimensional interactive system and three-dimensional interactive method | |
| CN102830795B (en) | Utilize the long-range control of motion sensor means | |
| CN102779000B (en) | User interaction system and method | |
| JP3176588U (en) | Remote touch circuit and attachment | |
| US20150220158A1 (en) | Methods and Apparatus for Mapping of Arbitrary Human Motion Within an Arbitrary Space Bounded by a User's Range of Motion | |
| CN103744518A (en) | Stereoscopic interaction method, stereoscopic interaction display device and stereoscopic interaction system | |
| CN108431734A (en) | Touch feedback for non-touch surface interaction | |
| CN103339591A (en) | Apparatus and method for user input for controlling displayed information | |
| EP2558924B1 (en) | Apparatus, method and computer program for user input using a camera | |
| CN102508561B (en) | Operating rod | |
| KR20120068253A (en) | Method and apparatus for providing response of user interface | |
| EP3591503B1 (en) | Rendering of mediated reality content | |
| US11397478B1 (en) | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment | |
| CN110968190B (en) | IMU for touch detection | |
| US20150033157A1 (en) | 3d displaying apparatus and the method thereof | |
| CN102508563B (en) | Stereo interactive method and operated device | |
| CN205039917U (en) | Sea floor world analog system based on CAVE system | |
| CN104598035A (en) | Cursor display method based on 3D image display, intelligent equipment and intelligent system | |
| CN110968248B (en) | Generating a 3D model of a fingertip for visual touch detection | |
| CN104820492A (en) | Three-dimensional haptic system | |
| Varma et al. | Gestural interaction with three-dimensional interfaces; current research and recommendations | |
| CN213987444U (en) | Input system of near-to-eye display equipment | |
| CN112578983B (en) | Finger orientation touch detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Song Lei Inventor after: Liu Ning Inventor after: Ge Zhang Inventor before: Song Lei Inventor before: Liu Ning |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: SONG LEI LIU NING TO: SONG LEI LIU NING GE ZHANG |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180716 Address after: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Patentee after: SUPERD Co.,Ltd. Address before: 518053 H-1 Tung 101, overseas Chinese town, Nanshan District, Shenzhen, Guangdong. Patentee before: SHENZHEN SUPER PERFECT OPTICS Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130410 |