CN109545003A - A kind of display methods, device, terminal device and storage medium - Google Patents
A kind of display methods, device, terminal device and storage medium Download PDFInfo
- Publication number
- CN109545003A CN109545003A CN201811580594.2A CN201811580594A CN109545003A CN 109545003 A CN109545003 A CN 109545003A CN 201811580594 A CN201811580594 A CN 201811580594A CN 109545003 A CN109545003 A CN 109545003A
- Authority
- CN
- China
- Prior art keywords
- teaching mode
- teaching
- user
- information
- adjusted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of display methods, device, terminal device and storage mediums.The described method includes: the teaching mode constructed in advance is shown at the teaching position of augmented reality scene after listening to educational instruction；Obtain the location information of user；Teaching mode adjusted is determined with the teaching mode according to the positional information；The teaching mode adjusted is shown at the teaching position.Using this method, teaching mode can be adjusted according to customer position information, allow users to observe teaching mode from multi-angle of view, effectively improve the demonstration effect of teaching mode.By the technology of augmented reality in conjunction with body-building course, it is able to ascend the interest of body-building, improves the experience of user's study.
Description
Technical field
The present embodiments relate to augmented reality field more particularly to a kind of display methods, device, terminal device and
Storage medium.
Background technique
With the improvement of living standards, people increasingly pay attention to the health index of itself, people are usually in free time
Body-building is selected to take exercises, to build up health.Therefore, online private religion service has obtained widely universal.Body-building private religion can
Exercise guide is carried out for user by way of video teaching, so that user, which stays indoors, achievees the effect that body-building.
However, body-building course can not provide movement well for user mainly based on two-dimensional video on current line
Demonstration is unfavorable for user and imitates the study of movement, not good enough so as to cause user's training effect, or even in the process of movement
Injury significantly reduces the learning experience of user.
Summary of the invention
The embodiment of the invention provides a kind of display methods, device, terminal device and storage mediums, can effectively promote religion
Learn the demonstration effect of model.
In a first aspect, the embodiment of the invention provides a kind of display methods, comprising:
After listening to educational instruction, the teaching mode constructed in advance is shown at the teaching position of augmented reality scene；
Obtain the location information of user；
Teaching mode adjusted is determined with the teaching mode according to the positional information；
The teaching mode adjusted is shown at the teaching position.
Second aspect, the embodiment of the invention also provides a kind of display devices, comprising:
Just aobvious module shows the teaching mode constructed in advance in augmented reality scene after listening to educational instruction
Teaching position at；
Module is obtained, for obtaining the location information of user；
Determining module, for determining teaching mode adjusted with the teaching mode according to the positional information；
Display module, for showing the teaching mode adjusted at the teaching position.
The third aspect, the embodiment of the invention also provides a kind of terminal devices, comprising:
One or more processors；
Storage device, for storing one or more programs；
One or more of programs are executed by one or more of processors, so that one or more of processors
Realize display methods provided in an embodiment of the present invention.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer
Program, the program realize display methods provided in an embodiment of the present invention when being executed by processor.
The embodiment of the invention provides a kind of display methods, device, terminal device and storage mediums, first by listening to
After educational instruction, the teaching mode constructed in advance is shown at the teaching position of augmented reality scene；Secondly obtain user's
Location information；Then teaching mode adjusted is determined with the teaching mode according to the positional information；Finally by the tune
Teaching mode after whole is shown at the teaching position.It can be according to customer position information to teaching using above-mentioned technical proposal
Model is adjusted, and the teaching position of teaching mode is constant always, and terminal device can be according to customer position information to teaching mould
Type is adjusted, and such as adjusts the angle and/or size of teaching mode, so that the demonstration effect of teaching mode is effectively improved,
It allows users to observe teaching mode from multi-angle of view.In addition, by the technology of augmented reality in conjunction with body-building course, Neng Gouti
The interest for rising body-building improves the experience of user's study.
Detailed description of the invention
Fig. 1 is a kind of flow diagram for display methods that the embodiment of the present invention one provides；
Fig. 2 a is a kind of flow diagram of display methods provided by Embodiment 2 of the present invention；
Fig. 2 b shows the schematic diagram of the teaching mode of the offer of the present embodiment two；
Fig. 2 c shows the schematic diagram of teaching mode adjusted provided by Embodiment 2 of the present invention；
Fig. 3 is a kind of structural schematic diagram for display device that the embodiment of the present invention three provides；
Fig. 4 is a kind of structural schematic diagram for terminal device that the embodiment of the present invention four provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing or method described as flow chart.Although operations (or step) are described as the processing of sequence by flow chart,
Many of these operations can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of operations can be pacified again
Row.The processing can be terminated when its operations are completed, it is also possible to have the additional step being not included in attached drawing.Institute
Stating processing can correspond to method, function, regulation, subroutine, subprogram etc..
Embodiment one
Fig. 1 is a kind of flow diagram for display methods that the embodiment of the present invention one provides, and this method is applicable to impart knowledge to students
When, the case where carrying out teaching mode display, this method can be executed by display device, wherein the device can by software and/or
Hardware realization, and being typically integrated on terminal device, terminal device includes but is not limited in the present embodiment: mobile phone, computer and
The equipment such as personal digital assistant.
The application scenarios of the present embodiment can carry out the study of body-building course for user by observation teaching mode.Specifically
Ground, as shown in Figure 1, a kind of display methods that the embodiment of the present invention one provides, includes the following steps:
S101, after listening to educational instruction, the teaching mode constructed in advance is shown in the teaching position of augmented reality scene
Set place.
In the present embodiment, educational instruction can be understood as triggering the order imparted knowledge to students.Teaching mode can be managed
Solution is the model given lessons.Augmented reality scene can be understood as carrying out the environment that augmented reality is shown.Imparting knowledge to students position can be with
It is interpreted as the position that teaching mode is shown.
The present embodiment can be by showing teaching mode at the teaching position of augmented reality scene, for user's progress
The study of the content of courses.The augmented reality scene can be to pass through what terminal device constructed in advance, or terminal device knot
It closes what augmented reality product was presented, is not construed as limiting herein.
Wherein, the trigger means of educational instruction are not construed as limiting, and can be clicked corresponding key for user and be triggered educational instruction,
Triggering when being also possible to reach preset learning time.Teaching mode can be three-dimensional (3 D) manikin, which can
Think 3 D human body deformable model.The model that the model can be constructed in advance for terminal device, herein not to how constructing this
Teaching mode is defined, as long as the teaching mode can be imparted knowledge to students according to preset instruction.
The teaching mode constructed in advance is shown and is convenient in augmented reality scene after listening to educational instruction by this step
User observes teaching mode, can effectively solve the problem that user only observes the technical problem of imitation effect difference caused by two-dimensional video.
How to determine that teaching position is also not construed as limiting in this step, it, can also as the teaching position can be chosen for user
To be that terminal device is voluntarily chosen.Such as, the position that terminal device obtains that user chooses after listening to educational instruction is used as religion
Degree is set, or after listening to educational instruction terminal device to augmented reality scene carry out detection determine teaching position.
S102, the location information for obtaining user.
In the present embodiment, location information can be understood as the spatial positional information of user.This step can be existing in enhancing
The position of user is tracked in real field scape.
After teaching mode being shown at the teaching position of augmented reality scene, the position of the available user of this step
Information, can be adjusted based on the location information of user to teaching mode, so that user more comprehensively observes teaching
Model, to promote the learning effect of user.
The specific means for the location information for obtaining user is not defined herein, those skilled in the art can be according to reality
The suitable means of border situation selection determine the location information of user.It is used as this step can be obtained directly by station acquisition device
Family location information, can also be by analyze to image captured by the user acquired the location information of determining user in real time.
Station acquisition device may be considered the equipment that can obtain user location.Such as position sensor, GPS locator or inertia measurement
Unit.
S103, with the teaching mode teaching mode adjusted is determined according to the positional information.
After getting location information, this step can be adjusted teaching mode based on the location information of user.This step
It suddenly may include: that angle adjustment and/or size adjustment are carried out to teaching mode to the adjustment mode of teaching mode.Religion adjusted
Can only the angle of teaching mode and/or size be adjusted by learning model.
Specifically, after the present embodiment gets location information, user can be determined according to the location information and teaching mode
Relative to the relative position of teaching mode, teaching mode can be adjusted based on the relative position, by corresponding angle
Each user is presented, to realize the display of teaching mode different angle.
S104, the teaching mode adjusted is shown at the teaching position.
After determining teaching mode adjusted, teaching mode adjusted can be continued display in teaching position by this step
Place is set, so that user observes.It is understood that teaching mode adjusted is shown may be considered in teaching position
Secure the world coordinates of teaching mode, i.e., fixed position teaching mode being placed in augmented reality environment.
It is understood that if the location information of user changes, the angle and/or size of teaching mode adjusted
Also it will do it corresponding change, also reconstructed accordingly correspondingly, being presented on the augmented reality environment of user at the moment.
A kind of display methods that the embodiment of the present invention one provides, after first listening to educational instruction, the religion that will construct in advance
Model is learned to be shown at the teaching position of augmented reality scene；Secondly the location information of user is obtained；Then according to the position
Information and the teaching mode determine teaching mode adjusted；Finally the teaching mode adjusted is shown in the religion
Degree sets place.Using the above method, teaching mode can be adjusted according to customer position information, the teaching position of teaching mode
Set constant always, terminal device can be adjusted teaching mode according to customer position information, such as adjust the angle of teaching mode
Degree and/or size allow users to observe teaching from multi-angle of view to effectively improve the demonstration effect of teaching mode
Model.In addition, being able to ascend the interest of body-building by the technology of augmented reality in conjunction with body-building course, user's study is improved
Experience.
Embodiment two
Fig. 2 a is a kind of flow diagram of display methods provided by Embodiment 2 of the present invention, and the present embodiment two is above-mentioned each
It is optimized on the basis of embodiment.In the present embodiment, it will determine and adjust with the teaching mode according to the positional information
Teaching mode afterwards, is further detailed as: being based on the location information and the teaching mode, information is watched in determination attentively；It is based on
It is described to watch information attentively, determine teaching mode adjusted.
Further, the present embodiment, which also optimizes, includes: obtaining action control parameter；
Based on the action control parameter, the three-dimensional motion of the teaching mode shown at the teaching position is adjusted.
On the basis of above-mentioned optimization, the present embodiment, which also optimizes, includes: after listening to sign on, obtaining external environment
Initial image information；Extract the characteristic of the initial image information；It is corresponding described outer according to characteristic building
The augmented reality scene of boundary's environment.
Further, the present embodiment shows the teaching mode that will be constructed in advance in the teaching position of augmented reality scene
Place is set, is optimized are as follows: the initial image information is identified, determines position to be put；
Based on the position to be put, the teaching position in the augmented reality scene is determined；
The teaching mode constructed in advance is shown at the teaching position.
Further, the present embodiment will acquire the location information of user, optimization are as follows: obtain the measuring image letter of external environment
Breath；
The location information of user is determined according to the measuring image information and the initial image information
Further, it includes: the posture for obtaining the user of Inertial Measurement Unit monitoring that the embodiment of the present invention, which also optimizes,
Information；
The location information of the user is corrected according to the posture information.The not yet detailed content of the present embodiment please refers to reality
Apply example one.
As shown in Figure 2 a, a kind of display methods provided by Embodiment 2 of the present invention, includes the following steps:
S201, after listening to sign on, the initial image information of external environment is obtained.
In the present embodiment, sign on can be understood as the order for starting study.External environment can be understood as
User's local environment.Initial image information can be understood as the external environment that terminal device is obtained when constructing augmented reality scene
Image.Initial image information may include at least two images.
When user learns, terminal device can first listen to sign on, to enter teaching environment, then supervise again
Educational instruction is listened, to start to impart knowledge to students.The triggering mode of sign on is not defined in the present embodiment, as this starts to refer to
It enables to click for user and starts key triggering, triggering when being also possible to reach preset learning time.
After the present embodiment listens to sign on, academic environment can be constructed first, i.e. building augmented reality scene.Building
When augmented reality scene, this step can obtain the initial image information of external environment first.Herein not to acquisition external environment
Initial image information be defined, as terminal device can pass through image collecting device obtain external environment information.More have
Body, terminal device can star the initial image information that camera obtains external environment.
S202, the characteristic for extracting the initial image information.
In the present embodiment, characteristic can be understood as the location information of marker in initial image information.Herein not
Marker in initial image information is defined, marker can be determined according to the initial image information actually obtained.Mark
Knowing object can be understood as the position object of reference of initial image information.Pass through the position of marker in different moments initial image information
Information can be realized the effect of positioning.
This step can carry out identification to initial image information and extract characteristic, not limit specific processing hand herein
Section, those skilled in the art can corresponding means determines according to actual conditions.
S203, the augmented reality scene that the external environment is corresponded to according to characteristic building.
After extracting the characteristic in initial image information, this step can be matched each characteristic of acquisition
To construct the space transformational relation between initial image information, to construct augmented reality scene.Such as based on the same of same marker
Characteristic corresponding to one characteristic point determines space transformational relation.
S204, after listening to educational instruction, the initial image information is identified, determines position to be put.
In the present embodiment, position to be put can be understood as the teaching mode chosen from augmented reality scene placement
Position.
The trigger means of educational instruction are not construed as limiting, and can be triggered by user, can also be defaulted by terminal device and be triggered.
Such as, by clicking, corresponding key triggers educational instruction to user or terminal triggers teaching after having constructed augmented reality scene and refers to
It enables.
This step is not treated placement position and is defined, and such as position to be put can be plane.Therefore refer to listening to teaching
After order, image recognition can be carried out to initial image information, to identify the plane in augmented reality environment.
S205, it is based on the position to be put, determines the teaching position in the augmented reality scene.
After identifying position to be put, this step can determine augmented reality field based on the position to be put determined
Corresponding teaching position in scape.It is understood that position to be put may be considered the position chosen from initial image information
It sets, this step can select corresponding position as teaching position based on the position to be put in augmented reality scene.
It does not limit specifically determining means herein, can such as be converted based on the space in the augmented reality environment constructed in advance
Relationship determines the teaching position for corresponding to position to be put.
S206, the teaching mode constructed in advance is shown at the teaching position.
After determining teaching position, this step can be shown the teaching mode constructed in advance at the teaching position, with
It is observed for user.Specifically, this step can coordinate information progress of the world coordinates based on the teaching position to teaching mode
Setting.
S207, the measuring image information for obtaining external environment.
In the present embodiment, measuring image information can be understood as having constructed the external environment obtained after augmented reality scene
Image.The measuring image information can be used for carrying out space orientation to user.
After showing teaching mode in augmented reality scene, the location information of the available user of the present embodiment.Specifically,
This step can obtain the measuring image information of external environment first, to position to user.
This step does not limit the specific means for obtaining measuring image information, can such as be obtained by image collecting device.More
Add specifically, the measuring image information that terminal device can call rear camera to obtain external environment.
S208, the location information that user is determined according to the measuring image information and the initial image information.
After obtaining measuring image information, this step can be compared measuring image information and initial image information point
Analysis, determines the location information of user.Such as by carrying out position to like-identified object in measuring image information and initial image information
Analysis, determines the location information of user.
It is understood that the scene of the present embodiment can be with are as follows: user's hand-held terminal device, such as mobile phone are set by terminal
Standby rear camera carries out the Image Acquisition of external environment information, to realize the space orientation to user.
The particular content of location information is not defined herein, location information can be world coordinates, the angle of user
Information or velocity information.
S209, the posture information for obtaining the user that Inertial Measurement Unit monitors.
In the present embodiment, Inertial Measurement Unit can be understood as the device measured to customer position information.Posture
Information may include acceleration information and/or angular velocity information.
Inertial Measurement Unit may include three uniaxial accelerometers and three uniaxial gyros, and accelerometer can be examined
Acceleration signal of the user in world coordinate system is surveyed, gyro can detecte angular velocity signal of the user in world coordinate system.
Therefore this step terminal device can be by obtaining posture information of the user of Inertial Measurement Unit monitoring under world coordinate system, such as
Acceleration and acceleration, to calculate the posture of user, to realize space orientation.
S210, the location information that the user is corrected according to the posture information.
The present embodiment can obtain the location information of user by way of image and Inertial Measurement Unit fusion.
Specifically, this step can be used posture information and carry out error concealment to identified location information.Specifically, it repairs
Positive means can be not construed as limiting, and can determine modified specific means according to the particular content of location information.
It, can be using the position letter of weighted mean method amendment user if in location information including acceleration and angular speed
Breath.If location information is coordinate information, pair of preset posture information and location information can store in terminal device
It should be related to.The amendment to customer position information is realized based on the corresponding relationship and posture information.
S211, it is based on the location information and the teaching mode, information is watched in determination attentively.
In the present embodiment, watch the observed information that information can be understood as user to teaching mode attentively.Watching information attentively includes
Gaze angle and/or watch depth attentively etc., is not construed as limiting herein.Wherein, gaze angle can determine user's current fixation teaching mould
The position of type.Watching depth attentively can determine the distance of user's current distance teaching mode.The present embodiment be based on watch information attentively can
Determine the relative position of user and teaching mode.
After the location information for obtaining user, this step can determine user to the note of the teaching mode based on the location information
Visual information, with the teaching mode after being adjusted.
It is understood that can refresh at teaching position in real time and show according to the location information of user in the present embodiment
The teaching mode shown.When determining teaching mode adjusted, can location information based on user and last time adjustment teaching
Model watch attentively the determination of information.
S212, information is watched attentively based on described, determine teaching mode adjusted.
Obtain user watch information attentively after, this step can be watched attentively information and selected correspondence from model database based on this
Teaching mode adjusted.
Fig. 2 b shows the schematic diagram of the teaching mode of the offer of the present embodiment two.As shown in Figure 2 b, which is
Three-dimensional variable manikin, the teaching mode 21 can carry out the demonstration lesson of body-building course for user.
Fig. 2 c shows the schematic diagram of teaching mode adjusted provided by Embodiment 2 of the present invention.As shown in Figure 2 c, should
Teaching mode 22 adjusted can be for based on determined by location information and teaching mode 21.Specifically, when user is from teaching
After the front of model 21 is moved at 90 degree of the left side position of teaching mode 21, the location information of the user based on acquisition and
Teaching mode 21, the information of watching attentively determined can be to watch positive 90 degree of directions of teaching mode 21 attentively, i.e. right side.It is assumed herein that
It is clockwise positive direction.Teaching mode adjusted 22 as shown in Figure 2 c can be obtained by watching information attentively based on this.
S213, action control parameter is obtained.
In the present embodiment, action control parameter can be understood as the parameter moved for controlling teaching mode.Herein
Teaching mode do not limit adjustment before teaching mode or teaching mode adjusted.
Specifically, the available preset action control parameter of this step, the action control parameter can according to
Curricula selected by family determines, does not limit specific method of determination herein.
S214, it is based on the action control parameter, the three-dimensional for adjusting the teaching mode shown at the teaching position is dynamic
Make.
Terminal device obtain action control parameter after can based on the action control parameter to teaching position at currently show
The three-dimensional motion of the teaching mode shown is adjusted, so that teaching mode makes the movement specified in curricula, reaches movement
The effect of demonstration.
The execution sequence of S213 and S214 in the present embodiment is not construed as limiting, and the present embodiment can obtain action control in real time
Parameter with adjust be shown in teaching position at teaching mode movement.
S215, the teaching mode adjusted is shown at the teaching position.
After determining teaching mode adjusted, teaching mode adjusted can be continued display in teaching position by this step
Place is set, so that user observes.It is understood that the speed for refreshing teaching mode in the present embodiment at teaching position is big
In certain value, due to the persistence of vision, the teaching mode that user observes is adjusted according to customer position information real-time perfoming angle
Teaching mode.When watching scenery, optical signal is passed to cerebral nerve and needs by one of short duration time, the effect of light user
After, visual image does not disappear immediately, and this remaining vision is known as " after image ", this phenomenon of vision is properly termed as regarding
Feel persists.
Exemplary description is carried out to the embodiment of the present invention below:
Augmented reality, position tracking are used for body-building in conjunction with 3 D human body deformable model and moved by the embodiment of the present invention
Coach, allow users to watch three-dimensional (3 D) manikin from multiple angles, i.e. virtual fitness trainer, action modeling, guarantee
User to the study of movement imitate comprehensively, it is accurate, without dead angle.It effectively solves user in the prior art and watches two-dimensional video
When habit, action modeling can only be done from the coach in an angle view video, action message can not be obtained from multi-angle simultaneously, it is right
Action message study imitation impact, user study to it is non-type movement may cause user's training effect it is not good enough or by
The technical issues of hurting.
Specifically, it is then based in the use environment of user by the video image acquisition image data of mobile phone camera
Image data carries out characteristic point detection, matching, to calculate the space transformational relation between image, to construct augmented reality scene.
Plane is detected in augmented reality scene after having constructed augmented reality scene, 3 D human body deformable model is placed on the plane
At position, for user's observation.During user's observational learning, the image data and inertia measurement of mobile phone camera can be passed through
Device (Inertial measurement unit, IMU) sensing data tracks 3 D human body deformable model.Base
Augmented reality scene can be constructed in real time in the data that the image data and Inertial Measurement Unit of mobile phone camera monitor, and tracks three
The position of human body deformable model in space is tieed up, so that 3 D human body is deformable from corresponding camera perspective in real time by user
Model.
Terminal device is implemented to obtain the action control parameter of 3 D human body deformable model, changes 3 D human body deformable mold
The three-dimensional motion of type, so that 3 D human body deformable model completes the movement specified in course, user can see from camera perspective
3 D human body deformable model is examined, achievees the effect that action modeling.
A kind of display methods provided by Embodiment 2 of the present invention, embody determine teaching mode adjusted operation,
Show the operation of the operation of the teaching mode constructed in advance, the location information for obtaining user, also optimization includes that adjustment is three-dimensional dynamic
The operation of the location information of the operation of work, the operation for constructing augmented reality scene and amendment user.It can be based on using this method
The initial image information that user captures in real time constructs augmented reality scene, is then based on the augmented reality scene and determines teaching position
It sets.User determines teaching mode adjusted during study, based on the information of watching attentively determined in real time, is able to use family pair
Teaching mode different angle is observed, and the more true action modeling of user is brought.In addition, being shown in the religion at teaching position
The adjustment of three-dimensional motion can be carried out according to action control parameter by learning model, to impart knowledge to students to user's dynamic, by that will enhance
Reality technology, space orientation technique and teaching mode are combined for body-building action modeling, and user can lead in use environment
It crosses and changes different visual angles, realize the different physical feelings of different angle viewing teaching mode, user can be helped to obtain more
Action message, reach preferably study imitate effect, finally obtain better exercise experience.
Embodiment three
Fig. 3 is a kind of structural schematic diagram for display device that the embodiment of the present invention three provides, which is applicable to impart knowledge to students
When, carry out teaching mode display the case where, wherein the device can be implemented by software and/or hardware, and is typically integrated in terminal and sets
It is standby upper.
As shown in figure 3, the device includes: just to show module 31, obtain module 32, determining module 33 and display module 34；
Wherein, just aobvious module 31 shows the teaching mode constructed in advance existing in enhancing after listening to educational instruction
At the teaching position of real field scape；
Module 32 is obtained, for obtaining the location information of user；
Determining module 33, for determining teaching mode adjusted with the teaching mode according to the positional information；
Display module 34, for showing the teaching mode adjusted at the teaching position.
In the present embodiment, which passes through the religion that after just aobvious module 31 listens to educational instruction, will be constructed in advance first
Model is learned to be shown at the teaching position of augmented reality scene；Secondly by the location information for obtaining the acquisition user of module 32；So
Teaching mode adjusted is determined with the teaching mode according to the positional information by determining module 33 afterwards；Finally by aobvious
Show that module 34 shows the teaching mode adjusted at the teaching position.
A kind of display device is present embodiments provided, teaching mode can be adjusted according to customer position information, is taught
The teaching position for learning model is constant always, and terminal device can be adjusted teaching mode according to customer position information, such as adjusts
The angle and/or size of whole teaching mode allow users to effectively improve the demonstration effect of teaching mode from more
View is to teaching mode.In addition, it is able to ascend the interest of body-building by the technology of augmented reality in conjunction with body-building course,
Improve the experience of user's study.
Further, it is determined that module 33, is specifically used for: being based on the location information and the teaching mode, determination is watched attentively
Information；Information is watched attentively based on described, determines teaching mode adjusted.
On the basis of above-mentioned optimization, display device, optimization includes:
Movement adjustment module, for obtaining action control parameter；
Based on the action control parameter, the three-dimensional motion of the teaching mode shown at the teaching position is adjusted.
Based on the above-mentioned technical proposal, display device, optimization include:
Scenario building module, is used for: after listening to sign on, obtaining the initial image information of external environment；
Extract the characteristic of the initial image information；
According to the augmented reality scene of the corresponding external environment of characteristic building.
Further, module 31 is just shown, is specifically used for: the initial image information is identified, determine position to be put
It sets；
Based on the position to be put, the teaching position in the augmented reality scene is determined；
The teaching mode constructed in advance is shown at the teaching position.
Further, module 32 is obtained, is specifically used for:
Obtain the measuring image information of external environment；
The location information of user is determined according to the measuring image information and the initial image information.
Further, display device, optimization include:
Correction module is used for: obtaining the posture information of the user of Inertial Measurement Unit monitoring；
The location information of the user is corrected according to the posture information.
Display methods provided by any embodiment of the invention can be performed in above-mentioned display device, and it is corresponding to have execution method
Functional module and beneficial effect.
Example IV
Fig. 4 is a kind of structural schematic diagram for terminal device that the embodiment of the present invention four provides.As shown in figure 4, the present invention is real
The terminal device for applying the offer of example four includes: one or more processors 41 and storage device 42；Processor in the terminal device
41 can be one or more, in Fig. 4 by taking a processor 41 as an example；Storage device 42 is for storing one or more programs；
One or more of programs are executed by one or more of processors 41, so that one or more of processors 41 are realized
The display methods as described in any one of embodiment of the present invention.
The terminal device can also include: input unit 43 and output device 44.
Processor 41, storage device 42, input unit 43 and output device 44 in terminal device can by bus or
Other modes connect, in Fig. 4 for being connected by bus.
Storage device 42 in the terminal device is used as a kind of computer readable storage medium, can be used for storing one or more
A program, described program can be software program, computer executable program and module, such as the embodiment of the present invention one or two institutes
Corresponding program instruction/the module of display methods is provided (for example, the module in attached display device shown in Fig. 3, comprising: Chu Xianmo
Block 31 obtains module 32, determining module 33 and display module 34).Processor 41 is stored in storage device 42 by operation
Software program, instruction and module realize above-mentioned side thereby executing the various function application and data processing of terminal device
Display methods in method embodiment.
Storage device 42 may include storing program area and storage data area, wherein storing program area can storage program area,
Application program needed at least one function；Storage data area, which can be stored, uses created data etc. according to terminal device.
It can also include nonvolatile memory in addition, storage device 42 may include high-speed random access memory, for example, at least one
A disk memory, flush memory device or other non-volatile solid state memory parts.In some instances, storage device 42 can
It further comprise the memory remotely located relative to processor 41, these remote memories can be by network connection to setting
It is standby.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Input unit 43 can be used for receiving the number or character information of input, and generate the user setting with terminal device
And the related key signals input of function control.Output device 44 may include that display screen etc. shows equipment.
Also, when one or more included program of above-mentioned terminal device is held by one or more of processors 41
When row, program is proceeded as follows:
After listening to educational instruction, the teaching mode constructed in advance is shown at the teaching position of augmented reality scene；
Obtain the location information of user；
Teaching mode adjusted is determined with the teaching mode according to the positional information；
The teaching mode adjusted is shown at the teaching position.
Embodiment five
The embodiment of the present invention five provides a kind of computer readable storage medium, is stored thereon with computer program, the journey
For executing display methods when sequence is executed by processor, this method comprises:
After listening to educational instruction, the teaching mode constructed in advance is shown at the teaching position of augmented reality scene；
Obtain the location information of user；
Teaching mode adjusted is determined with the teaching mode according to the positional information；
The teaching mode adjusted is shown at the teaching position.
Optionally, it can be also used for executing display provided by any embodiment of the invention when which is executed by processor
Method.
The computer storage medium of the embodiment of the present invention, can be using any of one or more computer-readable media
Combination.Computer-readable medium can be computer-readable signal media or computer readable storage medium.It is computer-readable
Storage medium for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device or
Device, or any above combination.The more specific example (non exhaustive list) of computer readable storage medium includes: tool
There are electrical connection, the portable computer diskette, hard disk, random access memory (Random Access of one or more conducting wires
Memory, RAM), read-only memory (Read Only Memory, ROM), erasable programmable read only memory (Erasable
Programmable Read Only Memory, EPROM), flash memory, optical fiber, portable CD-ROM, light storage device, magnetic storage
Device or above-mentioned any appropriate combination.Computer readable storage medium, which can be, any includes or storage program has
Shape medium, the program can be commanded execution system, device or device use or in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited
In: electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can
Any computer-readable medium other than storage medium is read, which can send, propagates or transmit and be used for
By the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including but not limited to:
Wirelessly, electric wire, optical cable, radio frequency (Radio Frequency, RF) etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
It further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion
Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.?
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or
Wide area network (WAN) --- it is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service
Provider is connected by internet).
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of display methods characterized by comprising
After listening to educational instruction, the teaching mode constructed in advance is shown at the teaching position of augmented reality scene；
Obtain the location information of user；
Teaching mode adjusted is determined with the teaching mode according to the positional information；
The teaching mode adjusted is shown at the teaching position.
2. the method according to claim 1, wherein described true with the teaching mode according to the positional information
Fixed teaching mode adjusted, comprising:
Based on the location information and the teaching mode, information is watched in determination attentively；
Information is watched attentively based on described, determines teaching mode adjusted.
3. the method according to claim 1, wherein further include:
Obtain action control parameter；
Based on the action control parameter, the three-dimensional motion of the teaching mode shown at the teaching position is adjusted.
4. the method according to claim 1, wherein it is described listen to educational instruction before, further includes:
After listening to sign on, the initial image information of external environment is obtained；
Extract the characteristic of the initial image information；
According to the augmented reality scene of the corresponding external environment of characteristic building.
5. according to the method described in claim 4, it is characterized in that, the teaching mode that will be constructed in advance show it is existing in enhancing
At the teaching position of real field scape, comprising:
The initial image information is identified, determines position to be put；
Based on the position to be put, the teaching position in the augmented reality scene is determined；
The teaching mode constructed in advance is shown at the teaching position.
6. according to the method described in claim 4, it is characterized in that, the location information for obtaining user, comprising:
Obtain the measuring image information of external environment；
The location information of user is determined according to the measuring image information and the initial image information.
7. according to the method described in claim 6, it is characterized by further comprising:
Obtain the posture information of the user of Inertial Measurement Unit monitoring；
The location information of the user is corrected according to the posture information.
8. a kind of display device characterized by comprising
Just the teaching mode constructed in advance is shown the religion in augmented reality scene after listening to educational instruction by aobvious module
Degree sets place；
Module is obtained, for obtaining the location information of user；
Determining module, for determining teaching mode adjusted with the teaching mode according to the positional information；
Display module, for showing the teaching mode adjusted at the teaching position.
9. a kind of terminal device characterized by comprising
One or more processors；
Storage device, for storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
The now display methods as described in any in claim 1-7.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The display methods as described in any in claim 1-7 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811580594.2A CN109545003B (en) | 2018-12-24 | 2018-12-24 | Display method, display device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811580594.2A CN109545003B (en) | 2018-12-24 | 2018-12-24 | Display method, display device, terminal equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109545003A true CN109545003A (en) | 2019-03-29 |
| CN109545003B CN109545003B (en) | 2022-05-03 |
Family
ID=65856692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811580594.2A Active CN109545003B (en) | 2018-12-24 | 2018-12-24 | Display method, display device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109545003B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111323007A (en) * | 2020-02-12 | 2020-06-23 | 北京市商汤科技开发有限公司 | Positioning method and device, electronic equipment and storage medium |
| CN111818265A (en) * | 2020-07-16 | 2020-10-23 | 北京字节跳动网络技术有限公司 | Interaction method and device based on augmented reality model, electronic equipment and medium |
| CN112530219A (en) * | 2020-12-14 | 2021-03-19 | 北京高途云集教育科技有限公司 | Teaching information display method and device, computer equipment and storage medium |
| CN113656624A (en) * | 2021-10-18 | 2021-11-16 | 深圳江财教育科技有限公司 | Teaching equipment control method and system based on augmented reality and storage medium |
| CN113900526A (en) * | 2021-10-29 | 2022-01-07 | 深圳Tcl数字技术有限公司 | Three-dimensional human body image display control method and device, storage medium and display equipment |
Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103337079A (en) * | 2013-07-09 | 2013-10-02 | 广州新节奏智能科技有限公司 | Virtual augmented reality teaching method and device |
| CN103345357A (en) * | 2013-07-31 | 2013-10-09 | 关鸿亮 | Method for realizing automatic street view display based on mobile equipment sensor |
| CN104995665A (en) * | 2012-12-21 | 2015-10-21 | Metaio有限公司 | Method for representing virtual information in a real environment |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| US20170061693A1 (en) * | 2015-09-02 | 2017-03-02 | Jeffrey Kohler | Augmented-reality imaging |
| CN106796453A (en) * | 2014-10-07 | 2017-05-31 | 微软技术许可有限责任公司 | Projecting apparatus is driven to generate the experience of communal space augmented reality |
| TW201729164A (en) * | 2016-02-05 | 2017-08-16 | 黃宇軒 | Systems and applications for generating augmented reality images |
| US20170367771A1 (en) * | 2015-10-14 | 2017-12-28 | Surgical Theater LLC | Surgical Navigation Inside A Body |
| CN107622524A (en) * | 2017-09-29 | 2018-01-23 | 百度在线网络技术（北京）有限公司 | Display methods and display device for mobile terminal |
| US20180053338A1 (en) * | 2016-08-19 | 2018-02-22 | Gribbing Oy | Method for a user interface |
| CN107833283A (en) * | 2017-10-30 | 2018-03-23 | 努比亚技术有限公司 | A kind of teaching method and mobile terminal |
| CN107833238A (en) * | 2017-11-14 | 2018-03-23 | 京东方科技集团股份有限公司 | Largest connected field mark method, method for tracking target, augmented reality/virtual reality device |
| CN107943301A (en) * | 2017-12-18 | 2018-04-20 | 快创科技（大连）有限公司 | Experiencing system is viewed and admired in a kind of house-purchase based on AR technologies |
| CN107961524A (en) * | 2017-12-29 | 2018-04-27 | 武汉艺术先生数码科技有限公司 | Body-building game and training system based on AR |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN108198044A (en) * | 2018-01-30 | 2018-06-22 | 北京京东金融科技控股有限公司 | Methods of exhibiting, device, medium and the electronic equipment of merchandise news |
| CN108235764A (en) * | 2017-12-29 | 2018-06-29 | 深圳前海达闼云端智能科技有限公司 | Information processing method, device, cloud processing equipment and computer program product |
| CN108427498A (en) * | 2017-02-14 | 2018-08-21 | 深圳梦境视觉智能科技有限公司 | A kind of exchange method and device based on augmented reality |
| CN108428375A (en) * | 2017-02-14 | 2018-08-21 | 深圳梦境视觉智能科技有限公司 | A kind of teaching auxiliary and equipment based on augmented reality |
| CN108510592A (en) * | 2017-02-27 | 2018-09-07 | 亮风台（上海）信息科技有限公司 | The augmented reality methods of exhibiting of actual physical model |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108553888A (en) * | 2018-03-29 | 2018-09-21 | 广州汉智网络科技有限公司 | Augmented reality exchange method and device |
| US10134296B2 (en) * | 2013-10-03 | 2018-11-20 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
-
2018
- 2018-12-24 CN CN201811580594.2A patent/CN109545003B/en active Active
Patent Citations (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104995665A (en) * | 2012-12-21 | 2015-10-21 | Metaio有限公司 | Method for representing virtual information in a real environment |
| CN103337079A (en) * | 2013-07-09 | 2013-10-02 | 广州新节奏智能科技有限公司 | Virtual augmented reality teaching method and device |
| CN103345357A (en) * | 2013-07-31 | 2013-10-09 | 关鸿亮 | Method for realizing automatic street view display based on mobile equipment sensor |
| US10134296B2 (en) * | 2013-10-03 | 2018-11-20 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| CN106796453A (en) * | 2014-10-07 | 2017-05-31 | 微软技术许可有限责任公司 | Projecting apparatus is driven to generate the experience of communal space augmented reality |
| US20170061693A1 (en) * | 2015-09-02 | 2017-03-02 | Jeffrey Kohler | Augmented-reality imaging |
| US20170367771A1 (en) * | 2015-10-14 | 2017-12-28 | Surgical Theater LLC | Surgical Navigation Inside A Body |
| TW201729164A (en) * | 2016-02-05 | 2017-08-16 | 黃宇軒 | Systems and applications for generating augmented reality images |
| US20180053338A1 (en) * | 2016-08-19 | 2018-02-22 | Gribbing Oy | Method for a user interface |
| CN106355153A (en) * | 2016-08-31 | 2017-01-25 | 上海新镜科技有限公司 | Virtual object display method, device and system based on augmented reality |
| CN108427498A (en) * | 2017-02-14 | 2018-08-21 | 深圳梦境视觉智能科技有限公司 | A kind of exchange method and device based on augmented reality |
| CN108428375A (en) * | 2017-02-14 | 2018-08-21 | 深圳梦境视觉智能科技有限公司 | A kind of teaching auxiliary and equipment based on augmented reality |
| CN108510592A (en) * | 2017-02-27 | 2018-09-07 | 亮风台（上海）信息科技有限公司 | The augmented reality methods of exhibiting of actual physical model |
| CN107622524A (en) * | 2017-09-29 | 2018-01-23 | 百度在线网络技术（北京）有限公司 | Display methods and display device for mobile terminal |
| CN107833283A (en) * | 2017-10-30 | 2018-03-23 | 努比亚技术有限公司 | A kind of teaching method and mobile terminal |
| CN107833238A (en) * | 2017-11-14 | 2018-03-23 | 京东方科技集团股份有限公司 | Largest connected field mark method, method for tracking target, augmented reality/virtual reality device |
| CN107977080A (en) * | 2017-12-05 | 2018-05-01 | 北京小米移动软件有限公司 | Product uses methods of exhibiting and device |
| CN107943301A (en) * | 2017-12-18 | 2018-04-20 | 快创科技（大连）有限公司 | Experiencing system is viewed and admired in a kind of house-purchase based on AR technologies |
| CN108235764A (en) * | 2017-12-29 | 2018-06-29 | 深圳前海达闼云端智能科技有限公司 | Information processing method, device, cloud processing equipment and computer program product |
| CN107961524A (en) * | 2017-12-29 | 2018-04-27 | 武汉艺术先生数码科技有限公司 | Body-building game and training system based on AR |
| CN108198044A (en) * | 2018-01-30 | 2018-06-22 | 北京京东金融科技控股有限公司 | Methods of exhibiting, device, medium and the electronic equipment of merchandise news |
| CN108520552A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108553888A (en) * | 2018-03-29 | 2018-09-21 | 广州汉智网络科技有限公司 | Augmented reality exchange method and device |
Non-Patent Citations (1)
| Title |
|---|
| AR酱: "https://www.sohu.com/a/218885442_335284，AR+健身：高科技拯救死肥宅", 《搜狐网》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111323007A (en) * | 2020-02-12 | 2020-06-23 | 北京市商汤科技开发有限公司 | Positioning method and device, electronic equipment and storage medium |
| CN111323007B (en) * | 2020-02-12 | 2022-04-15 | 北京市商汤科技开发有限公司 | Positioning method and device, electronic equipment and storage medium |
| CN111818265A (en) * | 2020-07-16 | 2020-10-23 | 北京字节跳动网络技术有限公司 | Interaction method and device based on augmented reality model, electronic equipment and medium |
| CN111818265B (en) * | 2020-07-16 | 2022-03-04 | 北京字节跳动网络技术有限公司 | Interaction method and device based on augmented reality model, electronic equipment and medium |
| CN112530219A (en) * | 2020-12-14 | 2021-03-19 | 北京高途云集教育科技有限公司 | Teaching information display method and device, computer equipment and storage medium |
| CN113656624A (en) * | 2021-10-18 | 2021-11-16 | 深圳江财教育科技有限公司 | Teaching equipment control method and system based on augmented reality and storage medium |
| CN113900526A (en) * | 2021-10-29 | 2022-01-07 | 深圳Tcl数字技术有限公司 | Three-dimensional human body image display control method and device, storage medium and display equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109545003B (en) | 2022-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109545003A (en) | A kind of display methods, device, terminal device and storage medium | |
| CN109191588B (en) | Motion teaching method, motion teaching device, storage medium and electronic equipment | |
| US20180357472A1 (en) | Systems and methods for creating target motion, capturing motion, analyzing motion, and improving motion | |
| US9520072B2 (en) | Systems and methods for projecting images onto an object | |
| US8282481B2 (en) | System and method for cyber training of martial art on network | |
| CN105807931B (en) | A kind of implementation method of virtual reality | |
| CN107066082B (en) | Display methods and device | |
| US9082312B2 (en) | Physical activity instructional apparatus | |
| KR20130098770A (en) | Expanded 3d space based virtual sports simulation system | |
| KR20030085275A (en) | Golf swing motion montoring method and system | |
| US20170092223A1 (en) | Three-dimensional simulation system for generating a virtual environment involving a plurality of users and associated method | |
| US20220277506A1 (en) | Motion-based online interactive platform | |
| CN107281710A (en) | A kind of method of remedial action error | |
| JP6656382B2 (en) | Method and apparatus for processing multimedia information | |
| CN105824417B (en) | human-object combination method adopting virtual reality technology | |
| CN105797378A (en) | Game video realizing method based on virtual reality technology | |
| CN114022512A (en) | Exercise assisting method, apparatus and medium | |
| CN107256082B (en) | Throwing object trajectory measuring and calculating system based on network integration and binocular vision technology | |
| Zhang et al. | Exploring virtual environments by visually impaired using a mixed reality cane without visual feedback | |
| Kirakosian et al. | Near-contact person-to-3d character dance training: Comparing ar and vr for interactive entertainment | |
| US11049321B2 (en) | Sensor-based object tracking and monitoring | |
| US20230162458A1 (en) | Information processing apparatus, information processing method, and program | |
| CN106708266A (en) | AR action correction projection method and system based on binocular gesture recognition | |
| CN104933278B (en) | A kind of multi-modal interaction method and system for disfluency rehabilitation training | |
| CN117078976B (en) | Action scoring method, action scoring device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |