WO2023220071A3 - Systems, methods, and graphical user interfaces for scanning and modeling environments - Google Patents

Systems, methods, and graphical user interfaces for scanning and modeling environments Download PDF

Info

Publication number
WO2023220071A3
WO2023220071A3 PCT/US2023/021563 US2023021563W WO2023220071A3 WO 2023220071 A3 WO2023220071 A3 WO 2023220071A3 US 2023021563 W US2023021563 W US 2023021563W WO 2023220071 A3 WO2023220071 A3 WO 2023220071A3
Authority
WO
WIPO (PCT)
Prior art keywords
dimensional model
viewpoint
physical environment
scanning
systems
Prior art date
Application number
PCT/US2023/021563
Other languages
French (fr)
Other versions
WO2023220071A2 (en
Inventor
Allison W. DRYER
Giancarlo Yerkes
Praveen Sharma
Grant R. PAUL
Joseph A. MALIA
Original Assignee
Apple Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US18/144,746 external-priority patent/US20230368458A1/en
Application filed by Apple Inc. filed Critical Apple Inc.
Publication of WO2023220071A2 publication Critical patent/WO2023220071A2/en
Publication of WO2023220071A3 publication Critical patent/WO2023220071A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A computer system displays a preview of a three-dimensional model of a physical environment that includes a partially completed three-dimensional model of the physical environment that is displayed with a first orientation that corresponds to a first viewpoint of a user. The computer system detects first movement that changes a current viewpoint of the user in the physical environment to a second viewpoint and updates the preview of the three- dimensional model, including adding additional information to and rotating the partially completed three-dimensional model to a second orientation. While displaying a second view of the physical environment that corresponds to the second viewpoint, the computer system, in response to detecting a first input, updates the preview of the three-dimensional model in the first user interface, including rotating the partially completed three-dimensional model to a third orientation that does not correspond to the second viewpoint of the user.
PCT/US2023/021563 2022-05-10 2023-05-09 Systems, methods, and graphical user interfaces for scanning and modeling environments WO2023220071A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202263340444P 2022-05-10 2022-05-10
US63/340,444 2022-05-10
US18/144,746 2023-05-08
US18/144,746 US20230368458A1 (en) 2022-05-10 2023-05-08 Systems, Methods, and Graphical User Interfaces for Scanning and Modeling Environments

Publications (2)

Publication Number Publication Date
WO2023220071A2 WO2023220071A2 (en) 2023-11-16
WO2023220071A3 true WO2023220071A3 (en) 2024-01-11

Family

ID=86732306

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/021563 WO2023220071A2 (en) 2022-05-10 2023-05-09 Systems, methods, and graphical user interfaces for scanning and modeling environments

Country Status (1)

Country Link
WO (1) WO2023220071A2 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190221035A1 (en) * 2018-01-12 2019-07-18 International Business Machines Corporation Physical obstacle avoidance in a virtual reality environment
US20200184667A1 (en) * 2015-05-15 2020-06-11 4DMobile, LLC System for Volume Dimensioning Via Holographic Sensor Fusion
US20210097768A1 (en) * 2019-09-27 2021-04-01 Apple Inc. Systems, Methods, and Graphical User Interfaces for Modeling, Measuring, and Drawing Using Augmented Reality
US20210241483A1 (en) * 2020-02-03 2021-08-05 Apple Inc. Systems, Methods, and Graphical User Interfaces for Annotating, Measuring, and Modeling Environments
WO2021158427A1 (en) * 2020-02-03 2021-08-12 Apple Inc. Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US20210295602A1 (en) * 2020-03-17 2021-09-23 Apple Inc. Systems, Methods, and Graphical User Interfaces for Displaying and Manipulating Virtual Objects in Augmented Reality Environments
US20220091722A1 (en) * 2020-09-23 2022-03-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200184667A1 (en) * 2015-05-15 2020-06-11 4DMobile, LLC System for Volume Dimensioning Via Holographic Sensor Fusion
US20190221035A1 (en) * 2018-01-12 2019-07-18 International Business Machines Corporation Physical obstacle avoidance in a virtual reality environment
US20210097768A1 (en) * 2019-09-27 2021-04-01 Apple Inc. Systems, Methods, and Graphical User Interfaces for Modeling, Measuring, and Drawing Using Augmented Reality
US20210241483A1 (en) * 2020-02-03 2021-08-05 Apple Inc. Systems, Methods, and Graphical User Interfaces for Annotating, Measuring, and Modeling Environments
WO2021158427A1 (en) * 2020-02-03 2021-08-12 Apple Inc. Systems, methods, and graphical user interfaces for annotating, measuring, and modeling environments
US20210295602A1 (en) * 2020-03-17 2021-09-23 Apple Inc. Systems, Methods, and Graphical User Interfaces for Displaying and Manipulating Virtual Objects in Augmented Reality Environments
US20220091722A1 (en) * 2020-09-23 2022-03-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Also Published As

Publication number Publication date
WO2023220071A2 (en) 2023-11-16

Similar Documents

Publication Publication Date Title
US11227446B2 (en) Systems, methods, and graphical user interfaces for modeling, measuring, and drawing using augmented reality
US11727650B2 (en) Systems, methods, and graphical user interfaces for displaying and manipulating virtual objects in augmented reality environments
WO2022067083A3 (en) Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US9417784B2 (en) Multi display apparatus and method of controlling display operation
US8832588B1 (en) Context-inclusive magnifying area
US20130307796A1 (en) Touchscreen Device Integrated Computing System And Method
US11954245B2 (en) Displaying physical input devices as virtual objects
KR20160046150A (en) Apparatus and method for drawing and solving a figure content
US10129335B2 (en) Method and system for dynamic group creation in a collaboration framework
KR102131645B1 (en) Portable apparatus and method for sharing content thereof
US20220269338A1 (en) Augmented devices
JPH10320167A (en) Virtual space window display system
US11087560B2 (en) Normalization of objects for a 3D environment within an authoring application
US20200364941A1 (en) Content indicators in a 3d environment authoring application
US20230401798A1 (en) Accessible mixed reality applications
WO2023220071A3 (en) Systems, methods, and graphical user interfaces for scanning and modeling environments
JP2014241033A (en) Input processor, information processor, information processing system, input processing method, information processing method, input processing program and information processing program
KR101462419B1 (en) Terminal for drawing vector graphics
Agustina et al. Xpointer: an x-ray telepointer for relaxed-space-time wysiwis and unconstrained collaborative 3d design systems
US11880540B2 (en) Digital mark-up in a three dimensional environment
JP2001209826A (en) Method and device for editing virtual space, computer program storage medium and virtual reality presenting device
US20230196704A1 (en) Method for duplicating a graphical user interface (gui) element in a 3d scene
Xie et al. Natural Bare-Hand Interaction for Remote Operating Large Touch Screen.
TWD216535S (en) Graphic symbol for screen display
WO2024138117A1 (en) Methods and systems for displaying virtual elements in an xr environment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23729571

Country of ref document: EP

Kind code of ref document: A2