WO2024117524A1

WO2024117524A1 - Electronic device for displaying media content, and method therefor

Info

Publication number: WO2024117524A1
Application number: PCT/KR2023/015660
Authority: WO
Inventors: 권오윤; 윤지희; 주종성; 한재현; 김동호; 박성진; 이선기; 이승룡; 이지민
Original assignee: 삼성전자주식회사
Priority date: 2022-12-02
Filing date: 2023-10-12
Publication date: 2024-06-06

Abstract

A processor of a wearable device according to an embodiment may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. The processor may display, on a display, a first visual object including images of different points within the path. The processor may display, on the basis of at least one of a time period or point at which the one or more events occurred, one or more second visual objects representing the one or more events in connection with the first visual object.

Description

Electronic device and method for displaying media content

This present disclosure relates to an electronic device and method for displaying media content.

To provide an enhanced user experience, we provide augmented reality (AR) services that display computer-generated information in conjunction with external objects in the real-world. Electronic devices are being developed. The electronic device may be a wearable device that can be worn by a user. For example, the electronic device may be AR glasses and/or a head-mounted device (HMD).

According to one embodiment, a wearable device may include a display and a processor. The processor may identify media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched. The processor may display, on the display, a first visual object including images of different places within the route. The processor may display one or more second visual objects representing the one or more events in association with the first visual object, based on at least one of a time period or point at which the one or more events occurred.

According to one embodiment, a method of using a wearable device may include identifying media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched. The method of the wearable device may include displaying, on a display, a first visual object including images of different points in the path. The method of the wearable device displays one or more second visual objects expressing the one or more events in association with the first visual object, based on at least one of a time interval or point at which the one or more events occurred. Can include actions.

According to one embodiment, in a computer-readable storage medium storing one or more programs, when the one or more programs are executed by a processor of a wearable device, the one or more programs are stored in a path of an external electronic device and in the external electronic device. One or more events generated by may cause the processor of the wearable device to identify matched media content. The one or more programs, when executed by the processor of the wearable device, can cause the processor of the wearable device to display, on a display, a first visual object containing images for different points in the path. there is. The one or more programs, when executed by the processor of the wearable device, represent the one or more events in association with the first visual object based on at least one of a time interval or point at which the one or more events occurred. and cause the processor of the wearable device to display one or more second visual objects.

Figure 1 shows an example of a screen displayed through a wearable device, according to an embodiment.

Figure 2 shows an example of a block diagram of a wearable device, according to an embodiment.

FIG. 3A shows an example of a perspective view of a wearable device, according to an embodiment.

FIG. 3B illustrates an example of one or more hardware disposed within a wearable device, according to an embodiment.

4A to 4B show an example of the appearance of a wearable device, according to an embodiment.

Figure 5 shows an example of a screen displayed through a wearable device, according to an embodiment.

FIG. 6A shows an example of a screen displayed through a wearable device, according to an embodiment.

FIG. 6B shows an example of a screen displayed through a wearable device, according to an embodiment.

Figure 7 shows an example of a screen displayed through a wearable device, according to an embodiment.

Figure 8 shows an example of a screen displayed through a wearable device, according to an embodiment.

Figure 9 shows an example of a screen displayed through a wearable device, according to an embodiment.

Figure 10 shows an example of a screen displayed through a wearable device and an electronic device, according to an embodiment.

Figure 11 shows an example of a flowchart regarding the operation of a wearable device, according to an embodiment.

Figure 12 shows an example of a flowchart regarding the operation of a wearable device, according to an embodiment.

Figure 13 is an example diagram of a network environment related to the metaverse service.

Hereinafter, various embodiments of this document are described with reference to the attached drawings.

The various embodiments of this document and the terms used herein are not intended to limit the technology described in this document to a specific embodiment, and should be understood to include various changes, equivalents, and/or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar components. Singular expressions may include plural expressions, unless the context clearly dictates otherwise. In this document, expressions such as “A or B”, “at least one of A and/or B”, “A, B or C” or “at least one of A, B and/or C” refer to all of the items listed together. Possible combinations may be included. Expressions such as "first", "second", "first" or "second" can modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another. The components are not limited. When a component (e.g., a first) component is said to be "connected (functionally or communicatively)" or "connected" to another (e.g., second) component, it means that the component is connected to the other component. It may be connected directly to the component or may be connected through another component (e.g., a third component).

The term “module” used in this document includes a unit comprised of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrated part, a minimum unit that performs one or more functions, or a part thereof. For example, a module may be comprised of an application-specific integrated circuit (ASIC).

Figure 1 shows an example of a screen displayed through a wearable device, according to an embodiment. Referring to FIG. 1 , the wearable device 101 according to one embodiment may include a head-mounted display (HMD) that is wearable on the head of the user 110. Although the outer appearance of the wearable device 101 in the form of glasses is shown, the embodiment is not limited thereto. An example of the structure of the wearable device 101 that can be worn on the head of the user 110 is described with reference to FIGS. 3A to 3B and/or 4A to 4B. One or more pieces of hardware included in the wearable device 101 are exemplarily described with reference to FIG. 2 .

According to one embodiment, the wearable device 101 may execute functions related to augmented reality (AR) and/or mixed reality (MR). Referring to FIG. 1 , when the user 110 is wearing the wearable device 101, the wearable device 101 may include at least one lens disposed adjacent to the eye of the user 110. The wearable device 101 may combine light emitted from the display of the wearable device 101 with ambient light passing through the lens. The display area of the display may be formed within a lens through which ambient light passes. Because the wearable device 101 combines the ambient light and the light emitted from the display, the user 110 can see a real object perceived by the ambient light and the light emitted from the display. You can see an image in which the formed virtual objects are mixed.

According to one embodiment, the wearable device 101 may execute functions related to video see-through (VST) and/or virtual reality (VR). Referring to FIG. 1 , when the user 110 is wearing the wearable device 101, the wearable device 101 may include a housing that covers the eyes of the user 110. In this state, the wearable device 101 may include a display disposed on a first side facing the eye. The wearable device 101 may include a camera disposed on a second side opposite to the first side. Using the camera, the wearable device 101 can obtain frames containing ambient light. The wearable device 101 may output the frames in a display disposed on the first side, allowing the user 110 to recognize the ambient light through the display. The display area of the display disposed on the first side may be formed by one or more pixels included in the display. The wearable device 101 can display a screen based on media content through the display. For example, the media content may include a screen 105 and

visual objects

120, 130, 140, and 150, which will be described later. For example, the media content may include one (a) media content expressed within a virtual space.

According to one embodiment, the wearable device 101 may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. For example, the external electronic device may include a terminal that is owned by a user. For example, the terminal may include personal computers (PCs) such as laptops and desktops, smartphones, smartpads, tablet PCs, and smart accessories such as smartwatches. You can. For example, one or more events generated by the external electronic device may include an event of acquiring an image (eg, photo) through a camera of the external electronic device. For example, one or more events generated by the external electronic device may include an event of playing music using the external electronic device. For example, one or more events generated by the external electronic device may include an event of playing a video using the external electronic device. For example, one or more events generated by the external electronic device may include an event of acquiring video using the external electronic device. For example, one or more events generated by the external electronic device may include sending a message to a second external electronic device that is different from the external electronic device that is the first external electronic device, using the external electronic device, or 2 May include an event for receiving a message from an external electronic device. For example, one or more events generated by the external electronic device may be related to a software application executed by the external electronic device. For example, the software application executed by the external electronic device may be a software application for playing music, a software application for playing a video, a software application for taking a photo, a software application for taking a video, and/or the above. It may include a software application for communicating with an external electronic device that is different from the external electronic device. One or more events generated by the external electronic device are not limited to the above.

According to one embodiment, the wearable device 101 may display a first visual object 120 including images of different places within the path of the external electronic device on the display. For example, the images may be displayed based on a 3-dimensional virtual coordinate system. For example, the first visual object 120 may be a visual object that represents the passage of time, such as a timeline, or that represents the movement of an external electronic device within the path. For example, the first visual object 120 may be a visual object representing a sequence of a plurality of images. For example, the wearable device 101 may identify images within a specified time interval, such as a first image corresponding to a first time interval and/or a second image corresponding to a second time interval, among the plurality of images. An image corresponding to the location of the external electronic device may be displayed in the first visual object 120. For example, the images may include images corresponding to a specific location identified based on geographic information. For example, the path may include a path along which an external electronic device moves. For example, the wearable device 101 may display a first visual object 120 including images for representing at least part of the path. According to one embodiment, the wearable device 101 may sequentially display images included in the first visual object 120. According to one embodiment, the wearable device 101 may display a bar 125 overlapping with the first visual object 120. For example, the bar 125 may indicate that it displays one of images. The wearable device 101 can control the playback of media content or change the playback time section based on an input that changes the position of the bar 125. For example, the wearable device 101 may display a visual object, such as a progress bar, to indicate the progress of media content, indicating that it is displaying one of the images.

According to one embodiment, the wearable device 101 includes a second device that expresses the one or more events in connection with the first visual object 120, based on at least one of the time interval or point where the one or more events occurred. Visual objects 130 may be displayed. For example, the wearable device 101 may display second visual objects 130 corresponding to the time interval in which the one or more events occurred. For example, the second visual objects 130 may be visual objects that indicate a time period in which one or more events occurred. For example, the wearable device 101 may display second visual objects 130 corresponding to each of the points where the one or more events occurred. For example, the second visual objects 130 may include text indicating the one or more events. The wearable device 101 may display the second visual objects 130 based on different colors. For example, the wearable device 101 may display a second visual object 130-1 corresponding to a first color, a second visual object 130-2 corresponding to a second color, and a first visual object 130-2 corresponding to a third color. The second visual object 130-3 and/or the second visual object 130-4 corresponding to the fourth visual object may be displayed. The number of second visual objects 130 and/or the colors representing the second visual objects 130 are not limited. According to one embodiment, the wearable device 101 may identify an input indicating selection of one of the second visual objects 130. The wearable device 101 may perform an operation related to the selected event based on the input. An example of performing an operation based on an input indicating selection of one of the second visual objects 130 will be described later with reference to FIGS. 6A and 6B.

According to one embodiment, the wearable device 101 may display a third visual object 140 for displaying geographical information. For example, the wearable device 101 may display the path of an external electronic device within the third visual object 140. For example, the wearable device 101 may display the third visual object 140 based on a 2-dimensional virtual coordinate system. For example, the wearable device 101 may display a third visual object 140 for indicating geographic information such as a plan map. For example, the wearable device 101 may display the third visual object 140 within at least a partial area of the screen 105. For example, the wearable device 101 may display a location (or point) where one or more events occur within the third visual object 140. According to one embodiment, the wearable device 101 may change the size of the third visual object 140. The wearable device 101 can identify the input for the third visual object 140. For example, the wearable device 101 may enlarge the size of the third visual object 140 based on an input to the third visual object 140. For example, the wearable device 101 may reduce the size of the third visual object 140 based on an input to the third visual object 140. An example of an operation for adjusting the size of the third visual object 140 will be described later with reference to FIG. 7 .

According to one embodiment, the wearable device 101 may display fourth visual objects 150 on the screen 105 to change the screen 105. For example, the screen 105 may be displayed based on a three-dimensional virtual coordinate system. The wearable device 101 moves from the screen 105 to the direction in which one of the fourth visual objects 150 is oriented, based on an input to one of the fourth visual objects 150. You can change to the corresponding screen. For example, the wearable device 101 may display fourth visual objects 150 indicating directions, such as arrows and/or triangles. The wearable device 101 may change the screen 105 based on an input to one of the fourth visual objects 150. The wearable device 101 displays a screen different from the screen 105 corresponding to the direction indicated by the fourth visual objects 150, based on an input to one of the fourth visual objects 150. can be displayed.

As described above, the wearable device 101 according to one embodiment may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. The wearable device 101 may display a first visual object 120 containing images of different points within the path of the external electronic device while displaying the screen 105 related to the media content. . The wearable device 101 may display one or more second visual objects expressing the one or more events in connection with the first visual object 120, based on at least one of a visual section or point in which the one or more events occurred. (130) can be displayed. The wearable device 101 may display a screen 105 related to media content based on movement of an external electronic device by displaying the first visual object 120 and the second visual object. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying a screen 105 related to the media content.

Figure 2 shows an example of a block diagram of a wearable device, according to an embodiment. The wearable device 101 of FIG. 2 may include the wearable device 101 of FIG. 1 .

Referring to FIG. 2 , the wearable device 101 according to an embodiment may include at least one of a processor 210, a display 220, a communication circuit 230, or a memory 240. Processor 210, display 220, communication circuitry 230, and memory 240 are electrically and/or operative with each other by electronic components, such as a communication bus 205. Can be electronically and/or operably coupled with each other. Hereinafter, hardware being operatively combined may mean that a direct connection or an indirect connection between the hardware is established wired or wirelessly so that the second hardware is controlled by the first hardware among the hardware. Although shown in different blocks, the embodiment is not limited thereto. Some of the hardware in FIG. 2 (e.g., the processor 210, the communication circuit 230, and at least a portion of the memory 240) may be included in a single integrated circuit, such as a system on a chip (SoC). there is. The type and/or number of hardware included in the wearable device 101 is not limited to that shown in FIG. 2 . For example, the wearable device 101 may include only some of the hardware shown in FIG. 2 .

According to one embodiment, the wearable device 101 may include hardware for processing data based on one or more instructions. For example, hardware for processing data may include the processor 210. For example, hardware for processing data may include an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and/or an application processor (AP). may include. The processor 210 has the structure of a single-core processor, or is a multi-core processor such as dual core, quad core, hexa core, or octa core. It can have a structure of The operations of FIG. 1 and/or the operations described below may be performed by the processor 210.

According to one embodiment, the display 220 of the wearable device 101 may output visualized information to the user. For example, the display 220 is controlled by the processor 210 including a circuit such as a graphic processing unit (GPU), and can output visualized information to the user. The display 220 may include a flat panel display (FPD) and/or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and/or one or more light emitting diodes (LED). The LED may include an organic LED (OLED).

According to one embodiment, the communication circuit 230 of the wearable device 101 may include hardware components to support transmission and/or reception of electrical signals between the wearable device 101 and an external electronic device. For example, the communication circuit 230 may include at least one of a modem (MODEM), an antenna, and an optical/electronic (O/E) converter. The communication circuit 230 includes Ethernet, LAN (local area network), WAN (wide area network), WiFi (wireless fidelity), Bluetooth, BLE (Bluetooth low energy), ZigBee, and LTE (long term). evolution) and 5G NR (5th generation ne radio) may support transmission and/or reception of electrical signals based on various types of protocols.

According to one embodiment, the memory 240 of the wearable device 101 may include components for storing data and/or instructions input and/or output to the processor 210 of the wearable device 101. there is. For example, the memory 240 may include volatile memory such as random-access memory (RAM) and/or non-volatile memory such as read-only memory (ROM). there is. For example, volatile memory may include at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). For example, non-volatile memory includes programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disk, solid state drive (SSD), and embedded multi-media (eMMC). card) may be included. According to one embodiment, the wearable device 101 may generate media content based on information (or data) transmitted from an external electronic device. For example, the wearable device 101 may store the generated media content in the memory 240. The operation of generating the media content is described later with reference to FIG. 12. The wearable device 101 can output the media content through the display 220 by executing it. For example, the operation of outputting through the display 220 may be an operation of displaying a screen within the display 220.

According to one embodiment, the wearable device 101 may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. For example, the path of the external electronic device and/or one or more events generated by the external electronic device may be received from the external electronic device through the communication circuit 230. The wearable device 101 displays a screen (e.g., the screen in FIG. 1) related to the media content through the display 220, based on identifying media content to which the path of the external electronic device and the one or more events are matched. (105)) can be displayed.

According to one embodiment, the wearable device 101 displays, through the display 220, a first visual object (e.g., the first visual object in FIG. 1) containing images of different points in the path of the external electronic device. 120)) can be displayed. The wearable device 101 may display images corresponding to the path of the external electronic device within the first visual object. For example, the images may be displayed using a three-dimensional virtual coordinate system.

According to one embodiment, the wearable device 101 displays one or more second visual objects representing one or more events generated by an external electronic device in conjunction with the first visual object (e.g., the second visual object in FIG. 1 130) can be displayed. For example, the one or more events may be related to a software application executed by an external electronic device. For example, the one or more events may be related to operations performed by an external electronic device. According to one embodiment, the wearable device 101 may display the second visual object adjacent to the first visual object. For example, the wearable device 101 may display the second visual object adjacent to an image corresponding to a point where the one or more events occurred. The wearable device 101 may display a second visual object corresponding to some of the images included in the first visual object.

According to one embodiment, the wearable device 101 may display a third visual object (eg, the third visual object 140 of FIG. 1) to indicate geographical information. For example, the wearable device 101 may display the third visual object in at least a partial area of the screen. The wearable device 101 may display the path of the external electronic device within the third visual object. For example, the wearable device 101 may display a path indicating movement of the external electronic device in a third visual object, such as a map. According to one embodiment, the wearable device 101 may display points (or locations) where one or more events generated by an external electronic device occur within the third visual object. For example, the wearable device 101 may display points where each of the one or more events occurred within the third visual object. For example, the wearable device 101 may display the points in a color corresponding to one or more second visual objects representing the one or more events. According to one embodiment, the wearable device 101 may receive an input for the third visual object. For example, the wearable device 101 may receive the input from an external electronic device such as a controller. For example, the wearable device 101 may identify the input to the third visual object based on the motion or gesture of the user (eg, user 110 in FIG. 1). The input is not limited to what was described above. The wearable device 101 may adjust the size of the third visual object based on the input. For example, the wearable device 101 may change the third visual object from a first size to a second size based on identifying the input while displaying the third visual object. For example, the first size may be larger than the second size. For example, the wearable device 101 may identify an input for the third visual object while displaying the third visual object at a second size. The wearable device 101 may change the third visual object from a second size to a first size based on identifying the input. The size of the third visual object is not limited to the above.

According to one embodiment, the wearable device 101 may identify an input indicating selection of one of the second visual objects. The wearable device 101 may display a fourth visual object related to one of the second visual objects based on identifying an input indicating selection of one of the second visual objects. For example, the wearable device 101 may display a fourth visual object related to an event based on an input for one of the second visual objects corresponding to one or more events generated by an external electronic device. there is. For example, wearable device 101 may identify an input for a second visual object indicating an event related to playing music. The wearable device 101 may execute a software application for playing the music based on the input to the second visual object. The wearable device 101 may display a fourth visual object corresponding to the software application on at least part of the screen based on execution of the software application for playing music. For example, the fourth visual object may include a software interface that can cause interaction between the wearable device 101 and the user, such as a widget.

As described above, the wearable device 101 according to one embodiment may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. The wearable device 101 may display a first visual object including images of different points within the path through the display 220 . The wearable device 101 may display one or more second visual objects expressing the one or more events in conjunction with the first visual object, based on at least one of a time section or point at which the one or more events occurred. there is. The wearable device 101 may display the first visual object and the second visual object corresponding to the path of the external electronic device. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying the first visual object and the second visual object.

FIG. 3A shows an example of a perspective view of a wearable device, according to an embodiment. FIG. 3B shows an example of one or more hardware disposed in a wearable device, according to an embodiment. The wearable device 300 of FIGS. 3A to 3B may include the wearable device 101 of FIGS. 1 and/or 2 .

According to one embodiment, the wearable device 300 may be worn on a part of the user's body. The wearable device 300 provides the user wearing the wearable device 300 with augmented reality (AR), virtual reality (VR), or a mixed reality that combines augmented reality and virtual reality. , MR) can be provided. For example, the wearable device 300 outputs a virtual reality image to the user through at least one display 350 in response to the user's designated gesture acquired through the motion recognition camera 340-2 of FIG. 3B. can do.

According to one embodiment, at least one display 350 in the wearable device 300 may provide visual information to the user. The at least one display 350 may include the display 220 of FIG. 2 . For example, at least one display 350 may include a transparent or translucent lens. At least one display 350 may include a first display 350-1 and/or a second display 350-2 spaced apart from the first display 350-1. For example, the first display 350-1 and the second display 350-2 may be placed at positions corresponding to the user's left eye and right eye, respectively.

Referring to FIG. 3B, at least one display 350 forms a display area on the lens to display visual information included in external light passing through the lens to a user wearing the wearable device 300. It can provide other visual information that is distinct from visual information. The lens may be formed based on at least one of a Fresnel lens, a pancake lens, or a multi-channel lens. The display area formed by at least one display 350 may be formed on the first surface 331 and the second surface 332 of the lens. When a user wears the wearable device 300, external light may be incident on the first surface 331 and transmitted through the second surface 332, thereby being transmitted to the user. As another example, at least one display 350 may display a virtual reality image to be combined with a real screen transmitted through external light. The virtual reality image output from at least one display 350 includes one or more hardware (e.g.,

optical devices

382, 384, and/or at least one waveguides) included in the wearable device 300. )(333, 334)), it can be transmitted to the user's eyes.

According to one embodiment, the wearable device 300 includes waveguides 333 that diffract light transmitted from at least one display 350 and relayed by the

optical devices

382 and 384 and deliver it to the user. , 334). The

waveguides

333 and 334 may be formed based on at least one of glass, plastic, or polymer. A nanopattern may be formed on the outside or at least a portion of the inside of the

waveguides

333 and 334. The nanopattern may be formed based on a polygonal and/or curved grating structure. Light incident on one end of the

waveguides

333 and 334 may propagate to the other end of the

waveguides

333 and 334 by the nanopattern. The

waveguides

333 and 334 may include at least one of a diffractive element (eg, a diffractive optical element (DOE) or a holographic optical element (HOE)) or a reflective element (eg, a reflective mirror). For example, the

waveguides

333 and 334 may be disposed within the wearable device 300 to guide the screen displayed by at least one display 350 to the user's eyes. For example, the screen may be transmitted to the user's eyes based on total internal reflection (TIR) generated within the

waveguides

333 and 334.

According to one embodiment, the wearable device 300 analyzes objects included in the real-life image collected through the shooting camera 340-1, and selects an object that is the target of providing augmented reality from among the analyzed objects. Corresponding virtual objects can be combined and displayed on at least one display 350. The virtual object may include at least one of text and images for various information related to the object included in the real image. The wearable device 300 can analyze objects based on multi-cameras, such as stereo cameras. For the object analysis, the wearable device 300 may execute time-of-flight (ToF) and/or simultaneous localization and mapping (SLAM) supported by multi-cameras. A user wearing the wearable device 300 can watch images displayed on at least one display 350.

According to one embodiment, the frame may be made of a physical structure that allows the wearable device 300 to be worn on the user's body. According to one embodiment, the frame allows the first display 350-1 and the second display 350-2 to be positioned to correspond to the user's left eye and right eye when the user wears the wearable device 300. It can be configured so that The frame may support at least one display 350. For example, the frame may support the first display 350-1 and the second display 350-2 to be positioned at positions corresponding to the user's left and right eyes.

Referring to FIG. 3A , when the user wears the wearable device 300, the frame may include an area 320 at least partially in contact with a portion of the user's body. For example, the area 320 of the frame in contact with a part of the user's body includes an area in contact with a part of the user's nose, a part of the user's ear, and a side part of the user's face that the wearable device 300 touches. can do. According to one embodiment, the frame may include a nose pad 310 that contacts a part of the user's body. When the wearable device 300 is worn by a user, the nose pad 310 may be in contact with a portion of the user's nose. The frame may include a first temple 304 and a second temple 305 that are in contact with another part of the user's body that is distinct from the part of the user's body.

In one embodiment, the frame includes a first rim 301 surrounding at least a portion of the first display 350-1 and a second rim 302 surrounding at least a portion of the second display 350-2. , a bridge 303 disposed between the first rim 301 and the second rim 302, a first pad disposed along a portion of the edge of the first rim 301 from one end of the bridge 303 ( 311), a second pad 312 disposed along a portion of the edge of the second rim 302 from the other end of the bridge 303, a first temple extending from the first rim 301 and fixed to a portion of the wearer's ear ( 304), and a second temple 305 extending from the second rim 302 and fixed to a portion of the ear opposite the ear. The first pad 311 and the second pad 312 may be in contact with a portion of the user's nose, and the first temple 304 and the second temple 305 may be in contact with a portion of the user's face and a portion of the ear. may come into contact with. The

temples

304, 305 may be rotatably connected to the rim via the

hinge units

306, 307 of FIG. 3B. The first temple 304 may be rotatably connected to the first rim 301 through a first hinge unit 306 disposed between the first rim 301 and the first temple 304. . The second temple 305 may be rotatably connected to the second rim 302 through a second hinge unit 307 disposed between the second rim 302 and the second temple 305. According to one embodiment, the wearable device 300 detects an external object (e.g., a user's fingertip) touching the frame using a touch sensor, a grip sensor, and/or a proximity sensor formed on at least a portion of the surface of the frame. fingertip)), and/or a gesture performed by the external object may be identified.

According to one embodiment, the wearable device 300 may include hardware (eg, hardware described above based on the block diagram of FIG. 2) that performs various functions. For example, the hardware includes a battery module 370, an antenna module 375,

optical devices

382, 384, speakers 392-1, 392-2, and microphones 394-1, 394- 2, 394-3), a light emitting module (not shown), and/or a printed circuit board 390. Various hardware can be placed within the frame.

According to one embodiment, the microphones 394-1, 394-2, and 394-3 of the wearable device 300 may be disposed in at least a portion of the frame to obtain a sound signal. A first microphone 394-1 disposed on the nose pad 310, a second microphone 394-2 disposed on the second rim 302, and a third microphone disposed on the first rim 301. Although microphones 394-3 are shown in FIG. 3B, the number and placement of microphones 394 are not limited to the embodiment of FIG. 3B. If the number of microphones 394 included in the wearable device 300 is two or more, the wearable device 300 can identify the direction of the sound signal using a plurality of microphones disposed on different parts of the frame. there is.

According to one embodiment, the

optical devices

382 and 384 may transmit a virtual object transmitted from at least one display 350 to the wave guides 333 and 334. For example,

optical devices

382 and 384 may be projectors. The

optical devices

382 and 384 may be disposed adjacent to the at least one display 350 or may be included within at least one display 350 as part of the at least one display 350 . The first optical device 382 may correspond to the first display 350-1, and the second optical device 384 may correspond to the second display 350-2. The first optical device 382 can transmit the light output from the first display 350-1 to the first waveguide 333, and the second optical device 384 can transmit the light output from the first display 350-1 to the first waveguide 333. The light output from -2) can be transmitted to the second waveguide 334.

In one embodiment, the camera 340 may include an eye tracking camera (ET CAM) 340-1, a motion recognition camera 340-2, and/or an imaging camera 340-3. You can. The shooting camera 340-3, the eye tracking camera 340-1, and the motion recognition camera 340-2 may be placed at different positions on the frame and perform different functions. The shooting camera 340-3, eye tracking camera 340-1, and motion recognition camera 340-2 may be examples of the camera 225 of FIG. 2. The gaze tracking camera 340-1 may output data representing the gaze of the user wearing the wearable device 300. For example, the wearable device 300 may detect the gaze from an image including the user's pupils obtained through the gaze tracking camera 340-1. An example in which the gaze tracking camera 340-1 is positioned toward the user's right eye is shown in FIG. 3B, but the embodiment is not limited thereto, and the gaze tracking camera 340-1 is positioned solely toward the user's left eye. It may be placed towards, or towards both eyes.

In one embodiment, the capturing camera 340-3 may capture a real image or background to be matched with a virtual image to implement augmented reality or mixed reality content. The capturing camera may capture an image of a specific object that exists at a location where the user is looking and provide the image to at least one display 350. At least one display 350 is one in which a real image or background information including the image of the specific object obtained using a photographing camera and a virtual image provided through the

optical devices

382 and 384 are overlapped. The video can be displayed. In one embodiment, the imaging camera may be placed on the bridge 303 disposed between the first rim 301 and the second rim 302.

In one embodiment, the gaze tracking camera 340-1 tracks the gaze of a user wearing the wearable device 300, thereby tracking the user's gaze and visual information provided to at least one display 350. By matching them, a more realistic augmented reality can be realized. For example, when the user looks forward, the wearable device 300 may naturally display environmental information related to the user's front view on at least one display 350 at the location where the user is located. The gaze tracking camera 340-1 may be configured to capture an image of the user's pupil to determine the user's gaze. For example, the gaze tracking camera 340-1 may receive gaze detection light reflected from the user's pupil and track the user's gaze based on the position and movement of the received gaze detection light. In one embodiment, the eye tracking camera 340-1 may be placed at positions corresponding to the user's left and right eyes. For example, the eye tracking camera 340-1 may be placed within the first rim 301 and/or the second rim 302 to face the direction in which the user wearing the wearable device 300 is located. You can.

In one embodiment, the motion recognition camera 340-2 recognizes the movement of the entire or part of the user's body, such as the user's torso, hands, or face, and displays a specific event on the screen provided on at least one display 350. can be provided. The gesture recognition camera 340-2 may recognize a user's gesture, obtain a signal corresponding to the gesture, and provide a display corresponding to the signal to at least one display 350. The processor may identify a signal corresponding to the operation and perform a designated function based on the identification. In one embodiment, the motion recognition camera 340-2 may be disposed on the first rim 301 and/or the second rim 302.

In one embodiment, the camera 340 included in the wearable device 300 is not limited to the eye tracking camera 340-1 and the motion recognition camera 340-2 described above. For example, the wearable device 300 may identify an external object included within the user's field-of-view (FoV) using the capturing camera 340-3 disposed toward the user's field-of-view (FoV). The wearable device 300 identifies an external object based on a sensor for identifying the distance between the wearable device 300 and the external object, such as a depth sensor and/or a time of flight (ToF) sensor. It can be. The camera 340 disposed toward the FoV may support an autofocus function and/or an optical image stabilization (OIS) function. For example, the wearable device 300 includes a camera 340 (e.g., a face tracking (FT) camera) disposed toward the face of a user wearing the wearable device 300 to obtain an image including the face. ) may include.

Although not shown, according to one embodiment, the wearable device 300 radiates light toward a subject (e.g., the user's eyes, face, and/or an external object within the FoV) captured using the camera 340. It may further include a light source (eg, LED). The light source may include an LED with an infrared wavelength. The light source may be placed in at least one of the frame and hinge

units

306 and 307.

According to one embodiment, the battery module 370 may supply power to electronic components of the wearable device 300. In one embodiment, the battery module 370 may be disposed within the first temple 304 and/or the second temple 305. For example, the battery module 370 may be a plurality of battery modules 370 . A plurality of battery modules 370 may be disposed on the first temple 304 and the second temple 305, respectively. In one embodiment, the battery module 370 may be disposed at an end of the first temple 304 and/or the second temple 305.

In one embodiment, the antenna module 375 may transmit a signal or power to the outside of the wearable device 300, or may receive a signal or power from the outside. The antenna module 375 may be electrically and/or operationally connected to a communication circuit (eg, the communication circuit 230 of FIG. 2) within the wearable device 300. In one embodiment, the antenna module 375 may be disposed within the first temple 304 and/or the second temple 305. For example, the antenna module 375 may be placed close to one surface of the first temple 304 and/or the second temple 305.

In one embodiment, the speakers 392-1 and 392-2 may output sound signals to the outside of the wearable device 300. The sound output module may be referred to as a speaker. In one embodiment, the speakers 392-1 and 392-2 are disposed adjacent to the ears of the user wearing the wearable device 300, the first temple 304, and/or the second temple 305. ) can be placed within. For example, the wearable device 300 is disposed within the first temple 304 and the second speaker 392-2, which is disposed adjacent to the user's left ear, and the second temple 305 to listen to the user's hearing. It may include a first speaker 392-1, which is disposed adjacent to the right ear.

In one embodiment, a light emitting module (not shown) may include at least one light emitting device. In order to visually provide information about the specific state of the wearable device 300 to the user, the light emitting module may emit light in a color corresponding to a specific state or emit light in an operation corresponding to the specific state. For example, when the wearable device 300 requires charging, it may repeatedly emit red light at designated times. In one embodiment, the light emitting module may be disposed on the first rim 301 and/or the second rim 302.

Referring to FIG. 3B , the wearable device 300 according to one embodiment may include a printed circuit board (PCB) 390. The PCB 390 may be included in at least one of the first temple 304 or the second temple 305. The PCB 390 may include an interposer disposed between at least two sub-PCBs. On the PCB 390, one or more hardware included in the wearable device 300 (eg, hardware shown by the blocks described above with reference to FIG. 2) may be disposed. The wearable device 300 may include a flexible PCB (FPCB) for interconnecting the hardware.

According to one embodiment, the wearable device 300 includes a gyro sensor for detecting the posture of the wearable device 300 and/or the posture of a body part (e.g., head) of a user wearing the wearable device 300, It may include at least one of a gravity sensor and/or an acceleration sensor. The gravity sensor and acceleration sensor may each measure gravitational acceleration and/or acceleration based on designated three-dimensional axes (eg, x-axis, y-axis, and z-axis) that are perpendicular to each other. A gyro sensor can measure the angular velocity of each of designated three-dimensional axes (e.g., x-axis, y-axis, and z-axis). At least one of the gravity sensor, the acceleration sensor, and the gyro sensor may be referred to as an inertial measurement unit (IMU). According to one embodiment, the wearable device 300 may identify a user's motion and/or gesture performed to execute or stop a specific function of the wearable device 300 based on the IMU.

According to one embodiment, the wearable device 300 displays at least a portion of media content based on the display 350,

optical devices

382, 384, and/or

waveguides

333, 334. You can. For example, at least a portion of the media content is one of the first visual object 120, the second visual objects 130, the third visual object 140, or the fourth visual object 150 of FIG. 1. It may be at least part of it. Operations performed by the wearable device 300 may be performed by the processor 210 of FIG. 2 . However, it is not limited to this.

4A to 4B show an example of the appearance of a wearable device, according to an embodiment. The wearable device 400 of FIGS. 4A to 4B may include the wearable device 101 of FIGS. 1 and/or 2 .

Referring to FIG. 4A, according to one embodiment, the first surface 410 of the wearable device 400 may have a form attachable to a user's body part (e.g., the user's face). . Although not shown, the wearable device 400 may include a strap for securing to a portion of the user's body, and/or one or more temples (e.g., the first temple 304 of FIGS. 3A-3B , and/or the first temple 304 of FIGS. 3A-3B It may further include 2 temples (305). A first display 350-1 for outputting an image to the left eye of both eyes of the user, and a second display 350-2 for outputting an image to the right eye of the user's both eyes, have a first surface 410 It can be placed on top. The wearable device 400 is formed on the first surface 410 and emits light (e.g., external light (e.g., external light) different from the light emitted from the first display 350-1 and the second display 350-2. Rubber or silicone packing may be further included to prevent interference due to ambient light.

According to one embodiment, the wearable device 400 includes a camera for photographing and/or tracking both eyes of a user adjacent to each of the first display 350-1 and the second display 350-2. It may include (440-1, 440-2). The cameras 440-1 and 440-2 may be referred to as ET cameras. According to one embodiment, the wearable device 400 may include cameras 440-3 and 440-4 for photographing and/or recognizing the user's face. The cameras 440-3 and 440-4 may be referred to as FT cameras.

Referring to FIG. 4B, on the second side 420, which is opposite to the first side 410 of FIG. 4A, a camera (e.g., cameras 440) for acquiring information related to the external environment of the wearable device 400 -5, 440-6, 440-7, 440-8, 440-9, 440-10)), and/or a sensor (e.g., depth sensor 430) may be disposed. For example, the cameras 440-5, 440-6, 440-7, 440-8, 440-9, and 440-10 are configured to recognize external objects different from the wearable device 400. It may be placed on (420). For example, using the cameras 440-9 and 440-10, the wearable device 400 may obtain images and/or media to be transmitted to each of the user's eyes. The camera 440-9 will be disposed on the second side 420 of the wearable device 400 to acquire an image to be displayed through the second display 350-2 corresponding to the right eye among the two eyes. You can. The camera 440-10 may be disposed on the second side 420 of the wearable device 400 to acquire an image to be displayed through the first display 350-1 corresponding to the left eye among the two eyes. there is.

According to one embodiment, the wearable device 400 may include a depth sensor 430 disposed on the second surface 420 to identify the distance between the wearable device 400 and an external object. Using the depth sensor 430, the wearable device 400 acquires spatial information (e.g., depth map) about at least a portion of the FoV of the user wearing the wearable device 400. can do.

Although not shown, a microphone for acquiring sound output from an external object may be disposed on the second side 420 of the wearable device 400. The number of microphones may be one or more depending on the embodiment.

According to one embodiment, the wearable device 400 displays the first visual object 120 and the second visual object 120 of FIG. 1 based on the first display 350-1 and/or the second display 350-2. At least one of the objects 130, the third visual object 140, or the fourth visual object 150 may be displayed.

Figure 5 shows an example of a screen displayed through a wearable device, according to an embodiment. The wearable device 101 of FIG. 5 is the wearable device 101 of FIGS. 1 and/or 2, the wearable device 300 of FIGS. 3A to 3B, and/or the wearable device 400 of FIGS. 4A to 4B. may include. The operations of FIG. 5 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 5, according to one embodiment, the wearable device 101 controls the display (e.g., the display 220 of FIG. 2) to display the first screen 501 within the field-of-view (FoV). It can be displayed. For example, the wearable device 101 may display a first screen 501 related to media content. For example, the first screen 501 may be a screen corresponding to one of the images included in the first visual object 120 described in FIG. 1. For example, while displaying the first screen 501 corresponding to one of the images, the wearable device 101 displays visual objects 510 for displaying a screen different from the first screen 501. can be displayed. For example, the wearable device 101 may display the first visual object 510-1 and/or the second visual object 510-2. For example, the visual objects 510 may be visual objects for changing the first screen 501 related to the media content being executed.

According to one embodiment, the wearable device 101 may identify an input for at least one of the visual objects 510. For example, the input may be identified based on a signal transmitted from an external electronic device, such as a controller. For example, the input may be identified based on pressing a button included in the wearable device 101. The wearable device 101 may display a second screen 503 that is different from the first screen 501 based on identifying the input. For example, the first screen 501 may be an image related to a point of the external electronic device corresponding to the first time period. For example, the second screen may be an image related to a point of the external electronic device corresponding to the second time period. The first time section may be a time section after the second time section. The wearable device 101 displays a second screen corresponding to a second time interval from the first screen 501 corresponding to the first time interval, based on identifying the input to the first visual object 510-1. It can be changed to (502).

According to one embodiment, the wearable device 101 may identify an input for the second visual object 510-2. The wearable device 101 may identify an input to the second visual object 510-2 while displaying the first screen 501 corresponding to the first time period. The wearable device 101 may display a third screen 503 that is different from the first screen 501 based on the input to the second visual object 510-2. The wearable device 101 may display the third screen 503 corresponding to the third time period. For example, the third time section may be a time section after the first time section.

According to one embodiment, the wearable device 101 includes a camera (e.g., camera 340 in FIG. 3B, and/or cameras 440-5, 440-6, 440-7, 440-8 in FIG. 4B, Using 440-9, 440-10)), the gesture (or motion) of the user 110 can be identified. For example, the wearable device 101 may identify a designated gesture (or designated motion). For example, the wearable device 101 may change the screen displayed through the display based on identifying a designated gesture. For example, the designated gesture includes a gesture of moving the hand from right to left to change from the first screen 501 corresponding to the first time period to the second screen 502 corresponding to the second time period. It can be included. The designated gesture may include a gesture of moving the hand from left to right to change from the first screen 501 corresponding to the first time period to the third screen 503 corresponding to the third time period. . The designated gesture described above is an example and is not limited thereto.

As described above, the wearable device 101 according to one embodiment may display one of the

screens

501, 502, and 503 related to media content. While displaying one of the

screens

501, 502, and 503, the wearable device 101 may identify an input for displaying a screen different from the displayed screen. While displaying one of the

screens

501, 502, and 503, the wearable device 101 may identify a designated gesture for displaying a screen different from the displayed screen. The wearable device 101 may display a screen corresponding to a time period based on the input or the designated gesture. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying a screen corresponding to a time period based on the user's input.

FIG. 6A shows an example of a screen displayed through a wearable device, according to an embodiment. FIG. 6B shows an example of a screen displayed through a wearable device, according to an embodiment. The wearable device 101 of FIGS. 6A to 6B is the wearable device 101 of FIGS. 1, 2, and/or 5, the wearable device 300 of FIGS. 3A to 3B, and/or the wearable device 300 of FIGS. 4A to 4A. It may include the wearable device 400 of 4b. The operations of FIGS. 6A to 6B may be performed by the processor 210 of FIG. 2 .

6A to 6B, according to one embodiment, the wearable device 101 configures the path based on media content matched with a path of an external electronic device and one or more events generated by the external electronic device. A first visual object 120 containing images of different points may be displayed. The wearable device 101 may display one or more second visual objects 130 expressing the one or more events in connection with the first visual object, based on at least one of a time section or point in which the one or more events occurred. can be displayed. The second visual objects 130 may include buttons that can receive input. For example, the wearable device 101 may display a first button 601 related to playing music among the second visual objects 130. For example, the wearable device 101 may display a second button 602 related to chatting between the first external electronic device and the second external electronic device among the second visual objects 130. Events related to the buttons 601 and 602 are not limited to the above.

Referring to FIG. 6A , the wearable device 101 may identify an input indicating selection of the first button 601. The wearable device 101 displays a fourth visual object (e.g., an event related to playback of music) corresponding to the first button 601, based on an input indicating selection of the first button. 615) can be displayed. For example, the fourth visual object 615 may be a visual object that indicates performing substantially the same operation as an event generated by an external electronic device. For example, the fourth visual object 615 may be a software interface and a visual object for interaction between the wearable device 101 and the user 110. The wearable device 101 may display the fourth visual object 615 based on execution of a software application related to the fourth visual object 615. According to one embodiment, the wearable device 101 may display the first button 601 by emphasizing it based on an input indicating selection of the first button 601. For example, the wearable device 101 may enlarge the size of the first button 601 based on an input indicating selection of the first button 601. The operation for emphasizing the first button 601 is not limited to the operation for enlarging the size of the first button 601.

Referring to FIG. 6B, the wearable device 101 according to one embodiment may display a plurality of fourth

visual objects

615 and 625. For example, the fourth

visual objects

615 and 625 may be visual objects related to one or more events generated by an external electronic device. According to one embodiment, the wearable device 101 may display a second button 620, which is one of the second visual objects 130. The wearable device 101 may identify an input indicating selection of the second button 620. For example, the wearable device 101 may select the second button 620 and the second button 620 based on identifying an input indicating selection of the second button 620 while displaying the fourth visual object 615. A related fifth visual object 625 may be displayed. For example, the fifth visual object 625 may be a visual object representing a chatting message obtained based on communication between the first external electronic device and the second external electronic device. For example, the wearable device 101 may display the fifth visual object 625 based on execution of a software application related to a chat message.

According to one embodiment, the wearable device 101 may display the fourth visual object 615 and the fifth visual object 625. The wearable device 101 may identify an input indicating selection of at least one of the fourth visual object 615 and the fifth visual object 625. Based on identifying the input, the wearable device 101 may highlight and display a visual object (eg, the fourth visual object 615 or the fifth visual object 625) corresponding to the input. For example, the operation of emphasizing and displaying the visual object may include the operation of displaying the visual object by enlarging its size. For example, the operation of emphasizing and displaying the visual object may include the operation of displaying the color of the edges of the visual object in a designated color.

For example, the wearable device 101 may identify an input for the fourth visual object 615. The wearable device 101 may enlarge the size of the fourth visual object 615 or display it in a designated color based on identifying the input to the fourth visual object 615. For example, the wearable device 101 may identify an input for at least a portion of the fourth visual object 615 while emphasizing and displaying the fourth visual object 615 . The wearable device 101 may perform an operation corresponding to an input for at least part of the fourth visual object 615, based on identifying the input for the at least part. For example, the wearable device 101 performs an operation of playing music based on identifying an input to the play button 615-1 included in the fourth visual object 615 related to playing music. It can be done. The above description is an example of the fourth visual object 615, and the embodiment is not limited thereto. The fourth visual object 615 and/or the fifth visual object 625 may be displayed based on one or more events generated by an external electronic device.

As described above, according to one embodiment, the wearable device 101 displays the first visual object 120 and/or the second visual objects 130 based on one or more events generated by an external electronic device. ) can be displayed. The wearable device 101 may identify an input to one of the second visual objects 130 (eg, the first button 610 and/or the second button 620). Based on identifying the input to the first button 610 and/or the second button 620, the wearable device 101 displays a visual object (e.g., a second button) associated with one of the

buttons

610 and 620. 4 visual objects 615 and/or 5 visual objects 625) may be displayed. The fourth visual object 615 and/or the fifth visual object 625 may be related to a software application executed within a time interval. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying the fourth visual object 615 and/or the fifth visual object 625.

Figure 7 shows an example of a screen displayed through a wearable device, according to an embodiment. The wearable device 101 of FIG. 7 is the wearable device 101 of FIGS. 1, 2, 5, and/or 6A to 6B, the wearable device 300 of FIGS. 3A to 3B, and/or FIG. It may include the wearable device 400 of FIGS. 4A to 4B. The operations of FIG. 7 may be performed by the processor 210 of FIG. 2 .

Referring to FIG. 7 , the wearable device 101 according to one embodiment may identify media content in which the path of an external electronic device and one or more events generated by the external electronic device are matched. The wearable device 101 may display a first visual object 120 containing images of different points within the path. The wearable device 101 displays one or more second visual objects expressing the one or more events in connection with the first visual object 120, based on at least one of the time interval or point in which the one or more events occurred ( 130) can be displayed.

According to one embodiment, the wearable device 101 may display a third visual object 140 related to geographical information. For example, the third visual object 140 may be displayed based on a two-dimensional virtual coordinate system. According to one embodiment, the wearable device 101 may display a first button 710 for adjusting the size of the third visual object 140. For example, the first button 710 may include at least a portion of the third visual object 140. For example, the first button 710 may overlap with the third visual object 140 or may be displayed separately. The wearable device 101 may adjust the size of the third visual object 140 based on the input to the first button 710. For example, the wearable device 101 may identify an input indicating selection of the first button 710 while displaying the third visual object 140 displayed at the first size. The wearable device 101 may change the third visual object 140 to a second size based on the input. For example, the wearable device 101 may identify an input indicating selection of the second button 720 while displaying the third visual object 140 displayed at the second size. For example, the second button 720 may be a button that performs substantially the same function as the first button 710. The wearable device 101 may change the third visual object 140 to a first size based on the input. For example, the first size may be relatively small compared to the second size.

According to one embodiment, the wearable device 101 may display locations corresponding to one or more events generated by an external electronic device within the third visual object 140. For example, the wearable device 101 may display locations corresponding to the one or more events within the third visual object 140 of the first size. For example, the wearable device 101 may display locations corresponding to the one or more events within the third visual object 140 of the second size.

As described above, the wearable device 101 according to one embodiment may display the third visual object 140 to indicate geographical information. The wearable device 101 may display locations corresponding to one or more events generated by an external electronic device within the third visual object 140. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying the locations.

Figure 8 shows an example of a screen displayed through a wearable device, according to an embodiment. The wearable device 101 of FIG. 8 includes the wearable device 101 of FIGS. 1, 2, 5, 6A, 6B, and/or 7, the wearable device 300 of FIGS. 3A to 3B, and /Or it may include the wearable device 400 of FIGS. 4A to 4B. The operations of FIG. 8 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 8, according to one embodiment, the wearable device 101 is configured to match a first path 830 of a first external electronic device and one or more events generated by the first external electronic device. Media content can be identified. The wearable device 101 may identify second media content in which the second path 840 of the second external electronic device and one or more events generated by the second external electronic device are matched. For example, the second media content may be media content shared from the second external electronic device to the first external electronic device and/or the wearable device 101. According to one embodiment, the wearable device 101 may display a first visual object 120 including images of different points within the first path 830. The wearable device 101 may display a second visual object 810 including images of different points within the second path 840. According to one embodiment, the wearable device 101 displays a third visual object 140 for indicating geographical information while displaying the first visual object 120 and the second visual object 810. can do.

According to one embodiment, the wearable device 101 may display a first path 830 and a second path 840 within the third visual object 140. For example, the wearable device 101 may display the first path 830 and the second path 840 based on different colors. The wearable device 101 may display the first path 830 in the third visual object 140 in a first color. The wearable device 101 may display the second path 840 in the third visual object 140 in a second color. According to one embodiment, the wearable device 101 may display a partial area 820-1 of the first visual object 120 in substantially the same color as the color displaying the first path 830. there is. For example, the wearable device 101 may display a partial area 820-2 of the second visual object 810 in substantially the same color as the color in which the second path 840 is displayed.

According to one embodiment, the wearable device 101 may display a first virtual character 850 corresponding to first media content. The wearable device 101 may display a second virtual character 860 corresponding to second media content. For example, the wearable device 101 may display the edge of the first virtual character 850 in a first color. For example, the wearable device 101 may display the edge of the second virtual character 860 in a second color.

According to one embodiment, the wearable device 101 may identify an input for the second visual object 810. The wearable device 101 may change the sizes of the first visual object 120 and the second visual object 810 based on identifying the input to the second visual object 810. For example, the wearable device 101 may receive an input for the second visual object 810 while displaying the first visual object 120 of the first size and the second visual object 810 of the second size. can be identified. The wearable device 101 may display a first visual object 120 of a second size and a second visual object 810 of a first size based on identifying the input.

According to one embodiment, the wearable device 101 may display one or more events generated by the second external electronic device in the designated area 870. For example, the wearable device 101 may display one or more events generated by a second external electronic device within the designated area 870, which is a different area from the area displaying one or more events generated by the first external electronic device. You can display one of the events.

As described above, according to one embodiment, the wearable device 101 may identify media content related to a plurality of external electronic devices (e.g., a first external electronic device and/or a second external electronic device). . While displaying the plurality of media contents on the screen, the wearable device 101 displays visual objects (e.g., first visual object 120 and/or second visual object 130) related to the plurality of media contents. ) can be displayed. The wearable device 101 may identify an input for one of the visual objects. The wearable device 101 may change the size of the visual objects based on identifying an input for one of the visual objects. The wearable device 101 may enhance the user experience of the wearable device 101 by adjusting the size of the visual objects based on the input.

Figure 9 shows an example of a screen displayed through a wearable device, according to an embodiment. The wearable device 101 of FIG. 9 is the wearable device 101 of FIGS. 1, 2, 5, 6A, 6B, 7, and/or 8, and the wearable device 300 of FIGS. 3A to 3B. ), and/or the wearable device 400 of FIGS. 4A to 4B. The operations of FIG. 9 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 9, according to one embodiment, the wearable device 101 displays first media content in which a first path of a first external electronic device and one or more events generated by the first external electronic device are matched. can be identified. The wearable device 101 may identify second media content in which a second path of a second external electronic device and one or more events generated by the second external electronic device are matched. For example, the second media content may be media content shared from the second external electronic device to the first external electronic device and/or the wearable device 101. The wearable device 101 may display a first visual object 120 related to first media content and/or a second visual object 810 related to second media content.

According to one embodiment, the wearable device 101 may display the first visual object 120 and the second visual object 810 in the first state 900. The wearable device 101 may display a third visual object 910 to stop displaying the second visual object 810. The wearable device 101 may identify the input for the third visual object 910. The wearable device 101 may stop displaying the second visual object 810 based on the input for the third visual object 910. In FIG. 9 , the third visual object 910 is displayed adjacent to the second visual object 810, but the position at which the third visual object 910 is displayed is not limited thereto.

According to one embodiment, the wearable device 101 may display the first visual object 120 in the second state 905. The wearable device 101 may display a fourth visual object 920 to display a second visual object 810 related to second media content. The wearable device 101 can identify the input for the fourth visual object 920. The wearable device 101 may display the second visual object 810 based on the input for the fourth visual object 920. The fourth visual object 920 may be substantially the same visual object as the third visual object 910. The location of the fourth visual object 920 is not limited. For example, the third visual object 910 and the fourth visual object 920 may be arranged at the same location or may be arranged at different locations. When the third visual object 910 and the fourth visual object 920 are arranged at the same location, while the third visual object 910 is displayed, display of the fourth visual object 920 may be stopped. . When the third visual object 910 and the fourth visual object 920 are arranged at the same location, display of the third visual object 910 may be stopped while the fourth visual object 920 is displayed. .

As described above, the wearable device 101 according to one embodiment may control the display of the second visual object 810 related to the second media content. For example, the wearable device 101 may display a third visual object 910 and/or a fourth visual object 920 for controlling the second visual object 810. The wearable device 101 may perform an operation corresponding to each visual object based on an input to the third visual object 910 and/or the fourth visual object 920. The wearable device 101 may enhance the user experience of the wearable device 101 by displaying or stopping displaying the second visual object 810 .

Figure 10 shows an example of a screen displayed through a wearable device and an electronic device, according to an embodiment. The wearable device 101 of FIG. 10 is the wearable device 101 of FIGS. 1, 2, 5, 6A, 6B, 7, 8, and/or 9, and the wearable device of FIGS. 3A to 3B. It may include device 300 and/or wearable device 400 of FIGS. 4A to 4B. The operations of FIG. 10 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 10, according to one embodiment, the wearable device 101 may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. The wearable device 101 may display a first visual object 120 containing images of different points within the path. The wearable device 101 may display one or more second visual objects expressing the one or more events in connection with the first visual object 120, based on at least one of a time interval or point in which the one or more events occurred. (130) can be displayed. The wearable device 101 may display a third visual object 140 to indicate the route and geographic information. The wearable device 101 transmits information for displaying the first visual object 120, the second visual objects 130, and/or the third visual object 140 to an external electronic device or the external electronic device. It can be transmitted to another external electronic device that is different from the device. Hereinafter, the external electronic device may be a first external electronic device, and another external electronic device different from the external electronic device may be a second external electronic device.

According to one embodiment, the wearable device 101 sends information for displaying the first visual object 120, the second visual objects 130, and/or the third visual object 140 to the first external It may be transmitted to an electronic device and/or a second external electronic device. For example, the first external electronic device and/or the second external electronic device may have a different form factor from the wearable device 101. The wearable device 101 is configured to display a fourth visual object 1010 corresponding to the first visual object 120 on a screen displayed through the display of the first external electronic device and/or the second external electronic device. 1 Information can be transmitted. The wearable device 101 is configured to display a fifth visual object 1020 corresponding to the second visual objects 130 on a screen displayed through the display of the first external electronic device and/or the second external electronic device. Second information can be transmitted. The wearable device 101 is configured to display the sixth visual object 1030 corresponding to the third visual object 140 on the screen displayed through the display of the first external electronic device and/or the second external electronic device. 3 Information can be transmitted. According to one embodiment, the wearable device 101 processes at least some of the first information, the second information, and/or the third information to display the external electronic devices (e.g., the first external electronic device and /or a second external electronic device). For example, the wearable device 101 may transmit first information that changes the size of the first visual object 120 to display the fourth visual object 1010 to the external electronic devices. . For example, the wearable device 101 may transmit second information that changes the size of the second visual objects 130 for displaying the fifth visual object 1020 to the external electronic devices. For example, the wearable device 101 may transmit third information that changes the size of the third visual object 140 for displaying the sixth visual object 1030 to the external electronic devices. Although it has been described as first information, second information, and/or third information, the first to third information may be included in a single piece of information.

As described above, according to one embodiment, the wearable device 101 is an external electronic device that displays the first visual object 120, the second visual objects 130, and/or the third visual object 140. Information for displaying the fourth visual object 1010, the fifth visual object 1020, and/or the sixth visual object 1030, respectively, may be transmitted. The external electronic device may display

visual objects

1010, 1020, and 1030 based on receiving the information. The wearable device 101 may enhance the user experience of the wearable device 101 and/or the external electronic device by transmitting information for displaying the

visual objects

1010, 1020, and 1030 through the external electronic device. .

Figure 11 shows an example of a flowchart regarding the operation of a wearable device, according to an embodiment. The wearable device of FIG. 11 is the wearable device 101 of FIGS. 1, 2, 5, 6A, 6B, 7, 8, 9, and/or 10, and the wearable device of FIGS. 3A to 3B. It may include device 300 and/or wearable device 400 of FIGS. 4A to 4B. The operations of FIG. 11 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 11 , in operation 1101, according to one embodiment, the wearable device may identify media content to which the path of the external electronic device and one or more events generated by the external electronic device are matched. For example, the media content may be displayed based on a three-dimensional virtual coordinate system.

In operation 1103, according to one embodiment, the wearable device displays a first visual object (e.g., display 220 in FIG. 2) that includes images of different points in the path of the external electronic device. The first visual object 120 of FIGS. 1, 5, 6A, 6B, 7, 8, 9, and/or 10) may be displayed. For example, the first visual object may be a visual object that represents the passage of time, such as a timeline, or that represents movement of an external electronic device within the path. For example, the first visual object may be a visual object representing a sequence. For example, the wearable device may display a bar (eg, bar 125 in FIG. 1) overlapping the first visual object. The bar may indicate that one of the images included in the first visual object is displayed on the screen. For example, the wearable device may display an image corresponding to the bar on the screen based on the movement of the bar.

In operation 1105, according to one embodiment, the wearable device may identify at least one of a time period or point in which one or more events generated by an external electronic device occurred. For example, the wearable device may display one or more second visual objects representing the one or more events in conjunction with the first visual object, based on at least one of the time interval or point at which the one or more events occurred. there is. For example, the wearable device may display the second visual object adjacent to the first visual object.

According to one embodiment, the wearable device selects a third visual object (e.g., the fourth visual object in FIG. 6B) related to one of the second visual objects, based on an input indicating selection of one of the second visual objects. Object 615) can be displayed. Based on identifying an input indicating selection of one of the second visual objects, the wearable device may execute a software application corresponding to the input and associated with one of the second visual objects. The wearable device may display a third visual object related to the software application based on execution of the software application.

As described above, according to one embodiment, a wearable device may identify media content in which a path of an external electronic device and one or more events generated by the external electronic device are matched. The wearable device may display, on a display, a first visual object containing images of different points within the path. The wearable device may display one or more second visual objects expressing the one or more events in conjunction with the first visual object, based on at least one of a time period or point in which the one or more events occurred. The wearable device may enhance the user experience of the wearable device by displaying the first visual object and the second visual object based on media content.

Figure 12 shows an example of a flowchart regarding the operation of a wearable device, according to an embodiment. The wearable device of FIG. 12 includes the wearable device 101 of FIGS. 1, 2, 5, 6A, 6B, 7, 8, 9, and 10, and the wearable device 300 of FIGS. 3A to 3B. ), the wearable device 400 of FIGS. 4A to 4B, and/or the wearable device of FIG. 11. The operations of FIG. 12 may be performed by the processor 210 of FIG. 2.

Referring to FIG. 12, in operation 1201, according to one embodiment, the wearable device receives, from an external electronic device, a first message related to the path of the external electronic device and/or one or more events generated by the external electronic device. Information can be received. For example, the one or more events may be related to a software application executed by an external electronic device. The wearable device may generate media content based on the first information received from the external electronic device. For example, the media content may include media content displayed on the screen through a three-dimensional virtual coordinate system. The media content may be media content for expressing the path and/or the one or more events of the external electronic device. For example, based on the creation of the media content, the wearable device may store the generated media content in a memory (eg, memory 240 in FIG. 2). The wearable device can change media content included in the memory.

In operation 1203, according to one embodiment, the wearable device may change media content based on metadata included in first information received from an external electronic device. For example, the metadata may include the time at which one or more events occurred by an external electronic device, the location at which the one or more events occurred, and/or the weather (e.g., rain) when the one or more events occurred. may include data related to rainy, snowy, sunny, and/or cloudy. For example, the wearable device may change the media content to reflect the time within the media content based on identifying the time at which one or more events in the metadata occurred. For example, a wearable device may alter the media content to project a shadow of a virtual object identified within the media content. For example, a wearable device may modify the media content to specify the position of the sun corresponding to the time and project a shadow of a virtual object identified within the media content. For example, a wearable device may identify data related to weather when the one or more events occurred. Based on identifying the weather-related data, the wearable device may change the media content to display a virtual object related to the weather within the media content.

In operation 1205, the wearable device according to one embodiment may identify an execution history related to a software application executed on the external electronic device within the media content based on second information received from the external electronic device. For example, the wearable device may identify the execution history of the software application based on the second information. The wearable device may identify communication history with another external electronic device that is different from the external electronic device while executing the software application. The wearable device may change media content based on the execution history and/or communication history to display visual objects related to the history.

According to one embodiment, when transmitting the media content to an external electronic device, the wearable device may selectively transmit at least part of the media content. For example, a wearable device can specify a personal information level of the media content. The wearable device may selectively transmit at least part of the media content based on the personal information level. For example, the personal information level may be a level for specifying the transmitted media content when transmitting the media content to an external electronic device.

As described above, according to one embodiment, a wearable device may create or change media content based on first information, second information, and/or metadata transmitted from an external electronic device. The wearable device may create or change the media content based on the path of the external electronic device or one or more events generated by the external electronic device. The wearable device may enhance the user experience of the wearable device and/or the external electronic device by generating media content based on information or data transmitted from the external electronic device.

Metaverse is a compound word of the English word 'Meta', meaning 'virtual' or 'transcendence', and 'Universe', meaning universe. It is a combination of social, economic and cultural activities similar to the real world. It refers to a three-dimensional virtual world. Metaverse is a concept that is one step more advanced than virtual reality (VR, a cutting-edge technology that allows people to experience life-like experiences in a computer-generated virtual world), using avatars to simply enjoy games or virtual reality. Not only that, but it has the characteristic of being able to engage in social and cultural activities similar to actual reality. The Metaverse service is based on augmented reality (AR), virtual reality environment (VR), mixed reality (MR), and/or extended reality (XR), and creates the virtual world. Media content can be provided to enhance immersion.

For example, media content provided by the metaverse service may include social interaction content including avatar-based games, concerts, parties, and/or meetings. For example, the media content may include advertisements, user created content, and/or information for economic activities such as selling products and/or shopping. Ownership of the user-generated content may be proven by a blockchain-based non-fungible token (NFT). Metaverse services can support economic activities based on real currency and/or cryptocurrency. Through the metaverse service, virtual content linked to the real world, such as digital twin or life logging, can be provided.

FIG. 13 is an example diagram of a network environment 1301 in which metaverse services are provided through the server 1310.

13, the network environment 1301 includes a server 1310, a user terminal 1320 (e.g., a first terminal 1320-1 and a second terminal 1320-2), and a server 1310. It may include a network connecting the user terminal 1320. Within the network environment 1301, the server 1310 may provide a metaverse service to the user terminal 1320. The network may be formed by at least one intermediate node 1330 including an access point (AP) and/or a base station. The user terminal 1320 may connect to the server 1320 through a network and output a user interface (UI) related to the metaverse service to the user of the user terminal 1320. Based on the UI, the user terminal 1320 can obtain information to be input to the metaverse service from the user, or output information (eg, multimedia content) related to the metaverse service to the user.

At this time, the server 1310 provides a virtual space so that the user terminal 1320 can perform activities in the virtual space. In addition, the user terminal 1320 installs a S/W agent to access the virtual space provided by the server 1310 to express information provided by the server 1310 to the user, or to express information that the user wishes to express in the virtual space. Transmit information to the server. The S/W agent can be provided directly through the server 1310, downloaded from a public server, or embedded when purchasing a terminal.

In one embodiment, the metaverse service may be provided to the user terminal 1320 and/or the user using the server 1310. The embodiment is not limited to this, and the metaverse service may be provided through individual contact between users. For example, within the network environment 1301, the metaverse service can be provided by a direct connection between the first terminal 1320-1 and the second terminal 1320-2, independently of the server 1310. there is. Referring to FIG. 13, within the network environment 1301, the first terminal 1320-1 and the second terminal 1320-2 may be connected to each other through a network formed by at least one intermediate node 1330. . In an embodiment in which the first terminal 1320-1 and the second terminal 1320-2 are directly connected, one of the first terminal 1320-1 and the second terminal 1320-2 is: It can perform the role of the server 1310. For example, a metaverse environment can be formed solely by device-to-device connection (e.g., peer-to-peer (P2P) connection).

In one embodiment, the user terminal 1320 (or the user terminal 1320 including the first terminal 1320-1 and the second terminal 1320-2) may be made in various form factors and may provide images to the user. or/and an output device for providing sound and an input device for inputting information into the metaverse service. Examples of various form factors of the user terminal 1320 include a smartphone (e.g., the second terminal (1320-2)), an AR device (e.g., the first terminal (1320-1)), a VR device, an MR device, and a VST ( It may include a Video See Through (Video See Through) device, an OST (Optical See Through) device, a smart lens, a smart mirror, and a TV or projector capable of input/output.

The network (e.g., a network formed by at least one intermediate node 1330) includes various broadband networks including 3G, 4G, and 5G and a short-range network including Wifi and BT (e.g., the first terminal 1320-1, and a wired network or wireless network directly connecting the second terminal (1320-2).

A method for displaying media content to express the life cycle may be required. As described above, according to one embodiment, the wearable device 101 may include a display 220 and a processor 210. The processor 210 may identify media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched. The processor 210 may display a first visual object 120 including images of different places within the path on the display 220. The processor 210 generates one or more second visual objects representing the one or more events in conjunction with the first visual object 120, based on at least one of a time interval or point at which the one or more events occurred. (130) can be displayed.

According to one embodiment, the processor 210 may display the route in a third visual object 140 for displaying geographical information.

According to one embodiment, the processor 210 may display locations where the one or more events occurred within the third visual object 140.

According to one embodiment, the processor 210 may enlarge or reduce the third visual object 140 based on an input indicating selection of at least a portion of the third visual object 140.

According to one embodiment, the processor 210 may display the images based on a 3-dimensional virtual coordinate system.

According to one embodiment, the processor 210 selects a fourth visual object related to the event based on an input indicating selection of one (610; 620) of the one or more second visual objects 130. (615; 625) can be displayed.

According to one embodiment, the processor 210 is configured to match a path of a second external electronic device that is different from the external electronic device that is the first external electronic device and one or more events generated by the second external electronic device. Content can be identified. The processor 210, in conjunction with the first visual object 120, based on at least one of a time period or point at which one or more events generated by the second external electronic device occurred, displays the first visual object 120. A fifth visual object 810 corresponding to the object 120 may be displayed.

According to one embodiment, the processor 210 may display a sixth visual object 910 (920) to change the display of the fifth visual object 810.

As described above, according to one embodiment, the method of the wearable device 101 includes the operation of identifying media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched. may include. The method of the wearable device 101 may include displaying a first visual object 120 including images of different points in the path on the display 220. The method of the wearable device 101, based on at least one of a time section or point at which the one or more events occurred, in conjunction with the first visual object 120, one or more objects expressing the one or more events. 2 It may include an operation to display visual objects 130.

According to one embodiment, the method of the wearable device 101 may include an operation of displaying the route in a third visual object 140 for displaying geographical information.

According to one embodiment, the method of the wearable device 101 may include an operation of displaying a location where the one or more events occurred within the third visual object 140.

According to one embodiment, the method of the wearable device 101 enlarges or reduces the third visual object 140 based on an input indicating selection of at least a portion of the third visual object 140. It may include actions such as:

According to one embodiment, the method of the wearable device 101 may include an operation of displaying the images based on a 3-dimensional virtual coordinate system.

According to one embodiment, the method of the wearable device 101 selects one of the one or more second visual objects 130, based on an input indicating selection of a fourth visual object ( 615; 625) may be included.

According to one embodiment, the method of the wearable device 101 includes a path of a second external electronic device that is different from the external electronic device that is a first external electronic device and one or more events generated by the second external electronic device. It may include an operation of identifying matched media content. The method of the wearable device 101 connects the first visual object 120 based on at least one of a time period or point at which one or more events generated by the second external electronic device occurred, It may include an operation of displaying a fifth visual object 810 corresponding to the first visual object 120.

According to one embodiment, the method of the wearable device 101 may include an operation of displaying a sixth visual object 910; 920 to change the display of the fifth visual object 810.

As described above, according to one embodiment, in the computer-readable storage medium storing one or more programs, when the one or more programs are executed by the processor 210 of the wearable device 101, The path of the external electronic device and one or more events generated by the external electronic device may cause the processor 210 of the wearable device 101 to identify matched media content. The one or more programs, when executed by the processor 210 of the wearable device 101, display a first visual object 120 containing images of different points in the path on the display 220. To do so, the processor 210 of the wearable device 101 may be triggered. When executed by the processor 210 of the wearable device 101, the one or more programs display the first visual object 120 and The association may cause the processor 210 of the wearable device 101 to display one or more second visual objects 130 representing the one or more events.

According to one embodiment, the one or more programs, when executed by the processor 210 of the wearable device 101, display the route in a third visual object 140 for displaying geographical information. This may cause the processor 210 of the wearable device 101.

According to one embodiment, the one or more programs, when executed by the processor 210 of the wearable device 101, display the location where the one or more events occurred within the third visual object 140. , may cause the processor 210 of the wearable device 101.

According to one embodiment, when the one or more programs are executed by the processor 210 of the wearable device 101, based on an input indicating selection of at least a portion of the third visual object 140, This may cause the processor 210 of the wearable device 101 to enlarge or reduce the third visual object 140.

According to one embodiment, when the one or more programs are executed by the processor 210 of the wearable device 101, the wearable device displays the images based on a 3-dimensional virtual coordinate system. This may cause the processor 210 of 101.

According to one embodiment, the one or more programs, when executed by the processor 210 of the wearable device 101, respond to an input indicating selection of one of the one or more second visual objects 130. Based on this, the processor 210 of the wearable device 101 may be triggered to display the fourth visual object 615; 625 related to the event.

According to one embodiment, when the one or more programs are executed by the processor 210 of the wearable device 101, the path of the second external electronic device that is different from the external electronic device that is the first external electronic device and the One or more events generated by a second external electronic device may cause the processor 210 of the wearable device 101 to identify matched media content. The one or more programs, when executed by the processor 210 of the wearable device 101, are based on at least one of a time period or point at which one or more events generated by the second external electronic device occurred, In association with the first visual object 120, it may cause the processor 210 of the wearable device 101 to display a fifth visual object 810 corresponding to the first visual object 120. there is.

According to one embodiment, the one or more programs, when executed by the processor 210 of the wearable device 101, include a sixth visual object 910 for changing the display of the fifth visual object 810; This may cause the processor 210 of the wearable device 101 to display 920.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to those components in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are software (e.g., one or more instructions stored in a storage medium (e.g., internal memory or external memory) that can be read by a machine (e.g., electronic device 101). : It can be implemented as a program). For example, a processor (e.g., processor 210) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims

In a wearable device,

display; and

Includes a processor,

The processor,

identify media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched;

display, on the display, a first visual object containing images of different places in the route; and

configured to display, in conjunction with the first visual object, one or more second visual objects representing the one or more events, based on at least one of a time interval or point at which the one or more events occurred,

Wearable devices.
According to claim 1,

The processor,

configured to display the route within a third visual object for displaying geographic information,

Wearable devices.
According to clause 2,

The processor,

configured to indicate, within the third visual object, locations where the one or more events occurred,

Wearable devices.
According to clause 2,

The processor,

configured to enlarge or reduce the third visual object based on an input indicating selection of at least a portion of the third visual object,

Wearable devices.
According to claim 1,

The processor,

Configured to display the images based on a three-dimensional virtual coordinate system,

Wearable devices.
According to claim 1,

The processor,

configured to display a fourth visual object associated with the event based on an input indicating selection of one of the one or more second visual objects,

Wearable devices.
According to claim 1,

The processor,

identifying media content to which a path of a second external electronic device different from the external electronic device, which is a first external electronic device, and one or more events generated by the second external electronic device are matched; and

Displaying a fifth visual object corresponding to the first visual object in conjunction with the first visual object, based on at least one of a time period or point at which one or more events generated by the second external electronic device occurred. to, composed,

Wearable devices.
According to clause 7,

The processor,

configured to display a sixth visual object for changing the display of the fifth visual object,

Wearable devices.
In the method of a wearable device,

identifying media content to which a path of an external electronic device and one or more events generated by the external electronic device are matched;

displaying, on a display, a first visual object containing images of different points in the path; and

Comprising the operation of displaying one or more second visual objects representing the one or more events in association with the first visual object, based on at least one of a time interval or point at which the one or more events occurred,

method.
According to clause 9,

The method of the wearable device includes:

Comprising the act of displaying the route within a third visual object for displaying geographical information,

method.
According to claim 10,

The method of the wearable device includes:

Including, within the third visual object, displaying a location where the one or more events occurred,

method.
According to claim 10,

The method of the wearable device includes:

Comprising an operation of enlarging or reducing the third visual object based on an input indicating selection of at least a portion of the third visual object,

method.
According to clause 9,

The method of the wearable device includes:

Including the operation of displaying the images based on a 3-dimensional virtual coordinate system,

method.
According to clause 9,

The method of the wearable device includes:

Based on an input indicating selection of one of the one or more second visual objects, displaying a fourth visual object associated with the event,

method.
According to clause 9,

The method of the wearable device includes:

identifying media content to which a path of a second external electronic device different from the external electronic device, which is a first external electronic device, and one or more events generated by the second external electronic device are matched; and

Displaying a fifth visual object corresponding to the first visual object in conjunction with the first visual object, based on at least one of a time period or point at which one or more events generated by the second external electronic device occurred. Including the action of

method.