WO2022032589A1 - Panoramic playback method, apparatus and system, photographing device, and movable platform - Google Patents

Panoramic playback method, apparatus and system, photographing device, and movable platform Download PDF

Info

Publication number
WO2022032589A1
WO2022032589A1 PCT/CN2020/108980 CN2020108980W WO2022032589A1 WO 2022032589 A1 WO2022032589 A1 WO 2022032589A1 CN 2020108980 W CN2020108980 W CN 2020108980W WO 2022032589 A1 WO2022032589 A1 WO 2022032589A1
Authority
WO
WIPO (PCT)
Prior art keywords
panoramic image
processor
image
initial
library
Prior art date
Application number
PCT/CN2020/108980
Other languages
French (fr)
Chinese (zh)
Inventor
翁松伟
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080039570.5A priority Critical patent/CN113906727A/en
Priority to PCT/CN2020/108980 priority patent/WO2022032589A1/en
Publication of WO2022032589A1 publication Critical patent/WO2022032589A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio

Definitions

  • the present application relates to the field of panoramic images, and in particular, to a method for panoramic playback, an apparatus for panoramic playback, a shooting device, a movable platform, and a system for panoramic playback.
  • the user cannot directly edit the played back panoramic image to obtain the desired panoramic image. If the user is not satisfied with the captured panoramic image, he can only shoot again. , until a satisfactory panoramic image is captured, and then download it, or you can only passively download the panoramic image that the user is not satisfied with, and then import it into other image editing software for editing. High rate and cumbersome post-editing problems.
  • an embodiment of the present application provides a panorama playback method, including:
  • an apparatus for panoramic playback including:
  • memory for storing processor-executable instructions
  • processor is configured to:
  • an embodiment of the present application provides a photographing device, including:
  • memory for storing processor-executable instructions
  • processor is configured to:
  • an embodiment of the present application provides a movable platform on which a photographing device is mounted, and the photographing device includes:
  • memory for storing processor-executable instructions
  • processor is configured to:
  • an embodiment of the present application provides a system for panoramic playback, including a movable platform and a designated application, wherein a shooting device is installed on the movable platform, the designated application is installed on an electronic device, and the movable platform is connected to the designated application.
  • the electronic device is communicatively connected, the photographing device includes a processor and a memory, the memory is used for storing instructions, and the processor calls the instructions stored in the memory to implement the following operations when responding to a request from the specified application :
  • the corresponding proof image is re-synthesized to the target panoramic image and output to the interface of the designated application on the electronic device for playback.
  • the present application realizes that the target panoramic image can be re-synthesized for any selected area on the played back panoramic image for output playback.
  • FIG. 1 is a flowchart of a panorama playback method according to an exemplary embodiment of the present application.
  • FIG. 2 is a schematic diagram of an initial panoramic image according to an exemplary embodiment of the present application.
  • FIG. 3 is a schematic diagram of a re-synthesized panoramic image according to an exemplary embodiment of the present application.
  • Fig. 4 is a specific flowchart showing a spherical panorama playback according to an exemplary embodiment of the present application.
  • FIG. 5 is a schematic diagram of a device for panoramic playback according to an exemplary embodiment of the present application.
  • FIG. 6 is a schematic diagram of a photographing device shown in an exemplary embodiment of the present application.
  • FIG. 7 is a schematic diagram of a movable platform according to an exemplary embodiment of the present application.
  • FIG. 8 is a schematic diagram of a system for panoramic playback according to an exemplary embodiment of the present application.
  • a panoramic image refers to an image synthesized from a plurality of photographed proof images
  • a panoramic playback refers to the output and playback on the playback interface after synthesizing various proof images shot by a photographing device into a panoramic image. , which is the output preview for the user to download.
  • the photographing device refers to an electronic device capable of capturing images, for example, a camera, a mobile phone, a tablet computer, and the like.
  • the shooting device can output the synthesized panoramic image to the playback interface corresponding to other electronic devices that establish a connection relationship with it for playback, wherein the connection can be a wireless connection or a wired connection; In the case of the function, the shooting device can also use the synthesized panoramic image for the playback interface of the local device for output playback.
  • the photographing device can synthesize the photographed sample images into a panoramic image, and then output the corresponding electronic device to the electronic device that has established a connection relationship with it.
  • the playback interface can be used for playback; the photographing equipment can also transmit the photographed sample images to the electronic equipment that has established a connection relationship with it, and the electronic equipment can synthesize the panoramic image and then perform the panoramic playback.
  • an actual scenario of the present application may be that a user on the ground controls a remote control electronic device, controls a drone equipped with a camera to fly according to a pre-planned route, collects a certain number of sample images, and combines the collected sample images into a The panoramic image is then sent back to the remote control electronic device of the user on the ground for panoramic playback.
  • the user when the panoramic playback is performed on the playback interface, the user cannot edit it, for example, select the area of interest to the user to download, but can only passively download the entire image and then edit it later. Get user-satisfied images.
  • the embodiment of the present application provides a new panorama playback method.
  • the panorama image of the playback interface can be edited to regenerate a new panorama image for the user to download, which effectively reduces the abandonment rate of the panorama image captured by the user.
  • the re-editing workload for the user to shoot the panoramic image the user's stickiness is greatly improved.
  • the method can be applied to a photographing device, and of course, can also be applied to an electronic device that has a connection relationship with the photographing device and can receive images.
  • FIG. 1 is a flowchart of a panorama playback method shown in an exemplary embodiment of the present application. As shown in FIG. 1, the following steps are included:
  • the panoramic image may be a banner panoramic image or a spherical panoramic image, and the present application does not limit the type of the panoramic image.
  • the initial panoramic image and the newly synthesized target panoramic image can be different types of panoramic images.
  • the corresponding proof image can be determined based on the selected area on the spherical panoramic image, and then re-synthesized.
  • the banner panorama image of the content of the area should be selected, and vice versa is also possible.
  • the selected area on the newly synthesized target panoramic image can also be continuously acquired, and the synthesized target panoramic image based on the sample corresponding to the selected area is again output and played back until the user obtains a satisfactory panoramic image. download.
  • the number of selected regions may be only one, or there may be multiple ones, and corresponding panorama images may be re-synthesized for each selected region on the panorama image respectively.
  • the initial panoramic image and each newly synthesized target panoramic image can be displayed in different regions in the playback interface, so that the user can see the initial panoramic image and all the re-synthesized target panoramic images, and can choose any one.
  • Panorama images can be downloaded, or any panorama image can be selected to recompose the panorama image.
  • it can also be displayed in multiple layers on the playback interface, each layer displays a panoramic image, and the user can set the panoramic image to be previewed as the uppermost display. It can be understood that the above display manners are only exemplary, and the present application does not limit how the initial panoramic image and each newly synthesized target panoramic image are displayed in the playback interface.
  • synthesis information of each sample image may also be recorded, for example, matching information of feature points between each sample image, overlapping part between the sample images on the relevant sample image. Specific gravity information, etc., so that when the target panoramic image is re-synthesized subsequently, it can be directly synthesized according to the synthesis information, which avoids repeated calculations and improves the efficiency of re-synthesis.
  • the editing of the panoramic image may also include cutting out or adding annotations to the specified area on the output and playback panoramic image.
  • the specified region can be any shape, such as a rectangle, a circle, a heart shape, etc.
  • the user can download the captured image;
  • the user can also add annotations to it, for example, you can specify any area to add text annotations, where the text can be in any font.
  • the size can be adjusted arbitrarily.
  • the panoramic image obtained by directly intercepting the panoramic image displayed on the panoramic playback interface, and the sample image corresponding to the selected area of the panoramic image displayed on the panoramic playback interface are re-synthesized.
  • the quality of the image obtained by the two methods is quite different in some specific occasions.
  • the panorama image is synthesized by the camera mounted on the drone and then sent back to the electronic device held by the ground user for playback. Since the panorama image is synthesized by the camera, the camera only combines the synthesized panoramic image. For back transmission, and due to the large capacity of the synthesized panoramic image, considering the efficiency of transmission and the real-time requirements of playback, the panoramic image after a certain compression process is transmitted back, then the actual playback panoramic image Compared with the resolution of the truly synthesized panoramic image, there is a certain degree of decrease. If the playback of the panoramic image is directly intercepted, there will also be a certain degree of decrease in the resolution.
  • the resolution of the panorama image played back is the resolution of the real synthesis, so the quality of the new panorama image obtained will be better than that obtained by direct interception .
  • the user can freely select any area on the panorama image of the playback interface for resynthesis.
  • it can also be based on performing image recognition on the playback panorama image to recommend some regions to be selected to the user for selection by the user.
  • it is possible to mark the specified elements on the replayed panoramic image and establish a mark library, for example, to mark the specified elements on the initial panoramic image, wherein the elements mentioned in this embodiment may refer to the elements included in the panoramic image.
  • Arbitrary shooting objects such as high-rise buildings, roads, bridges and other typical shooting objects, identify the elements existing in the initial panoramic image through image recognition, and mark some typical elements. For some typical elements such as high-rise buildings, roads, and bridges, such elements can be marked, and based on the marked elements, a candidate area can be generated on the initial panoramic image for the user to choose.
  • the to-be-selected area may be generated centered on the marked element, and the size of the generated to-be-selected area may be freely adjusted according to user requirements.
  • the solution of the embodiment of the present application will be described more clearly below with reference to FIG. 2 and FIG. 3 .
  • FIG. 2 is an initial panoramic image shown in an exemplary embodiment of the present application. After identifying the initial panoramic image, while displaying on the playback interface, the typical elements in the image are marked based on the recognition result. Establish a tag library, as shown in Figure 2, respectively mark tall buildings and bridges, and generate corresponding regions A and B to be selected. When the user selects region B to be selected, based on the sample image corresponding to the region to be selected, Re-synthesize the target panoramic image as shown in Figure 3. It can be understood that the above-mentioned initial panorama image shown in FIG. 2 is marked and generated as the candidate regions, not only A and B, but more regions are not shown in the figure. The above is only A and B.
  • the number of the generated candidate regions is not limited.
  • the number of the generated candidate regions is not limited.
  • the user's trouble of manual selection is saved, and the quality of the resynthesized panoramic image is ensured while facilitating the user to recompose the image.
  • the region to be selected may be continuously generated on the subsequently re-synthesized panoramic image, so as to continue to synthesize a new panoramic image for playback based on the selected region to be selected.
  • a mapping library between elements on the initial panoramic image and each sample image may be established.
  • the mapping library with each sample image specifically, by detecting and extracting the feature points on the initial panoramic image that are used to identify the elements included in the initial panoramic image, and then based on the mapping relationship between each group of feature points and each sample image. Build a library of mappings between different elements and individual proof images.
  • FIG. 4 is a specific flowchart showing a spherical panorama playback according to an exemplary embodiment of the present application, including the following steps:
  • S405 Determine a proof image corresponding to the selected area based on the elements included in the selected area and the mapping library, re-synthesize the spherical panorama, and execute S403.
  • An embodiment of the present application further provides a panoramic playback device, as shown in FIG. 5 , which is a panoramic playback device 50 shown in an exemplary embodiment of the present application, including:
  • memory 502 for storing instructions executable by processor 501;
  • processor 501 is configured as:
  • An embodiment of the present application further provides a photographing device, as shown in FIG. 6 , which is a photographing device 60 shown in an exemplary embodiment of the present application, including:
  • memory 602 for storing instructions executable by processor 601;
  • processor 601 is configured as:
  • An embodiment of the present application further provides a movable platform, as shown in FIG. 7 , which is a movable platform 70 shown in an exemplary embodiment of the present application, on which the photographing device 60 shown in FIG.
  • the movable platform may be an unmanned aerial vehicle, an unmanned vehicle, or the like.
  • the present application also provides a system for panoramic playback, as shown in FIG. 8 , which is a system for panoramic playback shown in an exemplary embodiment of the present application, including a movable platform 70 as shown in FIG. 7 and a designated application 80, the designated application 80 is installed on the electronic device 81, the movable platform 70 is connected in communication with the electronic device 81, and when the processor 601 in the photographing device 60 responds to the request of the designated application 80, the instruction stored in the memory 602 is called for realizing the following operations:
  • the corresponding proof image is re-synthesized and the target panoramic image is output to the interface of the designated application 80 on the electronic device 81 for playback.
  • the apparatus embodiments since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts.
  • the device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Provided is a panoramic playback method. The method comprises: outputting and playing back an initial panoramic image synthesized from a plurality of sample images; acquiring a selected area on the initial panoramic image, and determining sample images corresponding to the selected area; and resynthesizing the corresponding sample images into a target panoramic image for output and playback. By means of the present application, a target panoramic image can be resynthesized for any selected area on a panoramic image which is played back, and same can be outputted and played back. Further provided are a panoramic playback apparatus, a photographing device, a movable platform and a panoramic playback system.

Description

全景回放的方法、装置和系统、拍摄设备、可移动平台Panoramic playback method, device and system, shooting equipment, movable platform 技术领域technical field
本申请涉及全景图像领域,尤其涉及一种全景回放的方法、全景回放的装置、拍摄设备、可移动平台以及全景回放的系统。The present application relates to the field of panoramic images, and in particular, to a method for panoramic playback, an apparatus for panoramic playback, a shooting device, a movable platform, and a system for panoramic playback.
背景技术Background technique
拍摄设备所拍摄的全景图像在回放界面进行全景回放时,用户无法直接对回放的全景图像进行编辑得到自己想要的全景图像,如果用户对所拍摄的全景图像不满意,则只能重新进行拍摄,直至拍摄到满意的全景图像再进行下载,或者只能被动地下载用户所不满意的全景图像,后期再导入到其他的图像编辑软件进行编辑,显然,现有的全景回放至少存在全景样张废弃率高以及后期编辑繁琐的问题。When the panoramic image captured by the shooting device is played back on the playback interface, the user cannot directly edit the played back panoramic image to obtain the desired panoramic image. If the user is not satisfied with the captured panoramic image, he can only shoot again. , until a satisfactory panoramic image is captured, and then download it, or you can only passively download the panoramic image that the user is not satisfied with, and then import it into other image editing software for editing. High rate and cumbersome post-editing problems.
发明内容SUMMARY OF THE INVENTION
第一方面,本申请实施例提供一种全景回放的方法,包括:In a first aspect, an embodiment of the present application provides a panorama playback method, including:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
第二方面,本申请实施例提供一种全景回放的装置,包括:In a second aspect, an embodiment of the present application provides an apparatus for panoramic playback, including:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,所述处理器被配置为:wherein the processor is configured to:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
第三方面,本申请实施例提供一种拍摄设备,包括:In a third aspect, an embodiment of the present application provides a photographing device, including:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,所述处理器被配置为:wherein the processor is configured to:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
第四方面,本申请实施例提供一种可移动平台,其上搭载拍摄设备,所述拍摄设备包括:In a fourth aspect, an embodiment of the present application provides a movable platform on which a photographing device is mounted, and the photographing device includes:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
其中,所述处理器被配置为:wherein the processor is configured to:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
第五方面,本申请实施例提供一种全景回放的系统,包括可移动平 台和指定应用,所述可移动平台上装有拍摄设备,所述指定应用安装于电子设备,所述可移动平台与所述电子设备通信连接,所述拍摄设备包括处理器和存储器,所述存储器用于存储指令,所述处理器在响应所述指定应用的请求时,调用所述存储器存储的指令用于实现以下操作:In a fifth aspect, an embodiment of the present application provides a system for panoramic playback, including a movable platform and a designated application, wherein a shooting device is installed on the movable platform, the designated application is installed on an electronic device, and the movable platform is connected to the designated application. The electronic device is communicatively connected, the photographing device includes a processor and a memory, the memory is used for storing instructions, and the processor calls the instructions stored in the memory to implement the following operations when responding to a request from the specified application :
将由多个样张图像合成的初始全景图像输出到所述电子设备上指定应用的界面进行回放;outputting the initial panoramic image synthesized from multiple proof images to the interface of the designated application on the electronic device for playback;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出到所述电子设备上指定应用的界面进行回放。The corresponding proof image is re-synthesized to the target panoramic image and output to the interface of the designated application on the electronic device for playback.
本申请通过确定输出回放的初始全景图像上的选中区域所对应的用于合成该初始全景图像的样张图像,实现了可以针对所回放的全景图像上任意选中区域重新合成目标全景图像来输出回放。By determining the proof image for synthesizing the initial panoramic image corresponding to the selected area on the initial panoramic image for output playback, the present application realizes that the target panoramic image can be re-synthesized for any selected area on the played back panoramic image for output playback.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.
图1是本申请一示例性实施例示出的一种全景回放的方法流程图。FIG. 1 is a flowchart of a panorama playback method according to an exemplary embodiment of the present application.
图2是本申请一示例性实施例示出的一张初始全景图像示意图。FIG. 2 is a schematic diagram of an initial panoramic image according to an exemplary embodiment of the present application.
图3是本申请一示例性实施例示出的一张重新合成的全景图像示意图。FIG. 3 is a schematic diagram of a re-synthesized panoramic image according to an exemplary embodiment of the present application.
图4是本申请一示例性实施例示出一种球形全景回放的具体流程 图。Fig. 4 is a specific flowchart showing a spherical panorama playback according to an exemplary embodiment of the present application.
图5是本申请一示例性实施例示出的一种全景回放的装置示意图。FIG. 5 is a schematic diagram of a device for panoramic playback according to an exemplary embodiment of the present application.
图6是本申请一示例性实施例示出的一种拍摄设备示意图。FIG. 6 is a schematic diagram of a photographing device shown in an exemplary embodiment of the present application.
图7是本申请一示例性实施例示出的一种可移动平台示意图。FIG. 7 is a schematic diagram of a movable platform according to an exemplary embodiment of the present application.
图8是本申请一示例性实施例示出的一种全景回放的系统示意图。FIG. 8 is a schematic diagram of a system for panoramic playback according to an exemplary embodiment of the present application.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
本申请实施例中全景图像指的是由所拍摄的多张样张图像合成的图像,全景回放指的是,将拍摄设备所拍摄的各样张图像合成为全景图像后,在回放界面上进行输出回放,也即是输出预览,以供用户下载。其中,拍摄设备指的是具备采集图像功能的电子设备,例如可以是相机、手机、平板电脑等。In the embodiment of the present application, a panoramic image refers to an image synthesized from a plurality of photographed proof images, and a panoramic playback refers to the output and playback on the playback interface after synthesizing various proof images shot by a photographing device into a panoramic image. , which is the output preview for the user to download. The photographing device refers to an electronic device capable of capturing images, for example, a camera, a mobile phone, a tablet computer, and the like.
拍摄设备可以将所合成的全景图像输出到其他与其建立连接关系的电子设备上对应的回放界面进行回放,其中,所述连接可以是无线连接,也可以是有线连接;当然,在拍摄设备具备显示功能的情况下,拍摄设备也可以将所合成的全景图像用于本端设备的回放界面进行输出回放。The shooting device can output the synthesized panoramic image to the playback interface corresponding to other electronic devices that establish a connection relationship with it for playback, wherein the connection can be a wireless connection or a wired connection; In the case of the function, the shooting device can also use the synthesized panoramic image for the playback interface of the local device for output playback.
另外,如果是由其他与拍摄设备建立连接关系的电子设备进行全景回放,则既可以由拍摄设备将所拍摄的各样张图像合成为全景图像后,再输出到与其建立连接关系的电子设备上对应的回放界面进行回放;也可以 由拍摄设备将所拍摄的各样张图像传输给与其建立连接关系的电子设备,由该电子设备合成为全景图像后再进行全景回放。例如,本申请一个实际的场景可以是,由地面上用户操控遥控电子设备,控制搭载有相机的无人机按预规划的航线飞行并采集一定数量的样张图像,将所采集的样张图像合成为全景图像,再回传给地面上用户的遥控电子设备进行全景回放。In addition, if the panorama playback is performed by other electronic devices that have established a connection relationship with the photographing device, the photographing device can synthesize the photographed sample images into a panoramic image, and then output the corresponding electronic device to the electronic device that has established a connection relationship with it. The playback interface can be used for playback; the photographing equipment can also transmit the photographed sample images to the electronic equipment that has established a connection relationship with it, and the electronic equipment can synthesize the panoramic image and then perform the panoramic playback. For example, an actual scenario of the present application may be that a user on the ground controls a remote control electronic device, controls a drone equipped with a camera to fly according to a pre-planned route, collects a certain number of sample images, and combines the collected sample images into a The panoramic image is then sent back to the remote control electronic device of the user on the ground for panoramic playback.
对于拍摄设备所拍摄的全景图像,在回放界面进行全景回放时,用户无法对其进行编辑,例如选择用户感兴趣的区域来进行下载,而只能被动地下载整张图像再通过后期的编辑才能得到用户满意的图像。For the panoramic image shot by the shooting device, when the panoramic playback is performed on the playback interface, the user cannot edit it, for example, select the area of interest to the user to download, but can only passively download the entire image and then edit it later. Get user-satisfied images.
对此,本申请实施例提供了新的全景回放方法,作为改进,可以实现对回放界面的全景图像进行编辑以重新生成新的全景图像供用户下载,有效地减少用户拍摄全景图像的废弃率,以及用户拍摄全景图像的再次编辑工作量,极大程度地提高了用户的粘性。该方法可以应用于拍摄设备,当然,也可以应用于与拍摄设备建立有连接关系,可以接收图像的电子设备上。In this regard, the embodiment of the present application provides a new panorama playback method. As an improvement, the panorama image of the playback interface can be edited to regenerate a new panorama image for the user to download, which effectively reduces the abandonment rate of the panorama image captured by the user. As well as the re-editing workload for the user to shoot the panoramic image, the user's stickiness is greatly improved. The method can be applied to a photographing device, and of course, can also be applied to an electronic device that has a connection relationship with the photographing device and can receive images.
请参照图1,图1是本申请一示例性实施例示出的一种全景回放的方法流程图,如图1所示,包括以下步骤:Please refer to FIG. 1. FIG. 1 is a flowchart of a panorama playback method shown in an exemplary embodiment of the present application. As shown in FIG. 1, the following steps are included:
S101,将由多个样张图像合成的初始全景图像输出回放;S101, output playback playback of an initial panoramic image synthesized by a plurality of proof images;
S102,获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;S102, acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
S103,将所述对应的样张图像重新合成目标全景图像输出回放。S103: Re-synthesize the corresponding proof image into the target panoramic image and output it for playback.
其中,全景图像可以是横幅全景图像,也可以是球形全景图像,本申请并不限定全景图像的类型。且初始全景图像和新合成的目标全景图像可以是不同类型的全景图像,例如初始全景图像为球形全景图像时,可以基于在球形全景图像上的选中区域确定所对应的样张图像,再重新合成对应该选中区域内容的横幅全景图像,反之也同样可行。The panoramic image may be a banner panoramic image or a spherical panoramic image, and the present application does not limit the type of the panoramic image. And the initial panoramic image and the newly synthesized target panoramic image can be different types of panoramic images. For example, when the initial panoramic image is a spherical panoramic image, the corresponding proof image can be determined based on the selected area on the spherical panoramic image, and then re-synthesized. The banner panorama image of the content of the area should be selected, and vice versa is also possible.
另外,对于新合成的目标全景图像,还可以继续获取该新合成的目标全景图像上的选中区域,再次重新基于选中区域所对应的样张合成目标全景图像输出回放,直至用户得到满意的全景图像进行下载。且对于每张全景图像而言,选中区域的数量可以只有1个,也可以有多个,可以分别为全景图像上的每个选中区域重新合成对应的全景图像。In addition, for the newly synthesized target panoramic image, the selected area on the newly synthesized target panoramic image can also be continuously acquired, and the synthesized target panoramic image based on the sample corresponding to the selected area is again output and played back until the user obtains a satisfactory panoramic image. download. And for each panorama image, the number of selected regions may be only one, or there may be multiple ones, and corresponding panorama images may be re-synthesized for each selected region on the panorama image respectively.
可选的,对于初始全景图像和各新合成的目标全景图像,可以在回放界面中分区域进行显示,使得用户能看到初始全景图像和所有重新合成的目标全景图像,既可以选择任一张全景图像进行下载,也可以选择任一张全景图像用来重新合成全景图像。当然,除了分区域显示以外,还可以是在回放界面分多层显示,每层显示一张全景图像,用户可以将想要预览的全景图像设为最上层显示。可以理解,以上的显示方式仅仅是示例性的,对于初始全景图像和各新合成的目标全景图像在回放界面中如何显示,本申请并不限定。Optionally, for the initial panoramic image and each newly synthesized target panoramic image, it can be displayed in different regions in the playback interface, so that the user can see the initial panoramic image and all the re-synthesized target panoramic images, and can choose any one. Panorama images can be downloaded, or any panorama image can be selected to recompose the panorama image. Of course, in addition to sub-regional display, it can also be displayed in multiple layers on the playback interface, each layer displays a panoramic image, and the user can set the panoramic image to be previewed as the uppermost display. It can be understood that the above display manners are only exemplary, and the present application does not limit how the initial panoramic image and each newly synthesized target panoramic image are displayed in the playback interface.
在一个实施例中,在合成初始全景图像时,还可以记录各个样张图像的合成信息,例如各样张图像之间的特征点的匹配信息,样张图像之间的重叠部分在相关的样张图像上的比重信息等,以便在后续重新合成目标全景图像时可以直接依照该合成信息进行合成,避免了重复的计算,提高重新合成的效率。In one embodiment, when synthesizing the initial panoramic image, synthesis information of each sample image may also be recorded, for example, matching information of feature points between each sample image, overlapping part between the sample images on the relevant sample image. Specific gravity information, etc., so that when the target panoramic image is re-synthesized subsequently, it can be directly synthesized according to the synthesis information, which avoids repeated calculations and improves the efficiency of re-synthesis.
当然,对全景图像的编辑,除了基于全景图像上的选中区域重新合成全景图像外,还可以包括,对输出回放的全景图像上的指定区域进行截取,或者添加标注。例如,对于任意在全景回放界面所显示的全景图像,可以基于用户指定的区域对其进行截取,其中,所指定的区域可以是任意形状的区域,例如可以是矩形、圆形、心形等形状,用户可以对截取所得的图像进行下载;对于任意在全景回放界面所显示的全景图像,用户还可以对其添加标注,例如可以指定任意区域添加文字标注,其中文字可以是任意字体的文字,文字大小可以进行任意调节,当然,也不排除还可以是 在指定区域添加图片、动画表情等形式的标注,可以理解,以上所列举的编辑方式仅仅为示例性,并不代表全部,在可行的情况下,还可以对所回放的全景图像进行其他的编辑,本申请实施例不进行穷举。Of course, the editing of the panoramic image, in addition to synthesizing the panoramic image based on the selected area on the panoramic image, may also include cutting out or adding annotations to the specified area on the output and playback panoramic image. For example, for any panorama image displayed on the panorama playback interface, it can be intercepted based on a region specified by the user, where the specified region can be any shape, such as a rectangle, a circle, a heart shape, etc. , the user can download the captured image; for any panoramic image displayed in the panoramic playback interface, the user can also add annotations to it, for example, you can specify any area to add text annotations, where the text can be in any font. The size can be adjusted arbitrarily. Of course, it is also possible to add annotations in the form of pictures, animated expressions, etc. in the designated area. It is understood that the editing methods listed above are only exemplary and do not represent all. In the following, other editing may also be performed on the played back panoramic image, which is not exhaustive in this embodiment of the present application.
值得注意的是,通过直接对全景回放界面所显示的全景图像进行截取的方式所得到的全景图像,以及通过对全景回放界面所显示的全景图像的选中区域所对应的的样张图像进行重新合成的方式所得到的全景图像,两种方式所得到的图像的质量在某些特定场合下是存在较大差异的,可以参考下面所举出的实际场景:由地面上用户操控遥控电子设备,控制搭载有相机的无人机按预规划的航线飞行并采集一定数量的样张图像,将所采集的样张图像合成全景图像,再回传给地面上用户的遥控电子设备进行全景回放。在该场景中由无人机所搭载的相机合成全景图像后回传给地面用户所持有的的电子设备进行回放,由于是由相机进行全景图像的合成,因此相机仅将合成后的全景图像进行回传,且由于合成的全景图像容量较大,考虑到传输的效率和回放的实时性要求,因此是将经过一定的压缩处理后的全景图像进行回传,那么实际上所回放的全景图像相比真正合成的全景图像的分辨率存在一定程度的下降,如果直接对所回放的全景图像进行截取,则也会同样存在分辨率出现一定程度的下降的问题。但如果是基于所回放的全景图像上选中区域所对应的的样张图像重新合成,则由于合成的是局部的全景图像,所使用的样张图像数量减少,因此新合成的全景图像容量也随之减小,因此可以不再进行压缩处理而直接回传,此时所回放的全景图像的分辨率为真正合成时的分辨率,因此得到的新的全景图像的质量相比直接截取所得的会更好。It is worth noting that the panoramic image obtained by directly intercepting the panoramic image displayed on the panoramic playback interface, and the sample image corresponding to the selected area of the panoramic image displayed on the panoramic playback interface are re-synthesized. For the panoramic image obtained by the method, the quality of the image obtained by the two methods is quite different in some specific occasions. You can refer to the actual scene listed below: the user on the ground controls the remote control electronic equipment, controls the onboard A drone with a camera flies according to a pre-planned route and collects a certain number of proof images, synthesizes the collected proof images into a panoramic image, and sends it back to the user's remote-controlled electronic device on the ground for panoramic playback. In this scene, the panorama image is synthesized by the camera mounted on the drone and then sent back to the electronic device held by the ground user for playback. Since the panorama image is synthesized by the camera, the camera only combines the synthesized panoramic image. For back transmission, and due to the large capacity of the synthesized panoramic image, considering the efficiency of transmission and the real-time requirements of playback, the panoramic image after a certain compression process is transmitted back, then the actual playback panoramic image Compared with the resolution of the truly synthesized panoramic image, there is a certain degree of decrease. If the playback of the panoramic image is directly intercepted, there will also be a certain degree of decrease in the resolution. However, if it is re-synthesized based on the sample images corresponding to the selected area on the playback panorama image, since the composite is a partial panoramic image, the number of sample images used is reduced, so the capacity of the newly synthesized panoramic image is also reduced accordingly. The resolution of the panorama image played back is the resolution of the real synthesis, so the quality of the new panorama image obtained will be better than that obtained by direct interception .
在一个实施例中,可以由用户自由选择回放界面的全景图像上任意区域进行重新合成,当然,还可以是基于对所回放的全景图像进行图像识别,以向用户推荐一些待选区域供用户选择,具体的,可以对所回放的全景图像上指定的元素进行标记并建立标记库,例如标记初始全景图像上指 定的元素,其中,本实施例所说的元素指的可以是全景图像所包括的任意拍摄对象,比如高楼建筑、马路、桥梁等一些较为典型的拍摄对象,通过图像识别识别出初始全景图像上存在的元素,并对一些典型的元素进行标记,例如如果识别出初始全景图像上存在高楼建筑、马路、桥梁等一些典型元素,则可以对该类元素进行标记,并基于标记的元素在初始全景图像上生成待选区域以供用户选择。In one embodiment, the user can freely select any area on the panorama image of the playback interface for resynthesis. Of course, it can also be based on performing image recognition on the playback panorama image to recommend some regions to be selected to the user for selection by the user. Specifically, it is possible to mark the specified elements on the replayed panoramic image and establish a mark library, for example, to mark the specified elements on the initial panoramic image, wherein the elements mentioned in this embodiment may refer to the elements included in the panoramic image. Arbitrary shooting objects, such as high-rise buildings, roads, bridges and other typical shooting objects, identify the elements existing in the initial panoramic image through image recognition, and mark some typical elements. For some typical elements such as high-rise buildings, roads, and bridges, such elements can be marked, and based on the marked elements, a candidate area can be generated on the initial panoramic image for the user to choose.
其中,待选区域可以是以所标记的元素为中心生成,且所生成的待选区域大小可以根据用户需求自由调节。下面结合图2和图3来更清楚地说明本申请实施例的方案。The to-be-selected area may be generated centered on the marked element, and the size of the generated to-be-selected area may be freely adjusted according to user requirements. The solution of the embodiment of the present application will be described more clearly below with reference to FIG. 2 and FIG. 3 .
请参照图2,图2是本申请一示例性实施例示出的一张初始全景图像,通过对该初始全景图像识别后,在回放界面展示的同时,基于识别的结果对图像中典型元素进行标记建立标记库,如图2中所示,分别对高楼与桥梁进行了标记,并生成对应的待选区域A、B,在用户选中待选区域B时,基于待选区域所对应的样张图像,重新合成得到如图3所示的目标全景图像。可以理解,以上对图2所示的初始全景图像进行标记并生成的待选区域并非只有A、B两个区域,而更多的区域并未在图中示出,以上仅是以A、B为例进行说明,并非限定所生成的待选区域的数量。本实施例通过向用户推荐一些优选的待选区域供用户重新构图,省去了用户手动选择的麻烦,在方便用户重新构图的同时也保证了重新合成的全景图像的质量。Please refer to FIG. 2. FIG. 2 is an initial panoramic image shown in an exemplary embodiment of the present application. After identifying the initial panoramic image, while displaying on the playback interface, the typical elements in the image are marked based on the recognition result. Establish a tag library, as shown in Figure 2, respectively mark tall buildings and bridges, and generate corresponding regions A and B to be selected. When the user selects region B to be selected, based on the sample image corresponding to the region to be selected, Re-synthesize the target panoramic image as shown in Figure 3. It can be understood that the above-mentioned initial panorama image shown in FIG. 2 is marked and generated as the candidate regions, not only A and B, but more regions are not shown in the figure. The above is only A and B. It is described as an example, and the number of the generated candidate regions is not limited. In this embodiment, by recommending some preferred areas to be selected to the user for the user to recompose the image, the user's trouble of manual selection is saved, and the quality of the resynthesized panoramic image is ensured while facilitating the user to recompose the image.
在一个实施例中,还可以基于所建立的标记库在后续重新合成的全景图像上继续生成待选区域,以便基于选中的待选区域继续合成新的全景图像输出回放。In one embodiment, based on the established marker library, the region to be selected may be continuously generated on the subsequently re-synthesized panoramic image, so as to continue to synthesize a new panoramic image for playback based on the selected region to be selected.
由于需要知道用户在回放的全景图像上的选中区域所对应的样张图像,才能知道用哪些样张图像来进行重新合成,因此,下面将介绍确定全景图像上的选中区域所对应的样张图像的方法。Since it is necessary to know the sample images corresponding to the selected area on the panorama image played back by the user, in order to know which sample images to use for recombination, the following will introduce the method for determining the sample image corresponding to the selected area on the panoramic image.
在一个实施例中,对于所合成的初始全景图像与合成该初始全景图像的各个样张图像,可以建立初始全景图像上的元素与各个样张图像之间的映射库,对于用户在初始全景图像上的选中区域,可以通过确定选中区域所包括的元素,基于选中区域包括的元素与映射库确定选中区域对应的样张图像,由于初始全景图像上的元素与各个样张图像之间存在映射关系,因此在确定选中区域所包括的元素后,可以依照该映射关系确定选中区域所包括的元素所对应的所有样张图像,进而确定出选中区域所对应的样张图像。In one embodiment, for the synthesized initial panoramic image and each sample image synthesized from the initial panoramic image, a mapping library between elements on the initial panoramic image and each sample image may be established. For the selected area, you can determine the elements included in the selected area, and determine the sample image corresponding to the selected area based on the elements included in the selected area and the mapping library. Since there is a mapping relationship between the elements on the initial panoramic image and each sample image, it is necessary to determine the sample image. After the elements included in the area are selected, all sample images corresponding to the elements included in the selected area can be determined according to the mapping relationship, and then the sample images corresponding to the selected area can be determined.
另外,由于识别初始全景图像上的元素主要依靠识别特征点来进行识别,而初始全景图像上各元素所对应的特征点与各个样张图像之间存在一定的映射,因此建立初始全景图像上的元素与各个样张图像之间的映射库,具体可以是通过检测并提取初始全景图像上用于识别该初始全景图像所包括的元素的特征点,再基于各组特征点与各个样张图像的映射关系来建立不同元素与各个样张图像之间的映射库。In addition, since the identification of elements on the initial panoramic image mainly relies on identifying feature points, and there is a certain mapping between the feature points corresponding to each element on the initial panoramic image and each sample image, the elements on the initial panoramic image are established. The mapping library with each sample image, specifically, by detecting and extracting the feature points on the initial panoramic image that are used to identify the elements included in the initial panoramic image, and then based on the mapping relationship between each group of feature points and each sample image. Build a library of mappings between different elements and individual proof images.
下面将结合图4来进一步说明全景回放的一个具体流程,请参照图4,图4是本申请一示例性实施例示出一种球形全景回放的具体流程图,包括以下步骤:A specific process of panorama playback will be further described below in conjunction with FIG. 4. Please refer to FIG. 4. FIG. 4 is a specific flowchart showing a spherical panorama playback according to an exemplary embodiment of the present application, including the following steps:
S401,采集多个样张图像并合成球形全景图;S401, collecting multiple proof images and synthesizing a spherical panorama;
S402,标记球形全景图上指定的元素,建立标记库,以及建立初始球形全景图像上的元素与该多个样张图像之间的映射库;S402, mark the specified elements on the spherical panorama, establish a mark library, and establish a mapping library between the elements on the initial spherical panoramic image and the multiple proof images;
S403,基于标记库在球形全景图上生成待选区域并输出回放,提示用户进行下载或选择待选区域进行重新构图;S403, generating a candidate area on the spherical panorama based on the marker library and outputting playback, prompting the user to download or select the candidate area to recompose the image;
S404,确定所回放的球形全景图上是否存在选中区域,若是,则执行S405;否则,流程结束;S404, determine whether there is a selected area on the replayed spherical panorama, if so, execute S405; otherwise, the process ends;
S405,基于选中区域包括的元素与映射库确定选中区域对应的样张 图像,并重新合成球形全景图,并执行S403。S405: Determine a proof image corresponding to the selected area based on the elements included in the selected area and the mapping library, re-synthesize the spherical panorama, and execute S403.
以上各步骤可参见前面实施例的描述,在此不再重复介绍。For the above steps, reference may be made to the descriptions of the previous embodiments, and the description will not be repeated here.
本申请实施例还提供一种全景回放的装置,如图5所示,图5是本申请一示例性实施例示出的一种全景回放的装置50,包括:An embodiment of the present application further provides a panoramic playback device, as shown in FIG. 5 , which is a panoramic playback device 50 shown in an exemplary embodiment of the present application, including:
处理器501; processor 501;
用于存储处理器501可执行指令的存储器502; memory 502 for storing instructions executable by processor 501;
其中,处理器501被配置为:Wherein, the processor 501 is configured as:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
本申请实施例还提供一种拍摄设备,如图6所示,图6是本申请一示例性实施例示出的一种拍摄设备60,包括:An embodiment of the present application further provides a photographing device, as shown in FIG. 6 , which is a photographing device 60 shown in an exemplary embodiment of the present application, including:
处理器601; processor 601;
用于存储处理器601可执行指令的存储器602; memory 602 for storing instructions executable by processor 601;
其中,处理器601被配置为:Wherein, the processor 601 is configured as:
将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
本申请实施例还提供一种可移动平台,如图7所示,图7是本申请一示例性实施例示出的一种可移动平台70,其上搭载图6所示的拍摄设备60,可参见图6的相关描述,其中,可移动平台可以是无人机、无人车等。An embodiment of the present application further provides a movable platform, as shown in FIG. 7 , which is a movable platform 70 shown in an exemplary embodiment of the present application, on which the photographing device 60 shown in FIG. Referring to the related description of FIG. 6 , the movable platform may be an unmanned aerial vehicle, an unmanned vehicle, or the like.
本申请还提供一种全景回放的系统,如图8所示,图8是本申请一示例性实施例示出的一种全景回放的系统,包括如图7所示的可移动平台70和指定应用80,指定应用80安装于电子设备81,可移动平台70与电子设备81通信连接,拍摄设备60中处理器601在响应指定应用80的请求时,调用存储器602存储的指令用于实现以下操作:The present application also provides a system for panoramic playback, as shown in FIG. 8 , which is a system for panoramic playback shown in an exemplary embodiment of the present application, including a movable platform 70 as shown in FIG. 7 and a designated application 80, the designated application 80 is installed on the electronic device 81, the movable platform 70 is connected in communication with the electronic device 81, and when the processor 601 in the photographing device 60 responds to the request of the designated application 80, the instruction stored in the memory 602 is called for realizing the following operations:
将由多个样张图像合成的初始全景图像输出到电子设备81上指定应用80的界面进行回放;outputting the initial panoramic image synthesized from the multiple proof images to the interface of the designated application 80 on the electronic device 81 for playback;
获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
将所述对应的样张图像重新合成目标全景图像输出到电子设备81上指定应用80的界面进行回放。The corresponding proof image is re-synthesized and the target panoramic image is output to the interface of the designated application 80 on the electronic device 81 for playback.
对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。As for the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……” 限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. The terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion such that a process, method, article or device comprising a list of elements includes not only those elements, but also other not expressly listed elements, or also include elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
以上对本申请实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The methods and devices provided by the embodiments of the present application have been described in detail above, and the principles and implementations of the present application are described with specific examples herein. At the same time, for those skilled in the art, according to the idea of the application, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as a limitation to the application. .

Claims (50)

  1. 一种全景回放的方法,其特征在于,包括:A method for panoramic playback, comprising:
    将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
    获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
    将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
  2. 根据权利要求1所述的方法,其特征在于,所述初始全景图像为球形全景图像。The method according to claim 1, wherein the initial panoramic image is a spherical panoramic image.
  3. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    标记所述初始全景图像上指定的元素并建立标记库;其中,所述元素为所述初始全景图像所包括的任意拍摄对象;Mark the specified element on the initial panoramic image and establish a mark library; wherein, the element is any photographing object included in the initial panoramic image;
    基于所述标记库在所述初始全景图像上生成待选区域。A candidate region is generated on the initial panoramic image based on the marker library.
  4. 根据权利要求3所述的方法,其特征在于,所述基于所述标记库在所述初始全景图像上生成待选区域包括:The method according to claim 3, wherein the generating a region to be selected on the initial panoramic image based on the marker library comprises:
    以所述标记库中所包括的标记的元素为中心生成待选区域。A candidate region is generated centered on the marked elements included in the marked library.
  5. 根据权利要求3所述的方法,其特征在于,所述方法还包括:The method according to claim 3, wherein the method further comprises:
    基于所述标记库在所述目标全景图像上生成待选区域,以基于选中的所述待选区域合成新的目标全景图像输出回放。A candidate area is generated on the target panoramic image based on the marker library, so as to synthesize a new target panoramic image based on the selected candidate area for playback.
  6. 根据权利要求3所述的方法,其特征在于,所述方法还包括:The method according to claim 3, wherein the method further comprises:
    建立所述初始全景图像上的元素与所述各个样张图像之间的映射库;establishing a mapping library between the elements on the initial panoramic image and the respective proof images;
    所述确定所述选中区域对应的样张图像包括:The determining of the sample image corresponding to the selected area includes:
    确定所述选中区域包括的元素;determining the elements included in the selected area;
    基于所述选中区域包括的元素与所述映射库确定所述选中区域对应的样张图像。A proof image corresponding to the selected area is determined based on the elements included in the selected area and the mapping library.
  7. 根据权利要求6所述的方法,其特征在于,所述建立所述初始全景图像上的元素与所述各个样张图像之间的映射库包括:The method according to claim 6, wherein the establishing a mapping library between the elements on the initial panoramic image and the respective proof images comprises:
    检测并提取所述初始全景图像上的特征点,所述特征点用于识别所述 初始全景图像上的元素;Detecting and extracting feature points on the initial panoramic image, the feature points are used to identify elements on the initial panoramic image;
    基于所述特征点与所述各个样张图像的映射关系建立所述元素与所述各个样张图像之间的映射库。A mapping library between the elements and the respective sample images is established based on the mapping relationship between the feature points and the respective sample images.
  8. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    记录所述各个样张图像的合成信息,以在重新合成目标全景图像时依照所述合成信息进行合成。The synthesis information of the respective proof images is recorded, so as to be synthesized according to the synthesis information when the target panoramic image is re-synthesized.
  9. 根据权利要求1所述的方法,其特征在于,所述选中区域数量为1个或1个以上。The method according to claim 1, wherein the number of the selected regions is one or more.
  10. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    对输出回放的初始全景图像和/或目标全景图像上的指定区域进行截取和/或添加标注。Cut out and/or add annotations to the designated area on the initial panorama image and/or the target panorama image for output playback.
  11. 一种全景回放的装置,其特征在于,包括:A device for panoramic playback, comprising:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    其中,所述处理器被配置为:wherein the processor is configured to:
    将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
    获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
    将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
  12. 根据权利要求11所述的装置,其特征在于,所述初始全景图像为球形全景图像。The device according to claim 11, wherein the initial panoramic image is a spherical panoramic image.
  13. 根据权利要求11所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 11, wherein the processor is further configured to:
    标记所述初始全景图像上指定的元素并建立标记库;其中,所述元素为所述初始全景图像所包括的任意拍摄对象;Mark the specified element on the initial panoramic image and establish a mark library; wherein, the element is any shooting object included in the initial panoramic image;
    基于所述标记库在所述初始全景图像上生成待选区域。A candidate region is generated on the initial panoramic image based on the marker library.
  14. 根据权利要求13所述的装置,其特征在于,所述处理器还被配置 为:The apparatus of claim 13, wherein the processor is further configured to:
    以所述标记库中所包括的标记的元素为中心生成待选区域。A candidate region is generated centered on the marked elements included in the marked library.
  15. 根据权利要求13所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 13, wherein the processor is further configured to:
    基于所述标记库在所述目标全景图像上生成待选区域,以基于选中的所述待选区域合成新的目标全景图像输出回放。A candidate area is generated on the target panoramic image based on the marker library, so as to synthesize a new target panoramic image based on the selected candidate area for playback.
  16. 根据权利要求13所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 13, wherein the processor is further configured to:
    建立所述初始全景图像上的元素与所述各个样张图像之间的映射库;establishing a mapping library between the elements on the initial panoramic image and the respective proof images;
    所述确定所述选中区域对应的样张图像包括:The determining of the sample image corresponding to the selected area includes:
    确定所述选中区域包括的元素;determining the elements included in the selected area;
    基于所述选中区域包括的元素与所述映射库确定所述选中区域对应的样张图像。A proof image corresponding to the selected area is determined based on the elements included in the selected area and the mapping library.
  17. 根据权利要求16所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 16, wherein the processor is further configured to:
    检测并提取所述初始全景图像上的特征点,所述特征点用于识别所述初始全景图像上的元素;Detecting and extracting feature points on the initial panoramic image, where the feature points are used to identify elements on the initial panoramic image;
    基于所述特征点与所述各个样张图像的映射关系建立所述元素与所述各个样张图像之间的映射库。A mapping library between the elements and the respective sample images is established based on the mapping relationship between the feature points and the respective sample images.
  18. 根据权利要求11所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 11, wherein the processor is further configured to:
    记录所述各个样张图像的合成信息,以在重新合成目标全景图像时依照所述合成信息进行合成。The synthesis information of the respective proof images is recorded, so as to be synthesized according to the synthesis information when the target panoramic image is re-synthesized.
  19. 根据权利要求11所述的装置,其特征在于,所述选中区域数量为1个或1个以上。The device according to claim 11, wherein the number of the selected regions is one or more.
  20. 根据权利要求11所述的装置,其特征在于,所述处理器还被配置为:The apparatus of claim 11, wherein the processor is further configured to:
    对输出回放的初始全景图像和/或目标全景图像上的指定区域进行截取和/或添加标注。Cut out and/or add annotations to the designated area on the initial panorama image and/or the target panorama image for output playback.
  21. 一种拍摄设备,其特征在于,包括:A photographing device, comprising:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    其中,所述处理器被配置为:wherein the processor is configured to:
    将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
    获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
    将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
  22. 根据权利要求11所述的拍摄设备,其特征在于,所述初始全景图像为球形全景图像。The photographing device according to claim 11, wherein the initial panoramic image is a spherical panoramic image.
  23. 根据权利要求21所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 21, wherein the processor is further configured to:
    标记所述初始全景图像上指定的元素并建立标记库;其中,所述元素为所述初始全景图像所包括的任意拍摄对象;Mark the specified element on the initial panoramic image and establish a mark library; wherein, the element is any shooting object included in the initial panoramic image;
    基于所述标记库在所述初始全景图像上生成待选区域。A candidate region is generated on the initial panoramic image based on the marker library.
  24. 根据权利要求23所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 23, wherein the processor is further configured to:
    以所述标记库中所包括的标记的元素为中心生成待选区域。A candidate region is generated centered on the marked elements included in the marked library.
  25. 根据权利要求23所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 23, wherein the processor is further configured to:
    基于所述标记库在所述目标全景图像上生成待选区域,以基于选中的所述待选区域合成新的目标全景图像输出回放。A candidate area is generated on the target panoramic image based on the marker library, so as to synthesize a new target panoramic image based on the selected candidate area for playback.
  26. 根据权利要求23所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 23, wherein the processor is further configured to:
    建立所述初始全景图像上的元素与所述各个样张图像之间的映射库;establishing a mapping library between the elements on the initial panoramic image and the respective proof images;
    所述确定所述选中区域对应的样张图像包括:The determining of the sample image corresponding to the selected area includes:
    确定所述选中区域包括的元素;determining the elements included in the selected area;
    基于所述选中区域包括的元素与所述映射库确定所述选中区域对应的样张图像。A proof image corresponding to the selected area is determined based on the elements included in the selected area and the mapping library.
  27. 根据权利要求26所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 26, wherein the processor is further configured to:
    检测并提取所述初始全景图像上的特征点,所述特征点用于识别所述初始全景图像上的元素;Detecting and extracting feature points on the initial panoramic image, where the feature points are used to identify elements on the initial panoramic image;
    基于所述特征点与所述各个样张图像的映射关系建立所述元素与所述各个样张图像之间的映射库。A mapping library between the elements and the respective sample images is established based on the mapping relationship between the feature points and the respective sample images.
  28. 根据权利要求21所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 21, wherein the processor is further configured to:
    记录所述各个样张图像的合成信息,以在重新合成目标全景图像时依照所述合成信息进行合成。The synthesis information of the respective proof images is recorded, so as to be synthesized according to the synthesis information when the target panoramic image is re-synthesized.
  29. 根据权利要求21所述的拍摄设备,其特征在于,所述选中区域数量为1个或1个以上。The photographing device according to claim 21, wherein the number of the selected areas is one or more.
  30. 根据权利要求21所述的拍摄设备,其特征在于,所述处理器还被配置为:The photographing device of claim 21, wherein the processor is further configured to:
    对输出回放的初始全景图像和/或目标全景图像上的指定区域进行截取和/或添加标注。Cut out and/or add annotations to the designated area on the initial panorama image and/or the target panorama image for output playback.
  31. 一种可移动平台,其上搭载拍摄设备,其特征在于,所述拍摄设备包括:A movable platform on which shooting equipment is mounted, characterized in that, the shooting equipment comprises:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    其中,所述处理器被配置为:wherein the processor is configured to:
    将由多个样张图像合成的初始全景图像输出回放;Play back the output of the initial panoramic image synthesized from multiple proof images;
    获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张 图像;Obtain the selected area on the initial panoramic image, and determine the sample image corresponding to the selected area;
    将所述对应的样张图像重新合成目标全景图像输出回放。Re-synthesize the corresponding sample image into the target panoramic image and output it for playback.
  32. 根据权利要求31所述的可移动平台,其特征在于,所述初始全景图像为球形全景图像。The movable platform of claim 31, wherein the initial panoramic image is a spherical panoramic image.
  33. 根据权利要求31所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 31, wherein the processor is further configured to:
    标记所述初始全景图像上指定的元素并建立标记库;其中,所述元素为所述初始全景图像所包括的任意拍摄对象;Mark the specified element on the initial panoramic image and establish a mark library; wherein, the element is any shooting object included in the initial panoramic image;
    基于所述标记库在所述初始全景图像上生成待选区域。A candidate region is generated on the initial panoramic image based on the marker library.
  34. 根据权利要求33所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 33, wherein the processor is further configured to:
    以所述标记库中所包括的标记的元素为中心生成待选区域。A candidate region is generated centered on the marked elements included in the marked library.
  35. 根据权利要求33所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 33, wherein the processor is further configured to:
    基于所述标记库在所述目标全景图像上生成待选区域,以基于选中的所述待选区域合成新的目标全景图像输出回放。A candidate area is generated on the target panoramic image based on the marker library, so as to synthesize a new target panoramic image based on the selected candidate area for playback.
  36. 根据权利要求33所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 33, wherein the processor is further configured to:
    建立所述初始全景图像上的元素与所述各个样张图像之间的映射库;establishing a mapping library between the elements on the initial panoramic image and the respective proof images;
    所述确定所述选中区域对应的样张图像包括:The determining of the sample image corresponding to the selected area includes:
    确定所述选中区域包括的元素;determining the elements included in the selected area;
    基于所述选中区域包括的元素与所述映射库确定所述选中区域对应的样张图像。A proof image corresponding to the selected area is determined based on the elements included in the selected area and the mapping library.
  37. 根据权利要求36所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 36, wherein the processor is further configured to:
    检测并提取所述初始全景图像上的特征点,所述特征点用于识别所述初始全景图像上的元素;Detecting and extracting feature points on the initial panoramic image, where the feature points are used to identify elements on the initial panoramic image;
    基于所述特征点与所述各个样张图像的映射关系建立所述元素与所述各个样张图像之间的映射库。A mapping library between the elements and the respective sample images is established based on the mapping relationship between the feature points and the respective sample images.
  38. 根据权利要求31所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 31, wherein the processor is further configured to:
    记录所述各个样张图像的合成信息,以在重新合成目标全景图像时依照所述合成信息进行合成。The synthesis information of the respective proof images is recorded, so as to be synthesized according to the synthesis information when the target panoramic image is re-synthesized.
  39. 根据权利要求31所述的可移动平台,其特征在于,所述选中区域数量为1个或1个以上。The movable platform according to claim 31, wherein the number of the selected areas is one or more.
  40. 根据权利要求41所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 41, wherein the processor is further configured to:
    对输出回放的初始全景图像和/或目标全景图像上的指定区域进行截取和/或添加标注。Cut out and/or add annotations to the designated area on the initial panorama image and/or the target panorama image for output playback.
  41. 一种全景回放的系统,其特征在于,包括可移动平台和指定应用,所述可移动平台上装有拍摄设备,所述指定应用安装于电子设备,所述可移动平台与所述电子设备通信连接,所述拍摄设备包括处理器和存储器,所述存储器用于存储指令,所述处理器在响应所述指定应用的请求时,调用所述存储器存储的指令用于实现以下操作:A system for panoramic playback, characterized in that it includes a movable platform and a designated application, the movable platform is equipped with a shooting device, the designated application is installed on an electronic device, and the movable platform is communicatively connected to the electronic device , the photographing device includes a processor and a memory, the memory is used for storing instructions, and when the processor responds to the request of the specified application, the memory is called to call the instructions stored in the memory to implement the following operations:
    将由多个样张图像合成的初始全景图像输出到所述电子设备上指定应用的界面进行回放;outputting the initial panoramic image synthesized from multiple proof images to the interface of the designated application on the electronic device for playback;
    获取所述初始全景图像上的选中区域,确定所述选中区域对应的样张图像;Acquiring a selected area on the initial panoramic image, and determining a sample image corresponding to the selected area;
    将所述对应的样张图像重新合成目标全景图像输出到所述电子设备上指定应用的界面进行回放。The corresponding proof image is re-synthesized to the target panoramic image and output to the interface of the designated application on the electronic device for playback.
  42. 根据权利要求41所述的系统,其特征在于,所述初始全景图像为球形全景图像。The system of claim 41, wherein the initial panoramic image is a spherical panoramic image.
  43. 根据权利要求41所述的系统,其特征在于,所述处理器还被配置为:The system of claim 41, wherein the processor is further configured to:
    标记所述初始全景图像上指定的元素并建立标记库;其中,所述元素为所述初始全景图像所包括的任意拍摄对象;Mark the specified element on the initial panoramic image and establish a mark library; wherein, the element is any shooting object included in the initial panoramic image;
    基于所述标记库在所述初始全景图像上生成待选区域。A candidate region is generated on the initial panoramic image based on the marker library.
  44. 根据权利要求43所述的系统,其特征在于,所述处理器还被配置为:The system of claim 43, wherein the processor is further configured to:
    以所述标记库中所包括的标记的元素为中心生成待选区域。A candidate region is generated centered on the marked elements included in the marked library.
  45. 根据权利要求43所述的系统,其特征在于,所述处理器还被配置为:The system of claim 43, wherein the processor is further configured to:
    基于所述标记库在所述目标全景图像上生成待选区域,以基于选中的所述待选区域合成新的目标全景图像输出回放。A candidate area is generated on the target panoramic image based on the marker library, so as to synthesize a new target panoramic image based on the selected candidate area for playback.
  46. 根据权利要求43所述的系统,其特征在于,所述处理器还被配置为:The system of claim 43, wherein the processor is further configured to:
    建立所述初始全景图像上的元素与所述各个样张图像之间的映射库;establishing a mapping library between the elements on the initial panoramic image and the respective proof images;
    所述确定所述选中区域对应的样张图像包括:The determining of the sample image corresponding to the selected area includes:
    确定所述选中区域包括的元素;determining the elements included in the selected area;
    基于所述选中区域包括的元素与所述映射库确定所述选中区域对应的样张图像。A proof image corresponding to the selected area is determined based on the elements included in the selected area and the mapping library.
  47. 根据权利要求46所述的系统,其特征在于,所述处理器还被配置为:The system of claim 46, wherein the processor is further configured to:
    检测并提取所述初始全景图像上的特征点,所述特征点用于识别所述初始全景图像上的元素;Detecting and extracting feature points on the initial panoramic image, where the feature points are used to identify elements on the initial panoramic image;
    基于所述特征点与所述各个样张图像的映射关系建立所述元素与所述各个样张图像之间的映射库。A mapping library between the elements and the respective sample images is established based on the mapping relationship between the feature points and the respective sample images.
  48. 根据权利要求41所述的系统,其特征在于,所述处理器还被配置为:The system of claim 41, wherein the processor is further configured to:
    记录所述各个样张图像的合成信息,以在重新合成目标全景图像时依照所述合成信息进行合成。The synthesis information of the respective proof images is recorded, so as to be synthesized according to the synthesis information when the target panoramic image is re-synthesized.
  49. 根据权利要求41所述的系统,其特征在于,所述选中区域数量为1个或1个以上。The system according to claim 41, wherein the number of the selected regions is one or more.
  50. 根据权利要求41所述的系统,其特征在于,所述处理器还被配置为:The system of claim 41, wherein the processor is further configured to:
    对输出回放的初始全景图像和/或目标全景图像上的指定区域进行截取和/或添加标注。Cut out and/or add annotations to the designated area on the initial panorama image and/or the target panorama image for output playback.
PCT/CN2020/108980 2020-08-13 2020-08-13 Panoramic playback method, apparatus and system, photographing device, and movable platform WO2022032589A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080039570.5A CN113906727A (en) 2020-08-13 2020-08-13 Panoramic playback method, device and system, shooting equipment and movable platform
PCT/CN2020/108980 WO2022032589A1 (en) 2020-08-13 2020-08-13 Panoramic playback method, apparatus and system, photographing device, and movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/108980 WO2022032589A1 (en) 2020-08-13 2020-08-13 Panoramic playback method, apparatus and system, photographing device, and movable platform

Publications (1)

Publication Number Publication Date
WO2022032589A1 true WO2022032589A1 (en) 2022-02-17

Family

ID=79186967

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/108980 WO2022032589A1 (en) 2020-08-13 2020-08-13 Panoramic playback method, apparatus and system, photographing device, and movable platform

Country Status (2)

Country Link
CN (1) CN113906727A (en)
WO (1) WO2022032589A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115361596A (en) * 2022-07-04 2022-11-18 浙江大华技术股份有限公司 Panoramic video data processing method and device, electronic device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101262597A (en) * 2007-03-09 2008-09-10 索尼株式会社 Image display system, device and method, image transmission apparatus and method, and program
US20160005319A1 (en) * 2014-07-07 2016-01-07 Airbus (Sas) Method for assisting the piloting of an aircraft on the ground and system for its implementation
CN107409239A (en) * 2015-12-04 2017-11-28 咖啡24株式会社 Image transfer method, graphic transmission equipment and image delivering system based on eye tracks
CN107682638A (en) * 2017-10-31 2018-02-09 北京疯景科技有限公司 Generation, the method and device of display panoramic picture
CN107770627A (en) * 2016-08-16 2018-03-06 三星电子株式会社 The method of image display device and operation image display device
CN107801075A (en) * 2016-08-30 2018-03-13 三星电子株式会社 Image display and its operating method

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120105577A1 (en) * 2010-11-01 2012-05-03 Olympus Imaging Corp. Panoramic image generation device and panoramic image generation method
KR20150059534A (en) * 2013-11-22 2015-06-01 삼성전자주식회사 Method of generating panorama images,Computer readable storage medium of recording the method and a panorama images generating device.
US9554060B2 (en) * 2014-01-30 2017-01-24 Google Inc. Zoom images with panoramic image capture
KR101844032B1 (en) * 2014-12-26 2018-05-14 주식회사 케이티 Method for sending video in region of interest from panoramic-video, server and device
US20170180680A1 (en) * 2015-12-21 2017-06-22 Hai Yu Object following view presentation method and system
US10666941B1 (en) * 2016-04-06 2020-05-26 Ambarella International Lp Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection
KR102604261B1 (en) * 2016-09-30 2023-11-21 삼성전자주식회사 Image processing apparatus and controlling method thereof
CN106791483B (en) * 2016-12-20 2020-07-10 北京小米移动软件有限公司 Image transmission method and device and electronic equipment
WO2018170725A1 (en) * 2017-03-21 2018-09-27 深圳市大疆创新科技有限公司 Image transmission method, device, and apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101262597A (en) * 2007-03-09 2008-09-10 索尼株式会社 Image display system, device and method, image transmission apparatus and method, and program
US20160005319A1 (en) * 2014-07-07 2016-01-07 Airbus (Sas) Method for assisting the piloting of an aircraft on the ground and system for its implementation
CN107409239A (en) * 2015-12-04 2017-11-28 咖啡24株式会社 Image transfer method, graphic transmission equipment and image delivering system based on eye tracks
CN107770627A (en) * 2016-08-16 2018-03-06 三星电子株式会社 The method of image display device and operation image display device
CN107801075A (en) * 2016-08-30 2018-03-13 三星电子株式会社 Image display and its operating method
CN107682638A (en) * 2017-10-31 2018-02-09 北京疯景科技有限公司 Generation, the method and device of display panoramic picture

Also Published As

Publication number Publication date
CN113906727A (en) 2022-01-07

Similar Documents

Publication Publication Date Title
JP4929940B2 (en) Shooting system
KR101530826B1 (en) Playing method and the system of 360 degree spacial video
EP2572504A1 (en) Multiple-site drawn-image sharing apparatus, multiple-site drawn-image sharing system, method executed by multiple-site drawn-image sharing apparatus, program, and recording medium
JP2008027336A (en) Location information delivery apparatus, camera, location information delivery method and program
CN106095881A (en) Method, system and the mobile terminal of a kind of display photos corresponding information
KR20160021706A (en) Playing method and the system of 360 degree spacial video
CN107483830A (en) A kind of photograph taking control method, system and storage medium based on mobile terminal
KR100901111B1 (en) Live-Image Providing System Using Contents of 3D Virtual Space
WO2022032589A1 (en) Panoramic playback method, apparatus and system, photographing device, and movable platform
JP2010198104A (en) Image display system, portable terminal system, portable terminal equipment, server, and image display method thereof
JP2014017026A (en) Image processor, image processing system and image processing method
CN107968949A (en) Dynamic data processing method and panoramic shooting system based on full-view image
JP2013021399A (en) Photographing request device, control method for photographing request device, and program
WO2021095598A1 (en) Information processing device, information processing method, information processing program, terminal device, terminal device control method, and control program
JP2009009436A (en) Satellite image request system
JP2009251720A (en) Satellite photographing image display method and satellite photographing image display device
JP2008090447A (en) Image album creation device and method, communication terminal, and image collection device
JP2013214158A (en) Display image retrieval device, display control system, display control method, and program
JP2006115062A (en) Photographing device
KR101630018B1 (en) Photographing apparatus and control method therof, group image managing system communicating the apparatus and control method therof, and recording medium for recording program for executing the control method
TWI636424B (en) Device and method for generating panorama image
JP2004194203A (en) Photographing system, information processing apparatus, its processing method, and program
KR102445296B1 (en) management systems of image by drone
WO2018137393A1 (en) Image processing method and electronic device
EP4436191A1 (en) Display terminal, communication system, display method, and carrier means

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20949087

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20949087

Country of ref document: EP

Kind code of ref document: A1