WO2017177842A1 - 媒体播放中的附加媒体展示方法及装置 - Google Patents

媒体播放中的附加媒体展示方法及装置 Download PDF

Info

Publication number
WO2017177842A1
WO2017177842A1 PCT/CN2017/079267 CN2017079267W WO2017177842A1 WO 2017177842 A1 WO2017177842 A1 WO 2017177842A1 CN 2017079267 W CN2017079267 W CN 2017079267W WO 2017177842 A1 WO2017177842 A1 WO 2017177842A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
panoramic
displaying
user
picture
Prior art date
Application number
PCT/CN2017/079267
Other languages
English (en)
French (fr)
Inventor
周彬
张驰
王贤骏
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2017177842A1 publication Critical patent/WO2017177842A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video

Definitions

  • the present application relates to the field of information technology (IT), and in particular, to an additional media display method and apparatus for media playback.
  • IT information technology
  • the present application provides an additional media presentation method in media playback, which is applied to a media playback client.
  • the method includes: acquiring additional media data corresponding to the media file; wherein the additional media data includes a panoramic media material, and the panorama
  • the media material includes a picture divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein each part of the one picture or each of the plurality of pictures corresponds to a different viewing angle, the three-dimensional
  • the video can be displayed in different perspectives; listening to the user's actions; in response to the listened actions, Determining a view corresponding to the operation; displaying a part of the one picture corresponding to the view in the panoramic media material or one of the plurality of pictures, or displaying the three-dimensional video by the view.
  • the present application also provides an additional media display device in media playback, which is placed in a media playing client, and the device includes:
  • One or more memories are One or more memories
  • One or more processors among them,
  • the one or more memories storing one or more instruction modules configured to be executed by the one or more processors;
  • the one or more instruction modules include: an obtaining module, which acquires additional media data corresponding to the media file; wherein the additional media data includes a panoramic media material, and the panoramic media material includes a picture divided into multiple parts a plurality of pictures or a three-dimensional video, wherein each part of the one picture or each of the plurality of pictures corresponds to different perspectives, and the three-dimensional video can be displayed in different perspectives; the monitoring module monitors the user And a display module, in response to the monitored operation, determining a perspective corresponding to the operation, displaying a part of the one picture corresponding to the view angle in the panoramic media material or one of the multiple pictures Zhang, or display the three-dimensional video in the view.
  • the present application also proposes a non-transitory computer readable storage medium, characterized in that computer readable instructions are stored, and at least one processor can be configured to:
  • the additional media data comprises a panoramic media material, the panoramic media material comprising a picture divided into a plurality of parts, a plurality of pictures or a three-dimensional video, wherein the one Each part of the picture or each of the plurality of pictures corresponds to a different perspective, and the three-dimensional video can be displayed in different perspectives;
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present application.
  • FIG. 2 is a schematic flow chart of a method according to an example of the present application.
  • FIG. 3 is a diagram showing an example of a panoramic media material of a 360-degree picture
  • FIG. 4 is a diagram showing an example of a panoramic media material of a 360-degree picture
  • FIG. 5 is a map example of 3D video material of a 360-degree video
  • FIG. 6 is a diagram showing an example of 3D video material of a 360-degree video
  • Figure 7 is an illustration of an additional media display
  • Figure 8 is an illustration of an additional media display
  • FIG. 9 is a schematic structural diagram of a device and a device in an example of the present application.
  • the present application provides an additional media display method and device for media playback. Set to improve media display.
  • FIG. 1 is a schematic diagram of an implementation environment involved in the present application.
  • the user terminal 101 has a media playing client 102 built therein.
  • the media playing client 102 can interact with the media playing server 103 via the Internet 105, obtain media files from the media playing server 103, and then can directly broadcast media such as video. file.
  • the additional media server 104 is configured to provide additional media data, such as: the advertiser can provide the creative, and the advertisement server (an additional media server) saves the advertisement data (an additional media data) containing the creatives and provides them through the Internet.
  • the media playing server 103 is further provided by the media playing server 103 to the media playing client 102 in the user terminal 101.
  • the media play client 102 can obtain additional media data (e.g., advertisement data) from the additional media server 104 via the Internet 105, thereby enabling the display of corresponding additional media (e.g., advertisements) during the presentation of the media file that is requested.
  • additional media data e.g., advertisement data
  • the present application proposes an additional media presentation method in media playback, which is applied to the media playback client 102 of FIG.
  • the method includes the following steps:
  • Step 201 Acquire additional media data corresponding to the media file.
  • the additional media data includes a panoramic media material, and the panoramic media material includes a picture divided into a plurality of parts, a plurality of pictures, or a three-dimensional video, wherein each part of the one picture or the plurality of pictures Each of the three-dimensional videos can be displayed in different perspectives corresponding to different perspectives.
  • additional media data corresponding to the media file may be obtained during the presentation of the media file.
  • the so-called display of the media file may refer to one of several situations: when the media playing client is ready to play the media file (the additional media displayed at this time may be referred to as a pre-roll), the media file is being played, and the mediation is paused.
  • the media file is played and the media file is played (the additional media displayed at this time may be referred to as a post-patch).
  • the media file is a video of a TV episode that can be clicked on-line
  • the additional media data is advertisement data
  • the corresponding advertisement data (also referred to as a pre-patch) can be obtained when the video of the episode is ready to be played.
  • Advertising may also obtain corresponding advertising data during the video playing process of the episode, and may also obtain corresponding advertising data when the video of the episode is paused, or obtain corresponding when the video of the episode is finished playing.
  • Ad data also known as post-roll ads).
  • each view of the picture or a different view corresponding to each of the multiple pictures, or different views based on the display of the three-dimensional video may be multiple views in the same two-dimensional plane, or Multiple perspectives in the same three-dimensional space.
  • each part of the picture or each of the plurality of pictures or a mapping relationship between the texture part of the three-dimensional video and different viewing angles may be established.
  • the additional data provider can provide multiple pictures or multiple videos captured by the panoramic camera on demand, so that the pictures or videos can be stitched into a panoramic picture or a panoramic 3D video material (ie, panoramic media material), wherein the panoramic picture is It is divided into multiple parts or includes multiple pictures, each part or each picture corresponds to different perspectives.
  • the panoramic 3D video is actually a 3D texture map, and each texture part corresponds to a different perspective.
  • the angle of view may represent a visual direction, referring to a direction from a viewpoint (also referred to as a camera) to a visible object, and different visual directions may be characterized by different perspectives.
  • Step 202 Monitor the user's operation.
  • this step can be monitored.
  • the operation of the user through the input device of the PC For example, the monitoring user performs various operations in the display interface of the media client by dragging/clicking the mouse or operating a keyboard, a handle, etc. (for example, moving from one location to another or clicking a certain location, etc.).
  • the operation of the listening user includes: listening for a gesture operation on the touch screen of the mobile terminal and/or monitoring a posture change of the mobile terminal by a gyroscope of the mobile terminal.
  • the monitoring user can monitor the posture change of the mobile terminal by using a sliding operation on the touch screen or using the gravitational acceleration sensing capability of the gyroscope, thereby being able to monitor the operation of the user holding the mobile terminal and rotating.
  • the mobile terminal refers to various portable electronic devices having a display function, such as a mobile phone, a tablet computer, a palmtop computer, an ultrabook, a wearable device, and the like.
  • Step 203 Determine the angle of view corresponding to the operation in response to the intercepted operation.
  • the correspondence between various operations and various views may be established in advance according to implementation requirements.
  • Step 204 Display a part of the one piece of the picture corresponding to the angle of view determined in step 203 in the above-mentioned panoramic media material or one of the plurality of pictures, or display the three-dimensional video by using the angle of view determined in step 203.
  • the media playing client can display the panoramic additional media, such as the panoramic image of the advertisement or promotion information or the panoramic 3D video.
  • the panoramic additional media such as the panoramic image of the advertisement or promotion information or the panoramic 3D video.
  • the user's operation such as: mouse click/drag operation, finger sliding touch screen, mobile terminal where the handheld media client is located, etc.
  • different pictures corresponding to different angles of the panoramic picture or the panoramic three-dimensional video may be displayed. (partially) or different 3D video textures, so that the user is more immersive, the picture or video can be changed according to the visual direction (or perspective), which can significantly improve the display of additional media. effect.
  • the above panoramic picture and panoramic 3D video can be referred to as a 360 degree picture and a 360 degree video.
  • the specific implementation of the 360-degree picture and the 360-degree video will be described below.
  • a 360-degree image has two implementations: one is that the viewpoint (or perspective) is outside the image, that is, the object in the image is observed from the outside, and the other is that the viewpoint is inside the image, that is, the image is viewed from the inside. object. There are slight differences in the implementation logic between the two methods, which are explained separately below.
  • the viewpoint is outside the picture. It can be imagined that the user stands in front of an object, and the object continues to rotate, and the user observes the 360-degree process of the object.
  • the media playing client monitors the user's operation, for example, the user holds the mobile terminal to perform a rotating action, and the media playing client can change according to the posture of the monitored mobile terminal. And a plurality of images of objects of different angles are sequentially played, and the visual persistence characteristic generated by the human eye is used to allow the user to produce an effect of rotating the object.
  • the panorama media material is pre-made. You can take photos of all angles of an object and stitch them into a panoramic image (which can be called a Sprite) as a panoramic media material. Then the panorama includes multiple parts or multiple pictures, each part or each picture. The picture is a photo of the object at a certain angle, and also corresponds to a visual direction (ie, a viewing angle).
  • the Canvas tag of the HTML5 page can be used to load such a panorama image in the additional media data.
  • the related class library can be used to monitor the user's operation, determine the angle of view corresponding to the monitored operation, and then can quickly switch different pictures or different picture parts in the panoramic picture based on the user's operation to form an animation display effect.
  • the viewpoint is inside the picture.
  • a panoramic picture that can be captured by a mobile phone is usually used.
  • the photographer takes a 360-degree view of the surrounding scene, thereby observing the 360-degree view of the surrounding scenery.
  • the media playing client monitors the user's operation, for example, the user holds the mobile terminal to perform a rotating action, and the media playing client can change according to the posture of the monitored mobile terminal.
  • the plurality of scene images of different angles are sequentially played, and the visual persistence characteristic generated by the human eye is used to allow the user to display the effect of rotating the scene around the scene.
  • the panorama media material is pre-made.
  • the camera can rotate the photos at various angles in situ and stitch the photos into a panoramic picture as the panoramic media material.
  • the panorama includes multiple parts or multiple pictures, and each picture part or each picture is turned to a certain camera.
  • a scene shot of a scene is also corresponding to a visual direction (ie, a perspective).
  • the Canvas tag of the HTML5 page can be used to load such a panorama image in the additional media data.
  • the related class library can be used to monitor the user's operation, determine the angle of view corresponding to the monitored operation, and then can quickly switch different pictures or different picture parts in the panoramic picture based on the user's operation to form an animation display effect.
  • 360-degree video of panoramic media material also known as 3D video material.
  • 3D video material can have different texture maps, such as green forests, blue oceans, if standing on spheres. Look around the perimeter to see the outline of the entire sphere and the texture map above it.
  • the video image itself is also a texture.
  • it is shot with a special 360-degree camera, it is attached as a flat material to a sphere. Due to the particularity of the material, the image is attached. After that, you can see that the entire spherical picture is seamlessly connected, as shown in Figure 5.
  • the so-called 360-degree video effect is to view the viewer as part of the center of the sphere, place the viewpoint or camera inside the sphere to observe, and then you can see the different texture parts of the video through the rotation of the sphere. As shown in Figure 6.
  • the media playing client monitors the user's operation, for example, the user holds the mobile terminal to perform a rotating action, and the media playing client can change according to the posture of the monitored mobile terminal.
  • the 3D video is played in different perspectives, allowing the user to generate a 3D scene to rotate around it, and has an immersive display effect.
  • the panorama media material is pre-made.
  • the panoramic media material includes 3D video material captured and encoded by a professional 3D camera, such as FLV (Flash Video) or MP43 video material.
  • FLV Flash Video
  • the rich media container can be used to load the 3D video material.
  • the rich media container here can be a Flash-based rich media plug-in for the PC-side media playing client ( Also known as a rich media shell), for a media player client of a mobile terminal, it may be a webview container of an HTML5 page.
  • the related class library (such as the away3D on the PC side and the three.js on the mobile side) can be used to monitor the user's operation, determine the visual direction corresponding to the monitored operation, and then quickly switch different perspectives based on the user's operation and differently.
  • the 3D video is played at a viewing angle to form a 3D animation.
  • the obtaining the additional media data corresponding to the media file may include: by using an associated logic plug-in in the media playing client (such as an order logic plug-in of the advertisement)
  • the associated logic that executes the additional media obtains the additional media data corresponding to the media file from the outside (for example, the order logic plug-in in the video playback client can obtain the advertisement data corresponding to the video file by executing the order logic of the advertisement).
  • the rich media plug-in in the media playback client loads the panoramic media material in the additional media data obtained by the associated logic plug-in.
  • the displaying one or more of the pictures corresponding to the viewing angle in the panoramic media material, or displaying the three-dimensional video in the determined viewing angle may include: displaying, by the rich media plug-in, the corresponding angle in the panoramic media material One or more of the pictures, or the rich media plug-in to display the 3D video from this perspective.
  • the associated logic plugin may be a Flash plugin
  • the rich media plugin may be a rich media shell on the Flash plugin
  • the associated logical plugin may be a software Development Kit (SDK) plugin
  • SDK software Development Kit
  • the media player client is located in the mobile terminal
  • 360-degree video ads are implemented by front-end technologies such as HTML5+JS+CSS3.
  • the underlying layer is a media playback client, such as a video application (APP).
  • APP video application
  • the SDK plug-in on the APP executes the order logic to obtain the creative (including the 360-degree video creative), and the media playback client implements the main video (ie, the aforementioned media).
  • the playback logic of the file The rich media plugin itself is a webview page, which is created by the APP and cascaded on the playback layer of the main video, and then implements 360-degree video creative loading and 3D effect implementation in the webview page.
  • the media player client is located in the PC
  • the 360-degree video advertisement is implemented by Flash technology, and the bottom layer is the Tencent video main player. Then the main player loads the advertisement plug-in (flash plug-in, and then runs the rich media plug-in, all of which are flash technology), and realizes the order logic. Finally, the content of the parameters returned by the order is obtained by loading the 360 video material and the rich media shell, and finally the 360 video effect is realized by the rich media shell.
  • the advertisement plug-in flash plug-in, and then runs the rich media plug-in, all of which are flash technology
  • the user may be prompted to display the panoramic effect of the additional media.
  • the user enters the panoramic effect display mode to start monitoring. User's operation.
  • the default additional media data may be displayed first, for example, one of the images in the panoramic media material corresponding to the preset viewing angle or one of the multiple images, or the panoramic media material is displayed in a preset perspective.
  • the 3D video in the 3D video, or a picture or a video other than the panoramic media material carried in the additional media data and prompt the user whether to display the panoramic effect.
  • the additional media is a patch advertisement. As shown in FIG.
  • a default patch 701 may be displayed first.
  • the default patch does not have a panoramic display effect, and the icon 702 indicates whether a panoramic effect needs to be displayed, and the user can click through.
  • the icon 702 causes the media playback client to enter the panoramic display mode of the advertisement, thereby starting the operation for monitoring (such as dragging the mouse, rotating the terminal device, gesture operation for the touch screen, etc.).
  • the user can be prompted to stop displaying the panoramic effect (such as shown in the user interface shown in FIG. 8).
  • a prompt icon 801 when receiving a response from the user confirming to stop displaying the panoramic effect (such as the user clicking the icon 801 prompting whether to stop displaying the panoramic effect), exiting the panoramic display mode and stopping listening to the user's operation.
  • a picture or a video can start counting down according to the preset duration (countdown as shown by 703 in Fig. 7), pause the countdown when receiving the response from the user confirming that the panoramic effect is to be displayed, and after receiving the panoramic display mode, when receiving Continue this countdown until the user confirms that the response to the panoramic effect is stopped.
  • the present application further provides an additional media display device, which can be placed in the media playing client.
  • the present invention includes the following modules: an obtaining module 901, a listening module 902, and a display module 903.
  • the obtaining module 901 is configured to obtain additional media data corresponding to the media file, where the additional media data includes a panoramic media material, where the panoramic media material includes a picture divided into multiple parts, multiple pictures, or a three-dimensional video, where the piece Each part of the picture or each of the above multiple pictures corresponds to a different perspective, and the above three-dimensional video can be displayed in different perspectives.
  • the obtaining module 901 may acquire additional media data corresponding to the media file during the media playing client displaying the media file.
  • the listening module 902 listens to the user's operation.
  • the display module 903 determines, in response to the operation monitored by the monitoring module 902, the angle of view corresponding to the operation, and displays a part of the one picture or the plurality of pictures corresponding to the view in the panoramic media material, or This perspective shows the above three-dimensional video.
  • the apparatus can further include a prompting module 904.
  • the display module 903 further displays a part of the one-picture corresponding to the preset viewing angle in the panoramic media material or one of the multiple pictures, or a preset perspective. Display the above 3D video, or display a picture or a video other than the panoramic media material in the above additional media data, and trigger a prompt Module 904.
  • the prompting module 904 prompts the user whether to display the panoramic effect after being triggered by the display module 903, and when receiving the response from the user confirming that the panoramic effect is to be displayed, the triggering listening module 902 starts to listen to the user's operation.
  • the prompting module 904 further prompts the user whether to stop displaying the panoramic effect.
  • the triggering listening module 902 stops listening to the user's operation.
  • the apparatus can further include a timing module 905.
  • the display module 903 is configured to display a part of the foregoing one of the preset views or one of the plurality of pictures, or display the three-dimensional video by a preset viewing angle, or display a picture other than the panoramic media material.
  • the trigger timing module 905 starts counting down according to the preset duration.
  • the prompting module 904 further triggers the timing module 905 to pause the countdown when receiving the response from the user confirming that the panoramic effect is to be displayed; and triggering the timing module 905 to continue counting down when receiving the response from the user confirming to stop displaying the panoramic effect.
  • each module in each example of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more devices or modules may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the additional media presentation device described above can be run in any computing device capable of media presentation (such as a computing device including a display interface) and loaded in a memory of the computing device, the memory can include: Take a memory (Random Access Memory, RAM) and/or a non-volatile memory.
  • the computing device may include: a memory 920, a processor 910, a bus 940, and a port 930, in addition to the modules 901-905 in the additional media display device.
  • Processor 910 and memory 920 are interconnected by a bus 940.
  • the processor 910 can receive and send through the port 930. Send data to enable network communication and/or local communication.
  • Each of the above modules 901 to 905 may be a machine executable instruction module stored in the memory 920.
  • the processor 910 can realize the functions of the above-described modules 901 to 905 by executing the machine executable instructions included in the modules 901 to 904 in the memory 920.
  • the aforementioned memory 920 will store one or more programs and be configured to be executed by one or more processors 910.
  • the one or more programs described above may include the following instruction modules:
  • the obtaining module 901 is configured to obtain additional media data corresponding to the media file, where the additional media data includes a panoramic media material, where the panoramic media material includes a picture divided into multiple parts, multiple pictures, or a three-dimensional video, where the piece Each part of the picture or each of the above multiple pictures corresponds to a different perspective, and the above three-dimensional video can be displayed in different perspectives.
  • the obtaining module 901 may acquire additional media data corresponding to the media file during the media playing client displaying the media file.
  • the listening module 902 listens to the user's operation.
  • the display module 903 determines, in response to the operation monitored by the monitoring module 902, the angle of view corresponding to the operation, and displays a part of the one picture or the plurality of pictures corresponding to the view in the panoramic media material, or This perspective shows the above three-dimensional video.
  • the computing device where the additional media display device is located is a PC
  • the computing device may include a peripheral input device capable of receiving user operations, such as a keyboard, a mouse, a touch screen, a handle, etc., so that the monitoring module 902 can monitor the user's
  • the operation enables the presentation module to perform a panoramic display of the additional media based on the user's operation.
  • the computing device may include components capable of receiving user operations, such as buttons, touch screens, wire controls, etc., and may also include gyroscopes, gravitational acceleration sensors, and the like. A part that is capable of sensing the change in posture of a computing device In this way, the listening module 902 can monitor the user's operation, so that the display module can perform panoramic display of the additional media based on the user's operation.
  • each instance of the present application can be implemented by a data processing program executed by a data processing device such as a computer.
  • the data processing program constitutes the present application.
  • a data processing program usually stored in a storage medium is executed by directly reading a program out of a storage medium or by installing or copying the program to a storage device (such as a hard disk and or a memory) of the data processing device. Therefore, such a storage medium also constitutes the present application.
  • the storage medium can use any type of recording method, such as paper storage medium (such as paper tape, etc.), magnetic storage medium (such as floppy disk, hard disk, flash memory, etc.), optical storage medium (such as CD-ROM, etc.), magneto-optical storage medium ( Such as MO, etc.).
  • the present application also provides a storage medium in which is stored a data processing program for performing any of the above-described methods of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种媒体播放中的附加媒体展示方法，该方法包括：获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；监听用户的操作；响应于监听到的操作，确定所述操作对应的视角；展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。本申请还公开了一种相应的装置。采用该方法和装置能够改善媒体展示效果。

Description

媒体播放中的附加媒体展示方法及装置
本申请要求于2016年04月11日提交中国专利局、申请号为201610221533.1、发明名称为“媒体播放中的附加媒体展示方法及装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及信息技术(IT，Information Technology)领域，尤其涉及一种媒体播放中的附加媒体展示方法及装置。
背景
随着互联网的发展，涌现出各种各样的在线媒体播放技术，用户通过PC端或各种移动终端上的媒体播放客户端(如：在线视频客户端等)可以在线点播及观看诸如视频等各种媒体文件。
目前，在播放媒体文件同时，还会有各类附加媒体的推送，比如：插入贴片广告、推送推广信息(如：新闻、公益宣传信息等)。
技术内容
本申请实例的技术方案是这样实现的：
本申请提出了一种媒体播放中的附加媒体展示方法，应用于媒体播放客户端，该方法包括：获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；监听用户的操作；响应于监听到的操作， 确定所述操作对应的视角；展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
本申请还提出了一种媒体播放中的附加媒体展示装置，其置于媒体播放客户端中，该装置包括：
一个或一个以上存储器；
一个或一个以上处理器；其中，
所述一个或一个以上存储器存储有一个或者一个以上指令模块，经配置由所述一个或者一个以上处理器执行；其中，
所述一个或者一个以上指令模块包括：获取模块，获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；监听模块，监听用户的操作；展示模块，响应于监听到的操作，确定所述操作对应的视角，展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
本申请还提出了一种非易失性计算机可读存储介质，其特征在于，存储有计算机可读指令，可以使至少一个处理器执行以下操作：
获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；
监听用户的操作；
响应于监听到的操作，确定所述操作对应的视角；
展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
附图简要说明
为了更清楚的说明本申请实例中的技术方案，下面将对实例描述中所需要使用的附图作简单的介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实例，对于本领域普通技术人员来说，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。其中，
图1为本申请所涉及的实施环境示意图；
图2为依据本申请一实例的方法流程示意图；
图3为360度图片的全景媒体素材示例图；
图4为360度图片的全景媒体素材示例图；
图5为360度视频的3D视频素材的贴图示例；
图6为360度视频的3D视频素材示例图；
图7为附加媒体展示一示例图；
图8为附加媒体展示一示例图；及
图9为本申请一实例中的装置及设备组成结构示意图。
实施方式
在实现本发明实例的过程中，发明人发现上述技术至少存在以下问题：目前附加媒体的展示方式是固定、单一的，展示效果还需改善。有鉴于此，本申请提供了一种媒体播放中的附加媒体展示方法及装 置，以提高媒体展示效果。
下面将结合本申请实例中的附图，对本申请实例中的技术方案进行清楚、完整地描述，显然，所描述的实例是本申请一部分实例，而不是全部的实例。基于本申请中的实例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实例，都属于本申请保护的范围。
图1为本申请所涉及的实施环境示意图。如图1所示，用户终端101内置有媒体播放客户端102，媒体播放客户端102通过互联网105可以跟媒体播放服务器103交互，从媒体播放服务器103获得媒体文件，进而能够在线点播诸如视频等媒体文件。附加媒体服务器104用于提供附加媒体数据，比如：广告主可以提供广告素材，由广告服务器(一种附加媒体服务器)保存包含这些广告素材的广告数据(一种附加媒体数据)并通过互联网提供给媒体播放服务器103，再由媒体播放服务器103提供给用户终端101中的媒体播放客户端102。媒体播放客户端102可通过互联网105获得来自于附加媒体服务器104的附加媒体数据(如广告数据)，进而能在展示所点播的某媒体文件的期间展示对应的附加媒体(如广告)。
本申请提出了一种媒体播放中的附加媒体展示方法，该方法应用于图1的媒体播放客户端102中。在一实例中，如图2所示，该方法包括如下步骤：
步骤201：获取媒体文件对应的附加媒体数据。其中，附加媒体数据包括全景媒体素材，全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示。
在一实例中，可应在展示媒体文件期间获取该媒体文件对应的附加媒体数据。这里，所谓展示媒体文件期间可以指一下几种情况之一：媒体播放客户端准备播放该媒体文件时(此时展示的附加媒体可被称为前贴片)、正在播放该媒体文件中、暂停播放该媒体文件时、该媒体文件播放完毕时(此时展示的附加媒体可被称为后贴片)。在一个具体应用场景中，媒体文件为可在线点播的某电视剧集的视频，附加媒体数据为广告数据，则可在该剧集的视频准备播放时获取对应的广告数据(也称为前贴片广告)，也可在该剧集的视频播放过程中获取对应的广告数据，还可在该剧集的视频暂停播放时获取对应的广告数据，或者在该剧集的视频播放完毕时获取对应的广告数据(也称为后贴片广告)。
这里，此张图片的每一部分或者上述多张图片中的每一张对应的不同的视角，或者三维视频的展示所基于的不同视角可以为同一二维平面中的多个视角，也可以为同一三维空间中的多个视角。这里，基于预设的某种全景图片/视频模型可以建立此张图片的每一部分或者多张图片中的每一张或者三维视频的贴图部分与不同视角之间的对应关系。附加数据的提供方可按需求提供由全景摄像机拍摄的多张图片或多段视频，这样，可以使用这些图片或视频拼接成全景图片或全景三维视频素材(即全景媒体素材)，其中，全景图片被分为多个部分或者包括多张图片，其中的每一部分或者每张图片对应不同的视角，全景三维视频实际上是三维立体贴图，每个贴图部分对应不同的视角。这里，视角可以代表视觉方向，指的是从视点(也被称为摄像机)到可视对象的方向，不同的视觉方向可以由不同的视角来表征。
步骤202：监听用户的操作。
当媒体播放客户端位于个人电脑(PC)时，本步骤中可以监听用 户通过PC的输入设备而进行的操作。比如：监听用户通过拖动/点击鼠标或者操作键盘、手柄等在媒体客户端的展示界面中的进行各种操作(比如：从某个位置移动到另一个位置或者点击某个位置等)。
当媒体播放客户端位于移动终端时，所述监听用户的操作包括：监听所述移动终端的触摸屏上的手势操作和/或通过所述移动终端的陀螺仪监听所述移动终端的姿态变化。例如：监听用户通过在触摸屏上进行的滑动操作，或者利用陀螺仪的重力加速度感知能力监听移动终端的姿态变化，进而能够监听到用户手持移动终端并转动的操作。这里，移动终端指各种具有显示功能的便携式电子设备，比如：手机、平板电脑、掌上电脑、超极本、可穿戴设备等。
步骤203：响应于监听到的操作，确定此操作对应的视角。这里，可根据实现需要预先建立各种操作与各个视角之间的对应关系。
步骤204：展示上述全景媒体素材中步骤203中确定的视角对应的上述一张图片中的一部分或者上述多张图片中的一张，或者以步骤203中确定的视角展示上述三维视频。
采用上述实例，用户在使用媒体播放客户端点播媒体文件时，媒体播放客户端可以展示全景的附加媒体，如广告或推广信息的全景图片或全景三维视频。其中，基于用户的操作(比如：鼠标点击/拖动操作、手指滑动触摸屏、手持媒体客户端所在的移动终端而转动等等)，可以展示出全景图片或全景三维视频中不同视角对应的不同图片(部分)或不同三维视频贴图部分，这样对于用户而言更有身临其境的感受，所见图片或视频能随视觉方向(或者说视角)变化而变化，进而能显著提高附加媒体的展示效果。
上述的全景图片和全景三维视频可被称为360度图片和360度视频。以下对360度图片和360度视频的具体实现方式加以说明。
一、360度图片有两种实现方式：一种是视点(或者说视角)处于图片的外部，即从外部观察图片中的物体，一种是视点处于图片的内部，即从内部观察图片中的物体。这两种方式的实现逻辑有稍许差别，下文中将分别阐述。
1、视点处于图片外部
视点处于图片外部可以想象成，用户站在一个物体前，这个物体不断自转，用户从而观察到了该物体360度全貌的过程。
例如图3所示的自行车，若是令它在一个水平面上每10度旋转一次，那么就会得到36张图片。
采用此种方式实现的附加媒体展示效果如下：
在展示图片类的附加媒体(如：图片广告贴片)时，媒体播放客户端监听用户的操作，比如:用户手持移动终端做旋转动作，媒体播放客户端可以根据监听到的移动终端的姿态变化而将多张不同角度的物体图片依次播放，利用人眼产生的视觉暂留特性，让用户产生物体在旋转的展示效果。
在具体实现时，要预先制作全景媒体素材。可拍摄一物体各个角度的照片，将这些照片拼接成全景图片(可被称为雪碧图)作为全景媒体素材，那么此全景图就包括多个部分或者多张图片，每个图片部分或每张图片为该物体某一角度的照片，也对应一个视觉方向(即一个视角)。在媒体播放客户端获取这种附加媒体数据时，可利用HTML5页面的Canvas标签来加载附加媒体数据中的这种全景图片。之后，可利用相关类库来监听用户的操作，确定监听到的操作对应的视角，进而可基于用户的操作快速切换全景图片中的不同图片或不同图片部分，形成动画的展示效果。
2、视点处于图片内部
视点处于图片内部，例如通常利用手机可拍摄到的全景图片，如图4所示，拍摄者在原地转圈360度拍摄到周围的景物，从而能观察到周围景物的360度全貌。
例如图4所示的景物，若令拍摄者在一个水平面上每10度旋转一次，那么就会得到36张图片，这些图片拼接在一起就能构成全景图片。
采用此种方式实现的附加媒体展示效果如下：
在展示图片类的附加媒体(如：图片广告贴片)时，媒体播放客户端监听用户的操作，比如:用户手持移动终端做旋转动作，媒体播放客户端可以根据监听到的移动终端的姿态变化而将多张不同角度的景物图片依次播放，利用人眼产生的视觉暂留特性，让用户产生景物在其周围旋转的展示效果。
在具体实现时，要预先制作全景媒体素材。可拍摄摄像机在原地旋转各个角度的照片，将这些照片拼接成全景图片作为全景媒体素材，那么此全景图就包括多个部分或多张图片，每个图片部分或每张图片为摄像机转到某一角度拍摄的景物照片，也对应一个视觉方向(即一个视角)。在媒体播放客户端获取这种附加媒体数据时，可利用HTML5页面的Canvas标签来加载附加媒体数据中的这种全景图片。之后，可利用相关类库来监听用户的操作，确定监听到的操作对应的视角，进而可基于用户的操作快速切换全景图片中的不同图片或不同图片部分，形成动画的展示效果。
二、360度视频的实现原理如下：
首先，要制作360度视频的全景媒体素材，也可称为3D视频素材。可以将3D视频素材想象成一个类似于地球的球体，这个球体上可以有不同的材质贴图，如绿色的森林、蓝色的海洋，如果站在球体 的外围来观察它，可以看到整个球体的轮廓以及上面的材质贴图。对于360度视频而言，可以理解视频画面本身也是一张贴图，它用特殊的360度摄像机拍摄出来以后，作为一个平面的素材，贴在了一球体上，由于素材的特殊性，贴完图后可以看到整个球形图片是无缝衔接的，如图5所示。
所谓的360度视频效果，就是把观者作为球体中心的一部分，把视点或者摄像机放置在球体内部来观察，然后就可以通过球体的旋转，来看到视频的不同贴图部分了。如图6所示。
采用此种方式实现的附加媒体展示效果如下：
在展示视频类的附加媒体(如：视频广告贴片)时，媒体播放客户端监听用户的操作，比如:用户手持移动终端做旋转动作，媒体播放客户端可以根据监听到的移动终端的姿态变化而依次以不同的视角播放3D视频，让用户产生3D景物在其周围旋转的感受，有身临其境的展示效果。
在具体实现时，要预先制作全景媒体素材。对于360度视频而言，全景媒体素材包括专业3D摄像机拍摄并编码出来的3D视频素材，比如FLV(Flash Video)或MP43视频素材。在媒体播放客户端获取这种附加媒体数据时，可利用富媒体容器来加载这种3D视频素材，这里的富媒体容器，对于PC端的媒体播放客户端而言可以是基于Flash的富媒体插件(也叫富媒体壳)，对于移动终端的媒体播放客户端而言可以是HTML5页面的网络视图(webview)容器。之后，可利用相关类库(如PC端的away3D，移动端的three.js)来监听用户的操作，确定监听到的操作对应的视觉方向，进而可基于用户的操作快速切换不同的视角并以不同的视角播放3D视频，形成3D动画的展示效果。
在一实例中，上述获取媒体文件对应的附加媒体数据(比如获取当前主视频对应的360度视频广告素材)可以包括：由媒体播放客户端中的关联逻辑插件(比如广告的订单逻辑插件)通过执行附加媒体的关联逻辑(如广告的订单逻辑)从外部获取媒体文件对应的附加媒体数据(如视频播放客户端中的订单逻辑插件可以通过执行广告的订单逻辑获取视频文件对应的广告数据)。再由媒体播放客户端中的富媒体插件加载关联逻辑插件获取到的附加媒体数据中的全景媒体素材。上述展示全景媒体素材中视角对应的一张图片中的一部分或者多张图片中的一张，或者以所确定的视角展示三维视频可以包括：由上述富媒体插件展示全景媒体素材中此视角对应的一张图片中的一部分或者多张图片中的一张，或者由上述富媒体插件以此视角展示三维视频。其中，当媒体播放客户端位于PC时，关联逻辑插件可以为Flash插件，富媒体插件可以为该Flash插件之上的富媒体壳；当媒体播放客户端位于移动终端时，关联逻辑插件可以为软件开发包(SDK)插件，富媒体插件可以为网络视图(webview)插件。
以下以附加媒体为360度视频广告为例，对本申请提供的技术方案做进一步说明。
一、媒体播放客户端位于移动终端
360度视频广告是由HTML5+JS+CSS3等前端技术实现。底层为媒体播放客户端，如视频应用(APP)，APP之上的SDK插件执行订单逻辑获取广告素材(包括360度视频广告素材)，并由媒体播放客户端来实现主视频(即前述的媒体文件)的播放逻辑。富媒体插件本身为一个webview页面，由APP创建后层叠在主视频的播放层之上，然后在webview页面中实现360度视频广告素材加载以及3D效果实现等功能。
二、媒体播放客户端位于PC
360度视频广告是由Flash技术实现，底层为腾讯视频主播放器，然后由主播放器加载广告插件(flash插件，其上再运行富媒体插件，都是flash技术)，进行订单逻辑的实现，最终由订单返回的参数内容获取到360视频素材以及富媒体壳的加载，最终由富媒体壳完成360视频效果的实现。
在一实例中，在展示全景媒体素材中的图片或三维视频之前，可以先提示用户是否展示附加媒体的全景效果，在用户操作确认要展示全景效果时，再进入全景效果展示模式，进而开始监听用户的操作。此种情况下，可以先展示默认的附加媒体数据，比如是全景媒体素材中对应于预设视角的一张图片中的一部分或者多张图片中的一张，或者以预设视角展示全景媒体素材中的三维视频，或者是附加媒体数据中携带的全景媒体素材以外的一张图片或一段视频，并提示用户是否要展示全景效果。例如附加媒体为贴片广告，如图7所示，可以先展示一默认的贴片701，该默认的贴片不具有全景展示效果，同时通过图标702提示是否需要展示全景效果，用户可以通过点击图标702而使媒体播放客户端进入广告的全景展示模式，进而开始监听用的操作(如拖动鼠标、转动终端设备、对于触摸屏的手势操作等)。
在一实例中，媒体播放客户端在开始监听用户的操作之后(即进入附加媒体的全景展示模式之后)，可进入提示用户是否要停止展示全景效果(比如图8所示的在用户界面中展示一提示图标801)，当接收到用户确认停止展示全景效果的响应时(如用户点击了提示是否停止展示全景效果的图标801)，退出全景展示模式进而停止监听用户的操作。
在一实例中，在展示默认的附加媒体数据时，比如是全景媒体素 材中对应于预设视角的一张图片中的一部分或者多张图片中的一张，或者以预设视角展示全景媒体素材中的三维视频，或者是附加媒体数据中携带的全景媒体素材以外的一张图片或一段视频，可以按预设时长开始倒计时(如图7中703所示的倒计时)，当接收到用户确认要展示全景效果的响应时暂停倒计时，在进入全景展示模式后，当接收到用户确认停止展示全景效果的响应时再继续此倒计时。
基于上述方法，本申请还提出了一种附加媒体展示装置，其可置于媒体播放客户端中，如图9所示，包括如下模块：获取模块901、监听模块902、展示模块903。
获取模块901，获取媒体文件对应的附加媒体数据；其中，该附加媒体数据包括全景媒体素材，全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，此张图片的每一部分或者上述多张图片中的每一张对应不同的视角，上述三维视频能以不同的视角展示。这里，获取模块901可以在媒体播放客户端展示媒体文件期间获取该媒体文件对应的附加媒体数据。
监听模块902，监听用户的操作。
展示模块903，响应于监听模块902监听到的操作，确定该操作对应的视角，展示上述全景媒体素材中该视角对应的上述一张图片中的一部分或者上述多张图片中的一张，或者以该视角展示上述三维视频。
在一实例中，该装置可进一步包括：提示模块904。其中，展示模块903在获取模块901获取到附加媒体数据后，进一步展示全景媒体素材中对应于预设视角的上述一张图片的一部分或者上述多张图片中的一张，或者以一预设视角展示上述三维视频，或者展示上述附加媒体数据中全景媒体素材以外的一张图片或一段视频，并触发提示 模块904。提示模块904在被展示模块903触发后提示用户是否要展示全景效果，并当接收到用户确认要展示全景效果的响应时，触发监听模块902开始监听用户的操作。提示模块904，进一步提示用户是否要停止展示全景效果，当接收到用户确认停止展示全景效果的响应时，触发监听模块902停止监听用户的操作。
在一实例中，该装置可进一步包括：计时模块905。其中，展示模块903，当展示预设视角的上述一张图片中的一部分或者上述多张图片中的一张，或者以预设视角展示上述三维视频，或者展示上述全景媒体素材以外的一张图片或一段视频时，进一步触发计时模块905按预设时长开始倒计时。提示模块904，当接收到用户确认要展示全景效果的响应时进一步触发计时模块905暂停倒计时；当接收到用户确认停止展示全景效果的响应时进一步触发计时模块905继续倒计时。
上述各模块功能的具体实现方式前文已有描述，这里不在赘述。
另外，在本申请各个实例中的各模块可以集成在一个处理单元中，也可以是各个模块单独物理存在，也可以两个或两个以上装置或模块集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
在一实例中，上述的附加媒体展示装置可运行在任一可进行媒体展示的计算设备中(比如包括显示接口的计算设备)，并加载在该计算设备的存储器中，此存储器可以包括：随机存取存储器(Random Access Memory，RAM)和/或非易失性存储器等。如图9所示，该计算设备除了包括上述附加媒体展示装置中的各个模块901～905，还可包括：存储器920、处理器910、总线940、端口930。处理器910和存储器920通过总线940互联。处理器910可通过端口930接收和发 送数据以实现网络通信和/或本地通信。上述各模块901～905可以是存储器920中存储的机器可执行指令模块。处理器910通过执行存储器920中各模块901～904中包含的机器可执行指令，进而能够实现上述各模块901～905的功能。
具体而言，在本申请中的一些实例中，上述存储器920将存储有一个或者一个以上程序，且经配置由一个或者一个以上处理器910执行。
上述一个或者一个以上程序可以包括如下指令模块：
获取模块901，获取媒体文件对应的附加媒体数据；其中，该附加媒体数据包括全景媒体素材，全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，此张图片的每一部分或者上述多张图片中的每一张对应不同的视角，上述三维视频能以不同的视角展示。这里，获取模块901可以在媒体播放客户端展示媒体文件期间获取该媒体文件对应的附加媒体数据。
监听模块902，监听用户的操作。
展示模块903，响应于监听模块902监听到的操作，确定该操作对应的视角，展示上述全景媒体素材中该视角对应的上述一张图片中的一部分或者上述多张图片中的一张，或者以该视角展示上述三维视频。当上述附加媒体展示装置所在的计算设备为PC时，该计算设备可以包括能够接收用户操作的外围输入设备，如：键盘、鼠标、触摸屏、手柄等等，这样监听模块902才能够监听到用户的操作，使得展示模块能够基于用户的操作来进行附加媒体的全景展示。当上述附加媒体展示装置所在的计算设备为移动终端时，该计算设备可以包括能够接收用户操作的部件，如：按键、触摸屏、线控等等，也可以包括陀螺仪、重力加速度传感器等这种能够感知计算设备姿态变化的部 件，这样监听模块902才能够监听到用户的操作，使得展示模块能够基于用户的操作来进行附加媒体的全景展示。
另外，本申请的每个实例可以通过由数据处理设备如计算机执行的数据处理程序来实现。显然，数据处理程序构成了本申请。此外，通常存储在一个存储介质中的数据处理程序通过直接将程序读取出存储介质或者通过将程序安装或复制到数据处理设备的存储设备(如硬盘和或内存)中执行。因此，这样的存储介质也构成了本申请。存储介质可以使用任何类型的记录方式，例如纸张存储介质(如纸带等)、磁存储介质(如软盘、硬盘、闪存等)、光存储介质(如CD-ROM等)、磁光存储介质(如MO等)等。
因此，本申请还提供了一种存储介质，其中存储有数据处理程序，该数据处理程序用于执行本申请上述方法的任何一种实例。
以上所述仅为本申请的实例而已，并不用以限制本申请，凡在本申请的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本申请保护的范围之内。

Claims (13)

  1. 一种媒体播放中的附加媒体展示方法，其特征在于，该方法包括：
    获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；
    监听用户的操作；
    响应于监听到的操作，确定所述操作对应的视角；
    展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
  2. 根据权利要求1所述的方法，进一步包括：
    在获取到所述附加媒体数据后，展示所述全景媒体素材中对应于预设视角的所述一张图片的一部分或者所述多张图片中的一张，或者以预设视角展示所述三维视频，或者展示所述附加媒体数据中所述全景媒体素材以外的一张图片或一段视频，并提示用户是否要展示全景效果；
    其中，当接收到用户确认要展示全景效果的响应时，开始监听用户的操作。
  3. 根据权利要求2所述的方法，进一步包括：
    在开始监听用户的操作之后，提示用户是否要停止展示全景效 果；
    当接收到用户确认停止展示全景效果的响应时，停止监听用户的操作。
  4. 根据权利要求3所述的方法，进一步包括：
    当展示所述预设视角的所述一张图片中的一部分或者所述多张图片中的一张，或者以预设视角展示所述三维视频，或者展示所述全景媒体素材以外的一张图片或一段视频时，按预设时长开始倒计时；
    当接收到用户确认要展示全景效果的响应时暂停所述倒计时；
    当接收到用户确认停止展示全景效果的响应时继续所述倒计时。
  5. 根据权利要求1所述的方法，其中，当所述媒体播放客户端位于个人电脑PC时，所述监听用户的操作包括：监听用户通过所述PC的输入设备而进行的操作；
    当所述媒体播放客户端位于移动终端时，所述监听用户的操作包括：监听所述移动终端的触摸屏上的手势操作和/或通过所述移动终端的陀螺仪监听所述移动终端的姿态变化。
  6. 根据权利要求1所述的方法，其中，所述获取媒体文件对应的附加媒体数据，包括：
    由关联逻辑插件通过执行附加媒体的关联逻辑从外部获取所述媒体文件对应的所述附加媒体数据；以及
    由富媒体插件加载所述关联逻辑插件获取到的所述附加媒体数据中的所述全景媒体素材；
    以及
    所述展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频，包括：
    由所述富媒体插件展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者由所述富媒体插件以所述视角展示所述三维视频。
  7. 根据权利要求6所述的方法，其中，当所述媒体播放客户端位于PC时，所述关联逻辑插件为Flash插件，所述富媒体插件为所述Flash插件之上的富媒体壳；
    当所述媒体播放客户端位于移动终端时，所述关联逻辑插件为软件开发包SDK插件，所述富媒体插件为网络视图webview插件。
  8. 根据权利要求1至7任一项所述的方法，其中，所述不同的视角，包括：同一二维平面中的多个视角或者同一三维空间中的多个视角。
  9. 一种媒体播放中的附加媒体展示装置，其特征在于，该装置包括：
    一个或一个以上存储器；
    一个或一个以上处理器；其中，
    所述一个或一个以上存储器存储有一个或者一个以上指令模块，经配置由所述一个或者一个以上处理器执行；其中，
    所述一个或者一个以上指令模块包括：
    获取模块，在获取媒体文件对应的附加媒体数据；其中，所述附 加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；
    监听模块，监听用户的操作；
    展示模块，响应于监听到的操作，确定所述操作对应的视角，展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
  10. 根据权利要求9所述的装置，进一步包括：提示模块；
    所述展示模块，在所述获取模块获取到所述附加媒体数据后，进一步展示所述全景媒体素材中对应于预设视角的所述一张图片的一部分或者所述多张图片中的一张，或者以预设视角展示所述三维视频，或者展示所述附加媒体数据中所述全景媒体素材以外的一张图片或一段视频，并触发所述提示模块；
    所述提示模块，在被所述展示模块触发后提示用户是否要展示全景效果，并当接收到用户确认要展示全景效果的响应时，触发所述监听模块开始监听用户的操作。
  11. 根据权利要求10所述的装置，其中，
    所述提示模块，进一步提示用户是否要停止展示全景效果，当接收到用户确认停止展示全景效果的响应时，触发所述监听模块停止监听用户的操作。
  12. 根据权利要求11所述的装置，进一步包括：计时模块；
    所述展示模块，当展示所述预设视角的所述一张图片中的一部分或者所述多张图片中的一张，或者以预设视角展示所述三维视频，或者展示所述全景媒体素材以外的一张图片或一段视频时，进一步触发所述计时模块按预设时长开始倒计时；
    所述提示模块，当接收到用户确认要展示全景效果的响应时进一步触发所述计时模块暂停所述倒计时；当接收到用户确认停止展示全景效果的响应时进一步触发所述计时模块继续所述倒计时。
  13. 一种非易失性计算机可读存储介质，其特征在于，存储有计算机可读指令，可以使至少一个处理器执行以下操作：
    获取媒体文件对应的附加媒体数据；其中，所述附加媒体数据包括全景媒体素材，所述全景媒体素材包括一张被分为多个部分的图片、多张图片或者三维视频，其中，所述一张图片的每一部分或者所述多张图片中的每一张对应不同的视角，所述三维视频能以不同的视角展示；
    监听用户的操作；
    响应于监听到的操作，确定所述操作对应的视角；
    展示所述全景媒体素材中所述视角对应的所述一张图片中的一部分或者所述多张图片中的一张，或者以所述视角展示所述三维视频。
PCT/CN2017/079267 2016-04-11 2017-04-01 媒体播放中的附加媒体展示方法及装置 WO2017177842A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610221533.1 2016-04-11
CN201610221533.1A CN107295393B (zh) 2016-04-11 2016-04-11 媒体播放中的附加媒体展示方法及装置以及计算设备和计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2017177842A1 true WO2017177842A1 (zh) 2017-10-19

Family

ID=60042323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/079267 WO2017177842A1 (zh) 2016-04-11 2017-04-01 媒体播放中的附加媒体展示方法及装置

Country Status (2)

Country Link
CN (1) CN107295393B (zh)
WO (1) WO2017177842A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923435A (zh) * 2021-08-26 2022-01-11 北京城市网邻信息技术有限公司 一种信息展示方法、设备及存储介质

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107911737B (zh) * 2017-11-28 2020-06-19 腾讯科技（深圳）有限公司 媒体内容的展示方法、装置、计算设备及存储介质
CN109960546B (zh) * 2017-12-14 2021-09-10 腾讯科技（深圳）有限公司 虚拟资源交互方法和装置、存储介质及电子装置
CN113012290B (zh) * 2021-03-17 2023-02-28 展讯通信(天津)有限公司 基于终端姿态的图片显示及获取方法及装置、存储介质、终端
CN114051090B (zh) * 2021-10-12 2023-07-18 聚好看科技股份有限公司 一种全景视频中投放资源的方法及显示设备
CN113992679B (zh) * 2021-10-26 2023-10-31 广域铭岛数字科技有限公司 一种汽车图像显示方法、系统及设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001063916A1 (en) * 2000-02-25 2001-08-30 Interval Research Corporation Method and system for selecting advertisements
CN101448138A (zh) * 2008-12-29 2009-06-03 深圳市同洲电子股份有限公司 一种视频广告的插播方法、系统及服务器
CN102789348A (zh) * 2011-05-18 2012-11-21 北京东方艾迪普科技发展有限公司 交互式三维图形视频可视化系统
CN102819388A (zh) * 2012-07-05 2012-12-12 东莞市尚睿电子商务有限公司 应用于移动终端操作系统的图片全景展示处理系统及其安装使用方法
CN104748746A (zh) * 2013-12-29 2015-07-01 刘进 智能机姿态测定及虚拟现实漫游方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001063916A1 (en) * 2000-02-25 2001-08-30 Interval Research Corporation Method and system for selecting advertisements
CN101448138A (zh) * 2008-12-29 2009-06-03 深圳市同洲电子股份有限公司 一种视频广告的插播方法、系统及服务器
CN102789348A (zh) * 2011-05-18 2012-11-21 北京东方艾迪普科技发展有限公司 交互式三维图形视频可视化系统
CN102819388A (zh) * 2012-07-05 2012-12-12 东莞市尚睿电子商务有限公司 应用于移动终端操作系统的图片全景展示处理系统及其安装使用方法
CN104748746A (zh) * 2013-12-29 2015-07-01 刘进 智能机姿态测定及虚拟现实漫游方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113923435A (zh) * 2021-08-26 2022-01-11 北京城市网邻信息技术有限公司 一种信息展示方法、设备及存储介质
CN113923435B (zh) * 2021-08-26 2022-08-05 北京城市网邻信息技术有限公司 一种信息展示方法、设备及存储介质

Also Published As

Publication number Publication date
CN107295393A (zh) 2017-10-24
CN107295393B (zh) 2019-12-13

Similar Documents

Publication Publication Date Title
WO2017177842A1 (zh) 媒体播放中的附加媒体展示方法及装置
CN109167950B (zh) 视频录制方法、视频播放方法、装置、设备及存储介质
US10812868B2 (en) Video content switching and synchronization system and method for switching between multiple video formats
US11830161B2 (en) Dynamically cropping digital content for display in any aspect ratio
CN109729411B (zh) 直播互动方法及装置
WO2019105274A1 (zh) 媒体内容的展示方法、装置、计算设备及存储介质
CN111970532B (zh) 视频播放方法、装置及设备
US20100156907A1 (en) Display surface tracking
US20120159327A1 (en) Real-time interaction with entertainment content
CN111277890B (zh) 虚拟礼物的获取方法和三维全景直播间的生成方法
CN114116053B (zh) 资源展示方法、装置、计算机设备及介质
US10015442B1 (en) Three-way video calling on hinged multi-screen device
CN112118477A (zh) 虚拟礼物展示方法、装置、设备以及存储介质
WO2018076939A1 (zh) 视频文件的处理方法和装置
CN115002359B (zh) 视频处理方法、装置、电子设备及存储介质
WO2016202024A1 (zh) 一种3d动画的展现方法及装置
CN112732089A (zh) 一种虚拟现实设备及快捷交互方法
CN113886611A (zh) 资源展示方法、装置、计算机设备及介质
CN109302636B (zh) 提供数据对象全景图信息的方法及装置
CN112131422A (zh) 表情图片生成方法、装置、设备及介质
US10733790B2 (en) Systems and methods for creating and displaying interactive 3D representations of real objects
WO2024125195A1 (zh) 一种信息展示方法及装置
CN114302160A (zh) 信息显示方法、装置、计算机设备及介质
WO2024164983A1 (zh) 一种特效生成方法、装置、计算机设备及存储介质
CN113194329A (zh) 直播互动方法、装置、终端及存储介质

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17781818

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17781818

Country of ref document: EP

Kind code of ref document: A1