Attal et al., 2020 - Google Patents

MatryODShka: Real-time 6DoF video view synthesis using multi-sphere images

Attal et al., 2020

View PDF
Document ID
10989159617796509767
Author
Attal B
Ling S
Gokaslan A
Richardt C
Tompkin J
Publication year
Publication venue
European Conference on Computer Vision

External Links

Snippet

We introduce a method to convert stereo 360^ ∘ (omnidirectional stereo) imagery into a layered, multi-sphere image representation for six degree-of-freedom (6DoF) rendering. Stereo 360^ ∘ imagery can be captured from multi-camera systems for virtual reality (VR) …
Continue reading at arxiv.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0207—Picture signal generators using a stereoscopic image camera involving a single 2D image pickup sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/02—Picture signal generators
    • H04N13/0203—Picture signal generators using a stereoscopic image camera
    • H04N13/0239—Picture signal generators using a stereoscopic image camera having two 2D image pickup sensors representing the interocular distance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/0003—Stereoscopic image signal coding, multiplexing, processing, recording or transmission
    • H04N13/0007—Processing stereoscopic image signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic or multiview television systems; Details thereof
    • H04N13/04—Picture reproducers

Similar Documents

Publication Publication Date Title
Attal et al. MatryODShka: Real-time 6DoF video view synthesis using multi-sphere images
Serrano et al. Motion parallax for 360 RGBD video
Zhou et al. Stereo magnification: Learning view synthesis using multiplane images
Bertel et al. Omniphotos: casual 360 vr photography
Lin et al. Deep multi depth panoramas for view synthesis
Luo et al. Parallax360: Stereoscopic 360 scene representation for head-motion parallax
US20130321396A1 (en) Multi-input free viewpoint video processing pipeline
Lai et al. Real-time panoramic depth maps from omni-directional stereo images for 6 dof videos in virtual reality
US20080246759A1 (en) Automatic Scene Modeling for the 3D Camera and 3D Video
Richardt et al. Capture, reconstruction, and representation of the visual real world for virtual reality
JP7519390B2 (en) Neural Blending for Novel View Synthesis
Bonatto et al. Real-time depth video-based rendering for 6-DoF HMD navigation and light field displays
Cheng et al. Quad‐fisheye Image Stitching for Monoscopic Panorama Reconstruction
WO2016087702A1 (en) Digital video rendering
da Silveira et al. Omnidirectional visual computing: Foundations, challenges, and applications
Pintore et al. Deep synthesis and exploration of omnidirectional stereoscopic environments from a single surround-view panoramic image
Cooke et al. Multi-view synthesis: A novel view creation approach for free viewpoint video
Fachada et al. Chapter View Synthesis Tool for VR Immersive Video
Farbiz et al. Live three-dimensional content for augmented reality
Mühlhausen et al. Temporal consistent motion parallax for omnidirectional stereo panorama video
Li et al. Extending 6-dof vr experience via multi-sphere images interpolation
Huang et al. 360$^\circ $ Stereo Image Composition with Depth Adaption
Yan et al. Stereoscopic image generation from light field with disparity scaling and super-resolution
Mühlhausen et al. Immersive Free‐Viewpoint Panorama Rendering from Omnidirectional Stereo Video
Thatte et al. Real-World Virtual Reality With Head-Motion Parallax