ImageBasedRendering

ImageBasedRendering - Image Based Rendering an overview...

Info iconThis preview shows pages 1–19. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Image Based Rendering an overview Photographs We have tools that acquire and tools that • We have tools that acquire and tools that display photographs at a convincing quality level 2
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
2 3 4
Background image of page 2
3 5 6
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
4 7 8
Background image of page 4
5 9 10
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
6 Photographs We have tools that acquire and tools that • We have tools that acquire and tools that display photographs at a convincing quality level, for almost 100 years now 11 12 Sergei Mikhailovich Prokudin-Gorskii. A Settler's Family, ca. 1907-1915.
Background image of page 6
7 13 Sergei Mikhailovich Prokudin-Gorskii. Tea Factory in Chakva. Chinese Foreman Lau-Dzhen-Dzhau. ca. 1907-1915. 14 Sergei Mikhailovich Prokudin-Gorskii. The Emir of Bukhara, 1911.
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
8 RGB in early 1900’s 15 Plenoptic function Defines all the ray • Defines all the rays – through any point in space (x, y, z) – with any orientation ( θ , φ ) – over all wavelenghts ( λ ) – at any given moment in time (t) 16 ) , , , , , , ( t z y x P λ ϕ φ ρ=
Background image of page 8
9 IBR summary Representation of plenoptic function explicit implicit model apping ramas rphing arping abases 17 geometric texture m a pano view mor 3D image w ray dat Lightfield – Lumigraph approach [Levoy96, Gortler96] • Take all photographs you will ever need to display • Model becomes database of rays Rendering becomes database querying 18 • Rendering becomes database querying
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10 Overview Introduction • Introduction • Lightfield – Lumigraph – definition – construction – compression 19 Overview Introduction • Introduction • Lightfield – Lumigraph – definition – construction – compression 20
Background image of page 10
11 From 7D to 4D P λ ϕ φ ρ= • Static scene, t constant λ approximated with RGB ) , , , , , , ( t z y x 21 • consider only convex hull of objects, so the origin of the ray does not matter 4D Lightfield / Lumigraph 22
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
12 Discreet 4D Lightfield 23 Lightfield: set of images with COPs on regular grid 24
Background image of page 12
13 or Lightfield: set of images of a point seen at various angles 25 Depth correction of rays 26
Background image of page 13

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
14 Overview Introduction • Introduction • Lightfield – Lumigraph – definition – construction – compression 27 Overview Introduction • Introduction • Lightfield – Lumigraph – definition – construction – compression 28
Background image of page 14
15 Construction from dense set of photographs 29 Construction from sparse set of photographs iti camera positions 30 acquisition stage blue screening space carving
Background image of page 15

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
16 Filling in gaps using pull-push algorithm • Pull phase • low res levels are created • gaps are shrunk • Push phase 31 • gaps at high res levels are filled using low res levels Overview Introduction • Introduction • Lightfield – Lumigraph – definition – construction – compression 32
Background image of page 16