· Instructors: Moncef Gabbouj , Karen Egiazarian , and Atanas Gotchev
During the first period, lectures on selected topics related with 3DTV will be given. During the second period, more detailed topics will be covered by student presentations. Students are encouraged to contact the instructors on time to choose a presentation topic.
Contents: Fundamentals of algebra, vector and matrix operations. Implicit, explicit and parametric description of geometric primitives (points, lines, triangles etc.). Euclidian, affine and projective spaces, Cartesian, barycentric and homogeneous coordinates, coordinate systems (world coordinates, camera coordinates, device coordinates). Principle of duality. Points, vectors and frames. Geometric transformations in E2 and E3. Projective transformations. Stereo projection. Camera parameters and camera settings.
Contents: Extracting 3D structure from multi-view 2D images. Determining correpondences between images: feature extraction, robust feature matching, finding dense correspondences. Determining 3D structure from image pairs: epipolar geometry, solving for F-matrix, E-matrix and 3D parameters, triangulation for depth estimation. Determining 3D structure from multiframes (video): bundle adjustment for multi-frames, factorization approaches, recursive methods based on Kalman filters.
Contents: Introduction to computer graphics. Geometric modeling: curves, surfaces, and solids. Usage of implicit and parametric surfaces for modeling and rendering (collision detection for animation purposes, ray-surface intersections for rendering, generating geometric primitives). Polygon mesh representations. Cubic curves and surfaces (Hermite, Bezier BSpline, etc.). Introduction to animation.
Contents: Radiance, irradiance, image formation, BRDF, Lambert's cosine law. Object space rendering techniques (Gouraud shading, Phong shading etc.). Image space rendering techniques (ray tracing). Texture mapping, bump mapping, environment mapping.
Contents: Basic principles of digital coding of waveforms, basic entropy, fundamentals of lossless and lossy compression. Transform domain data coding: discrete cosine transform (DCT), integer arithmetic based implementation of DCT, integer transform, KLT and wavelet transforms. Lifting implementation of the wavelet transform. Geometric coding. JPEG algorithm. Basics of video compression. Popular video standards: H.263, H.264, MPEG-1, MPEG-2, MPEG-4. 3D video coding techniques (multichannel video coding, stereo video coding, mesh based coding etc.).
Contents: Internet protocol stack overview. Basics of data transport. IP reliable transport, flow and congestion control. Multicast. Wireless networking issues. Multimedia transport over IP. Packet loss (resilience, recovery). Delay (buffer management). Review of the existing protocols and techniques. 3D video models and their transport over IP. Left/right views. Views and depth. Views and 3D models. Lightfields.
Contents: Introduction to elementary ray and wave optics from a signals and systems viewpoint, plane-wave decompositions, diffraction, Fourier optics.
Contents: Directional basics of stereoscopic vision and an analytical view of stereoscopy. 3D cues and the human visual system. Autostereoscopic displays: multiple image and volumetric.
Contents: Depth perception, 3D displays: color multiplex, polarization multiplex, time multiplex, location multiplex, direction multiplex, multiple focal distances.
Contents: Fundamentals of holography and holographic 3DTV techniques. Brief Introduction to the theoretical basis and experimental techniques of the holographic process. Techniques for dynamic holographic recording. Digital methods in holography, hybrid and synthesized holograms for dynamic holographic displays. SLMs and DMDs for holographic displays. Applications of holographic 3D displays.