Parallax mapping types

From Tech Artists Wiki

Contents 1 Introduction 2 The start of the road 2.1 Normal Mapping 2.2 Parallax/Offset/Virtual Displacement Mapping 2.3 Parallax with Offset Limiting 2.4 Iterative Parallax Mapping 3 The fork in the road 3.1 Relief Mapping 3.2 Cone Mapping 3.3 Parallax Occlusion 3.4 Steep Parallax 4 Conclusions

[edit] Introduction

Parallax mapping is a convoluted and confusing topic. There are a number of different types of bump mapping, and parallax is one. The development of the methods is not quite iterative and not at all linear. Its damn confusing, actually. I'll give a quick run-down of all the methods, so that you can sound graphically sophisticated when you're discussing next-gen shader rendering techniques at parties.

[edit] The start of the road

These techniques have been around for years now, and they are common place and relatively cheap. Also, there was a somewhat linear development of the techniques, in contrast to the later "Occlusion" techniques.

[edit] Normal Mapping

Normal mapping reads the normal for a surface from a texture, instead of the geometry. This allows a flat surface to take the lighting information of a much more complex surface. It is also a relatively cheap technique. See my Shaders article.

[edit] Parallax/Offset/Virtual Displacement Mapping

(Unreal Engine 3) This uses a heightmap that will alter the UV's of a surface depending on the height and the the eye vector (the line from the camera to the pixel). Lower areas will squish together, higher areas will spread out some, and the result will look like the texture is occluded. This technique is relatively cheap, as well, it is just a few instructions added to a normal mapping shader.

[edit] Parallax with Offset Limiting

(FEAR) At glancing angles, the texture appears to "swim" a great deal with regular Parallax mapping. The pixels are all a mess. So applying a limit to the movement largely solves this.

[edit] Iterative Parallax Mapping

http://www.cescg.org/CESCG-2006/papers/TUBudapest-Premecz-Matyas.pdf

One of the more interesting Parallax implementations, which never really caught on. It uses the ideas learned later, with the Occlusion mapping types, in order to find a more exact Parallax via iterations of the offset.

[edit] The fork in the road

Here we have a paradigm shift. All the techniques up to now are "hacks" are far as the occlusion goes. The following techniques are all similar in a couple ways; they use a raycast to test for occlusion; they actually perform occlusion of pixels, and are not "hacks" like the above techniques. There is "true" occlusion. The difference is mainly in how the raytrace is performed, with regards to accuracy, performance, etc. The paradigm shift is also that these are just now becoming feasible on current hardware.

[edit] Relief Mapping

• http://fabio.policarpo.nom.br/relief/index.htm
• There is a Relief Mapping node in ShaderFX.

This uses a binary search. It was one of the really groundbreaking Parallax papers, and he's referenced in nearly every Occlusion shader paper. It is a good and usable Occlusion solution (clocks at 69 pixel shader instructions in Policarpo's implementation). The main drawback is that that it uses hard-edged shadows and sampling can fall apart at glancing angles.

[edit] Cone Mapping

• http://www.lonesock.net/files/ConeStepMapping.pdf

This focuses on creating a better method of finding the ray intersection between the view and the heightfield, using a Cone Map. Cone mapping is a technique that is constantly being improved and innovated on, but it essentially requires a 'cone map' (pre-generated from the normal map, but it takes a while to generate). This helps with shadowing and getting rid of the linear artifacts at glancing angles.

[edit] Parallax Occlusion

• http://ati.amd.com/developer/i3d2006/I3D2006-Tatarchuk-POM.pdf
• Parallax Occlusion Shader
• Parallax Occlusion Function from the Common Functions page.
• Used in games such as Crysis and Uncharted: Drake's Fortune.

The main addition here is soft-shadowing. This is an extremely expensive implementation, but its what you'll be seeing on next-gen hardware, most likely. Tartarchuk's big improvement is the sampling method, using more samples for steeper viewing angles (decreasing the linear artifacts while maximizing efficiency).

[edit] Steep Parallax

• http://graphics.cs.brown.edu/games/SteepParallax/index.html

Developed by the Computer Science Department at Brown University. This is better for fine surface details, such as the illusion of hair, according to the research.

[edit] Conclusions

There isn't really a "best" method. Normal mapping is the simplest, and Parallax Occlusion with Soft Shadows the best. But lots of people like Normal Mapping because it doesn't have any texture swimming, and Parallx Occlusion isn't usable. Better methods are more expensive, and sometimes require properly designed assets, meaning they are not compatible. For example, to maximize a relief mapped wall you may put extra detail (such as a vine) in the texture; however, if you were just using Parallax you'd probably want to model the vine with polygons. Its important also to note that the Occlusion techniques aren't really usable in games today. This is merely meant as a extremely brief and simplistic overview of the different Parallax techniques, because, as we can see, there are at least 7 of them. I hope this cleared things up, and I hope you add your own findings and elaborate on mine on this page.