Mesostructure modelling using texture synthesis
L. Mac Manus, M. Iwasaki, K. Kamanori, S. Sato, N. A. Dodgson
We address the problem of modelling specular reflections resulting from mesostructure in object surfaces. Mesostructure lies between microstructure and macrostructure. Microstructure is surface structure that is sufficiently small to be modelled probabalistically, such as with the well known microfacet models. Macrostructure is structure large enough to be measurable using various shape capture techniques. Between these two extremes lie many object surfaces that are rippled or dimpled on a scale too small to be captured and too structured to be averaged using a microfacet model. It is to these object surfaces that we turn our attention in this paper. Our techniques allow relighting of specularly lit objects, super-resolution of specularly lit objects, and automated generation of bump maps.
Videos:
In our paper we present several examples of using our technique on still images. However, the results also hold for movie images and these videos show how our technique may be used in the relighting of a grapefruit and a lemon. Our mesostructure generation technique is applied to low-resolution normal maps to generate the specular image. Four variations are shown:- Mesostructure in both diffuse and specular channels - this is the default setting
- Mesostructure in the specular channel only - in this case the diffuse channel has been replaced with a smooth, blue textureless surface to help emphasise the contribution of the specular mesostructure
- Mesostructure in the diffuse channel only - in this case a smooth specular image is used and it is clear that this looks unrealistic
- Mesostructure in neither channel - this illustrates the paucity of the underlying low resolution normal map
- Grapefruit (our method)
- Mesostructure in both specular and diffuse channels (4.2 MB AVI DivX)
- Mesostructure in specular channel only (3.8 MB AVI DivX)
- Mesostructure in diffuse channel only (4.2 MB AVI DivX)
- Mesostructure in neither channel (3.9 MB AVI DivX)
- Mesostructure in both specular and diffuse channels (1.8 MB AVI DivX)
- Mesostructure in specular channel only (1.9 MB AVI DivX)
- Mesostructure in diffuse channel only (1.9 MB AVI DivX)
- Mesostructure in neither channel (1.9 MB AVI DivX)
- Grapefruit (Baba's method)
- Mesostructure in both specular and diffuse channels (4.4 MB AVI DivX)
- Mesostructure in specular channel only (4.0 MB AVI DivX)
- Mesostructure in both specular and diffuse channels (8.8 MB AVI DivX)
- Mesostructure in specular channel only (8.8 MB AVI DivX)
Contact:
- We welcome your comments and suggestions. Please contact
Lorcan Mac Manus.
Acknowledgements:
- We wish to thank Panasonic whose support made this project possible.