Tutorial 2 : Image and Video Analysis using Local Binary Pattern Variants

Presenters:

Prof. Matti Pietikäinen, University of Oulu, Finland
Janne Heikkilä, University of Oulu, Finland

Abstract

This tutorial presents effective methods for image and video analysis based on recent variants of the highly popular local binary pattern (LBP) texture operator. Part I overviews the basic LBP operators in spatial and spatiotemporal domains. Part II provides an overview of recent LBP variants which improve the discriminative power and robustness of the original LBP. It also describes in more detail the local phase quantization operator (LPQ), which has the property of being highly insensitive to image blurring but also retains excellent discrimination power both with sharp and blurry images. Part III presents examples of using different LBP variants in important image and video analysis problems, including face and facial expression recognition, biomedical image analysis, motion analysis, recognition of actions and gait, and video texture synthesis. Finally, Part IV concludes the tutorial and presents some directions for future research.

Short description of the material to be covered

Part I: Introduction to local binary patterns in spatial and spatiotemporal domains [1-5]
Part II a: Recent variants of LBP (e.g. LBP-HF, LTP, LQP, LBPV, CLBP, learning-based LBP, WLD) [5-12]
Part II b: Local phase quantization (LPQ) operator [13-14]
Part III: Example applications: Face and facial expression recognition, lipreading, motion analysis, recognition of actions and gait, video texture synthesis, biomedical image analysis [5,15-20]
Part IV: Summary and future directions

Biography of the presenters

Matti Pietikäinen received the Doctor of Science in Technology degree from the University of Oulu, Finland, in 1982. In 1981, he established the Machine Vision Group at the University of Oulu. Currently, he is a professor of information engineering, scientific director of Infotech Oulu Research Center, and leader of the Machine Vision Group at the University of Oulu. From 1980 to 1981 and from 1984 to 1985 he was with the Computer Vision Laboratory at the University of Maryland. His research interests include texture-based computer vision, face analysis, activity analysis, and their applications in human-computer interaction, biometrics, biomedical image analysis, visual surveillance, and image/video retrieval. He has authored over 250 refereed papers in international journals, books, and conference proceedings and about 100 other publications or reports. His research is frequently cited and its results are used in various applications around the world. He was an associate editor of the IEEE Transactions on Pattern Analysis and Machine Intelligence and Pattern Recognition journals, and currently serves as an associate editor of Image and Vision Computing journal. He is the first author of the book entitled “Computer Vision Using Local Binary Patterns” to be published by Springer in 2011. He was also the editor of the book Texture Analysis in Machine Vision (World Scientific, 2000) and has served as a reviewer for numerous journals and conferences. He was the president of the Pattern Recognition Society of Finland from 1989 to 1992. From 1989 to 2007 he served as a member of the Governing Board of the International Association for Pattern Recognition (IAPR), and became one of the founding fellows of the IAPR in 1994. He regurarly serves on program committees of the top conferences and workshops of his field.

Janne Heikkilä received his Doctor of Science in Technology degree in information engineering from the University of Oulu in 1998. Currently, he is a professor of information technology in the Computer Science and Engineering Laboratory, and the associate leader of the Machine Vision Group. He is the former president of the Pattern Recognition Society of Finland and the member of the Governing Board of the International Association for Pattern Recognition (IAPR). He has also served on committees of several international conferences and as a reviewer in many scientific journals. His research interests include geometric camera calibration, 3D vision, geometric invariants, image registration, motion estimation, human tracking, activity analysis, and computational imaging. He has over 100 publications in peer-reviewed international journals and conference proceedings.