Convolutional recognition of dynamic textures with preliminary categorization

Abstract

Dynamic Texture (DT) can be considered as an extension of the static texture additionally comprising the motion features. The DT is very wide but the weak studied type of textures that is employed in many tasks of computer vision. The proposed method of the DTs recognition includes a preliminary categorization based on the proposed four categories, such as natural particles with periodic movement, natural translucency/transparent non-rigid blobs with randomly changed movement, man-made opaque rigid objects with periodic movement, and man-made opaque rigid objects with stationary or chaotic movement. Such formulation permitted to construct the separate spatial and temporal Convolutional Neural Networks (CNNs) for each category. The inputs of the CNNs are a pair of successive frames (taken through 1, 2, 3, or 4 frames according to a category), while the outputs store the sets of binary features in a view of histograms. In test stage, the concatenated histograms are compared with the histograms of the classes using the Kullback-Leibler distance. The experiments demonstrate the efficiency of the designed CNNs and provided the recognition rates up 97.46–98.32% for the sequences with a single type of the DT conducted on the DynTex database.