Traditional Chinese Painting Classification Based on Painting Techniques

被引:0
|
作者
Gao F. [1 ]
Nie J. [2 ]
Huang L. [2 ]
Duan L.-Y. [1 ]
Li X.-M. [1 ]
机构
[1] School of Electronics Engineering and Computer Science, Peking University, Beijing
[2] College of Information Science & Engineering, Ocean University of China, Qingdao, 266100, Shandong
来源
| 1600年 / Science Press卷 / 40期
关键词
Gongbi; Image classification; Image retrieval; Traditional Chinese painting; Xieyi;
D O I
10.11897/SP.J.1016.2017.02871
中图分类号
学科分类号
摘要
The digitization of traditional Chinese painting (TCP) is important for its preserving and sharing. Massive traditional Chinese painting has become an important part of the digital museum. How to achieve efficient retrieval and management of traditional Chinese paintings has become an urgent demands. There are two categories of approaches to handle this problem. The first category is methods based on manual annotation, trying to retrieval TCPs using the tags that labeled by annotators for each image. This kind of methods can get promising results for small dataset. But when the scale of dataset is large, these methods need a large number of annotators for manual annotation and a lot of time. This cannot meet the needs of the rapid growth in the number of TCPs. Furthermore, manual annotations are subjective, different annotators may have different understanding for the same traditional Chinese painting. The second category is methods based on image content which analyses the content of the traditional Chinese painting automatically. With the development of the theory of image analysis and retrieval, this kind of methods are widely concerned and researched. On contrary to the first kind of methods, there are many merits, e.g., they are objective and they can deal with large-scale dataset. The proposed method belongs to the latter category and focus on the classification of TCP. In this paper, we proposed a novel traditional Chinese painting classification method based on painting techniques. Generally, according to the differences of painting techniques, the traditional Chinese painting can be divided into two categories, i.e., Gongbi and Xieyi. Due to various contents, different art styles of different painters, classification of Gongbi and Xieyi is still a challenging task. By analyzing the property of Gongbi and Xieyi, we proposed a novel key region detection method for TCP firstly. The main differences between 'Gongbi' and 'Xieyi' are the representation of details. In general, Gongbi paints the outline first, then coloring, Xieyi is not. Therefore, key regions for districting Gongbi and Xieyi should consist of point and edge. According to this, in this step, we incorporated the Scale Invariant Feature Transform (SIFT) detector and canny edge detector for detecting point and edge respectively. The points and edges obtained constitute the key regions for distinguishing Gongbi and Xieyi. Secondly, we proposed a Neighborhood Difference Descriptor (NDD). NDD represents the similarity and difference for a neighborhood of each edge pixel. The final descriptors consisted of the NDD and Bag of words. Finally, a cascade classification scheme was introduced, which combined the different dimension features to obtain the classification results. Comprehensive and comparative experiments were done over a challenging dataset. The dataset consists of 1718 traditional Chinese paintings and the numbers of Gongbi and Xieyi are 822 and 896 respectively. We split the dataset into training set and testing set. The key parameter and the classification were trained on the training set. The experimental results showed that the proposed feature can describe the painting techniques property effectively and achieved promising performance. Comparative experiments showed that our method outperforms the state-of-the-art methods. © 2017, Science Press. All right reserved.
引用
收藏
页码:2871 / 2882
页数:11
相关论文
共 31 条
  • [1] Zhang H., Zha Z.J., Yang Y., Et al., Attribute-augmented semantic hierarchy: Towards a unified framework for content-based image retrieval, ACM Transactions on Multimedia Computing, Communications, and Applications, 11, 1, (2014)
  • [2] He Y.-F., Zhou L., Yu J.-Q., Et al., Image retrieval based on locally features aggregating, Chinese Journal of Computers, 34, 11, pp. 2224-2233, (2011)
  • [3] Yan K., Wang Y., Liang D., Et al., CNN vs. SIFT for image retrieval: Alternative or complementary?, Proceedings of the 2016 ACM on Multimedia Conference, pp. 407-411, (2016)
  • [4] Zhao Z.-Q., Ji H.-F., Gao J., Et al., Sparse coding based multi-scale spatial latent semantic analysis for image classification, Chinese Journal of Computers, 37, 6, pp. 1251-1260, (2014)
  • [5] Xie H., Ancient Paintings, (1991)
  • [6] Liu H.-L., The six laws of Chinese painting, Journal of Nanjing Art Institute(Fine Arts & Design), 2, pp. 24-43, (2006)
  • [7] Zhuang L., Zhuang Y.-T., Wu J.-Q., Et al., Image retrieval approach based on sparse canonical correlation analysis, Journal of Software, 23, 5, pp. 1295-1304, (2012)
  • [8] de Ves E., Benavent X., Coma I., Et al., A novel dynamic multi-model relevance feedback procedure for content-based image retrieval, Neurocomputing, 208, pp. 99-107, (2016)
  • [9] Guo J.M., Prasetyo H., Content-based image retrieval using features extracted from halftoning-based block truncation coding, IEEE Transactions on Image Processing, 24, 3, pp. 1010-1024, (2015)
  • [10] Xie L., Hong R., Zhang B., Et al., Image classification and retrieval are ONE, Proceedings of the 5th ACM on International Conference on Multimedia Retrieval, pp. 3-10, (2015)