Multimedia Tools and Applications

Selective clustering for representative paintings selection

Y. Deng, F. Tang, W. Dong, F. Wu, O. Deussen, C. Xu

Material

Abstract

Selective classification (or rejection based classification) has been proved useful in many applications. In this paper we describe a selective clustering framework with reject option to carry out large-scale digital arts analysis. With the help of deep learning techniques, we extract content-style features from a pre-trained convolutional network for the paintings. By proposing a rejection mechanism under Bayesian framework, we focus on selecting style-oriented representative paintings of an artist, which is an interesting and challenging cultural heritage application. Two kinds of samples are rejected during the rejection based robust continuous clustering process. Representative paintings are selected during the selective clustering phase. Visual qualitative analysis on small painting set and large scale quantitative experiments on a subset of Wikiart show that the proposed rejection based selective clustering approach outperforms the standard clustering methods.

BibTeX

@article{Deng2019Selectiveclusteringrepresentative,
  abstract  = {Selective classification (or rejection based classification) has been proved useful in many applications. In this paper we describe a selective clustering framework with reject option to carry out large-scale digital arts analysis. With the help of deep learning techniques, we extract content-style features from a pre-trained convolutional network for the paintings. By proposing a rejection mechanism under Bayesian framework, we focus on selecting style-oriented representative paintings of an artist, which is an interesting and challenging cultural heritage application. Two kinds of samples are rejected during the rejection based robust continuous clustering process. Representative paintings are selected during the selective clustering phase. Visual qualitative analysis on small painting set and large scale quantitative experiments on a subset of Wikiart show that the proposed rejection based selective clustering approach outperforms the standard clustering methods.},
  author    = {Y. Deng, F. Tang, W. Dong, F. Wu, O. Deussen, C. Xu},
  day       = {09},
  doi       = {10.1007/s11042-019-7271-7},
  issn      = {1573-7721},
  journal   = {Multimedia Tools and Applications},
  month     = {feb},
  number    = {14},
  pages     = {19305--19323},
  publisher = {Springer Science and Business Media LLC},
  title     = {Selective clustering for representative paintings selection},
  url       = {http://graphics.uni-konstanz.de/publikationen/Deng2019Selectiveclusteringrepresentative},
  volume    = {78},
  year      = {2019}
}