TY - GEN
T1 - Multi-label active learning with low-rank mapping for image classification
AU - Guo, Anqian
AU - Wu, Jian
AU - Sheng, Victor S.
AU - Zhao, Pengpeng
AU - Cui, Zhiming
N1 - Funding Information:
In real-word applications, each image usually has multiple labels according to its semantic information [1]. Correspondingly, multi-label image classification arises and has received broad attention recently [2, 3]. Active learning is This research was partially supported by the Natural Science Foundation of China under grant No.61402311 and 61440053, Jiangsu Province Colleges and Universities Natural Science Research Project under grant No.13KJB520021, and the U.S. National Science Foundation (IIS-1115417).
Publisher Copyright:
© 2017 IEEE.
PY - 2017/8/28
Y1 - 2017/8/28
N2 - In multi-label image classification, each image is always associated with multiple labels and labels are usually correlated with each other. The intrinsic relation among labels can definitely contribute to classifier training. However, most previous studies on active learning for multi-label image classification purely mine label correlation based on observed label distribution. They ignore the mapping relation between examples and their labels. This mapping relation also implicates label relationship. Ignoring the mapping relation leads to an uncomprehensive label correlation estimation and results in a bad performance for classification. In this paper, we propose a novel multi-label active learning with low-rank mapping for image classification, called LMMAL, to solve this issue. More precisely, we train a low-rank mapping matrix to signify the mapping relation between the feature space and the label space of a certain multi-label dataset. Using this low-rank mapping relation, we exploit a full label correlation. Subsequently, an effective sampling strategy is designed by integrating this potential information with uncertainty to select the most informative example-label pairs. In addition, we extend LMMAL with automatic labeling (denoted as AL-LMMAL) to further reduce the annotation workload of active learning. Empirical results demonstrate the effectiveness of our approaches.
AB - In multi-label image classification, each image is always associated with multiple labels and labels are usually correlated with each other. The intrinsic relation among labels can definitely contribute to classifier training. However, most previous studies on active learning for multi-label image classification purely mine label correlation based on observed label distribution. They ignore the mapping relation between examples and their labels. This mapping relation also implicates label relationship. Ignoring the mapping relation leads to an uncomprehensive label correlation estimation and results in a bad performance for classification. In this paper, we propose a novel multi-label active learning with low-rank mapping for image classification, called LMMAL, to solve this issue. More precisely, we train a low-rank mapping matrix to signify the mapping relation between the feature space and the label space of a certain multi-label dataset. Using this low-rank mapping relation, we exploit a full label correlation. Subsequently, an effective sampling strategy is designed by integrating this potential information with uncertainty to select the most informative example-label pairs. In addition, we extend LMMAL with automatic labeling (denoted as AL-LMMAL) to further reduce the annotation workload of active learning. Empirical results demonstrate the effectiveness of our approaches.
KW - Active learning
KW - Automatic labeling
KW - Label correlation
KW - Multi-label image classification
UR - http://www.scopus.com/inward/record.url?scp=85030246370&partnerID=8YFLogxK
U2 - 10.1109/ICME.2017.8019412
DO - 10.1109/ICME.2017.8019412
M3 - Conference contribution
AN - SCOPUS:85030246370
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
SP - 259
EP - 264
BT - 2017 IEEE International Conference on Multimedia and Expo, ICME 2017
PB - IEEE Computer Society
T2 - 2017 IEEE International Conference on Multimedia and Expo, ICME 2017
Y2 - 10 July 2017 through 14 July 2017
ER -