TY - JOUR
T1 - Weak-Labeled Active Learning With Conditional Label Dependence for Multilabel Image Classification
AU - Wu, Jian
AU - Zhao, Shiquan
AU - Sheng, Victor S.
AU - Zhang, Jing
AU - Ye, Chen
AU - Zhao, Pengpeng
AU - Cui, Zhiming
N1 - Funding Information:
Manuscript received September 3, 2015; revised January 3, 2016, July 15, 2016, and December 28, 2016; accepted January 7, 2017. Date of publication January 11, 2017; date of current version May 13, 2017. This work was supported in part by the Natural Science Foundation of China under Grant 61402311 and Grant 61603186, in part by the Jiangsu Province Colleges and Universities Natural Science Research Project under Grant 13KJB520021, and in part by the U.S. National Science Foundation under Grant IIS-1115417. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Winston Hsu.
Publisher Copyright:
© 2017 IEEE.
PY - 2017/6
Y1 - 2017/6
N2 - Multilabel image classification has been a hot topic in the field of computer vision and image understanding in recent years. To achieve better classification performance with fewer labeled images, multilabel active learning is used for this scenario. Several active learning methods have been proposed for multilabel image classification. However, all of them assume that either all training images have complete labels or label correlations are given at the beginning. These two assumptions are unrealistic. In fact, it is very difficult to obtain complete labels for each example, in particular when the size of labels in a multilabel dataset is very large. Typically, only partial labels are available. This is one type of "weak label" problem. To solve this weak label problem inside multilabel active learning, this paper proposes a novel solution called AE-WLMAL. AE-WLMAL explores conditional label correlations on the weak label problem with the help of input features and then utilizes label correlations to construct a unified sampling strategy and evaluate the informativeness of each example-label pair in a multilabel dataset for active sampling. In addition, a pruning strategy is adopted to further improve its computation efficiency. Moreover, AE-WLAML exploits label correlations to infer labels for unlabeled images, which further reduces human labeling cost. Our experimental results on seven real-world datasets show that AE-WLMAL consistently outperforms existing approaches.
AB - Multilabel image classification has been a hot topic in the field of computer vision and image understanding in recent years. To achieve better classification performance with fewer labeled images, multilabel active learning is used for this scenario. Several active learning methods have been proposed for multilabel image classification. However, all of them assume that either all training images have complete labels or label correlations are given at the beginning. These two assumptions are unrealistic. In fact, it is very difficult to obtain complete labels for each example, in particular when the size of labels in a multilabel dataset is very large. Typically, only partial labels are available. This is one type of "weak label" problem. To solve this weak label problem inside multilabel active learning, this paper proposes a novel solution called AE-WLMAL. AE-WLMAL explores conditional label correlations on the weak label problem with the help of input features and then utilizes label correlations to construct a unified sampling strategy and evaluate the informativeness of each example-label pair in a multilabel dataset for active sampling. In addition, a pruning strategy is adopted to further improve its computation efficiency. Moreover, AE-WLAML exploits label correlations to infer labels for unlabeled images, which further reduces human labeling cost. Our experimental results on seven real-world datasets show that AE-WLMAL consistently outperforms existing approaches.
KW - Multilabel active learning
KW - conditional label dependence
KW - image classification
KW - label correlation
KW - weak label
UR - http://www.scopus.com/inward/record.url?scp=85028298307&partnerID=8YFLogxK
U2 - 10.1109/TMM.2017.2652065
DO - 10.1109/TMM.2017.2652065
M3 - Article
AN - SCOPUS:85028298307
SN - 1520-9210
VL - 19
SP - 1156
EP - 1169
JO - IEEE Transactions on Multimedia
JF - IEEE Transactions on Multimedia
IS - 6
M1 - 7814308
ER -