News

• ^NEW09/14/2024: I will serve as an Area Chair of CVPR 2025 and Senior PC of AAAI 2025.

• ^NEW08/29/2024: I will serve as an Associate Editor of IEEE Transactions on Affective Computing.

• ^NEW09/02/2024: One paper on image matching was accepted to TPAMI. Congrats to Xin and Rong!

• 02/27/2024: Four papers were accepted to CVPR 2024.

• 12/08/2023: One paper was accepted to Current Issues in Tourism (SSCI), a top-tier international journal in the field of tourism.

• 08/18/2023: One paper was accepted to Proceedings of the IEEE.

• 07/14/2023: Two papers were accepted to ICCV 2023.

• 07/02/2023: I will serve as an Area Chair of CVPR 2024 and Senior PC of AAAI 2024.

• 02/28/2023: Four papers were accepted to CVPR 2023.

• 12/10/2022: One paper on automatic image complexity assessment was accepted to TPAMI. Congrats to Tinglei and Yingjie!

• 11/03/2022: One paper was accepted to Tourism Management, a top-tier international journal with the highest impator factor in the field of tourism.

• 07/04/2022: Three papers were accepted to ACM MM 2022, and another paper was accepted to ECCV 2022.

• 12/01/2021: Two papers were accepted to TIP.

• 08/18/2021: One paper on multimodal emotion recognition was accepted to IEEE Signal Processing Magazine.

• 07/22/2021: One paper on object detection was accepted to ICCV 2021.

• 07/06/2021: Another paper was accepted to TIP.

• 06/26/2021: One paper on learning from web data was accepted to TIP.

• 06/21/2021: One paper was accepted to TPAMI. Congrats to Xingxu and Guoli!

• 05/12/2021: Xingxu and Xiaoping defended their dissertations successfully. Congratulations! They would join DiDi and MeiTuan, respectively.

• 10/18/2020: Xingxu and Xiaoping received National Scholarship for Graduate Students (￥20,000). Both of them also received Merit Student Awards from Nankai University. Big Congrats!

• 7/26/2020: One paper on RGB-D saliency detection was accepted to ECCV 2020. Another paper on emotional matching was accepted to ACM MM 2020.

• 6/16/2020: Two papers on sentiment analysis were accepted to TMM.

• 11/11/2019: Two papers were accepted to AAAI 2020.

• 10/18/2019:  Liyi, Chi and Xiaoping received National Scholarship for Graduate Students (￥20,000). Congrats!

• 08/18/2019: One paper (the extended version of our CVPR 2018 paper on weakly supervised visual sentiment recognition) was accepted to TMM.

• 07/22/2019: Four papers were accepted to ICCV 2019.

• 07/02/2019: One paper was accepted to ACM MM 2019.

• 05/30/2018: Jie and Dongyu defended their dissertations successfully. Congratulations! They would join the Hong Kong Polytechnic University (PolyU) and Tsinghua University as Ph. D. students, respectively.

• 04/18/2019: One paper on visual emotion recognition was accepted to TOMM.

• 04/09/2019: One paper was accepted to TPAMI. Congrats to Jie!

• 04/02/2019: One paper on skin disease image recognition was accepted to TNNLS.

• 02/25/2019: One paper was accepted to CVPR as oral presentation.

• 02/19/2019: One paper was accepted to TIP.

• 11/07/2018: Prof. Jing-Hao Xue and Prof. Zhanyu Ma visited our lab.

• 11/01/2018: One paper was accepted to AAAI.

• 10/20/2018: Visiting student Jiamei received National Scholarship for Graduate Students from Civil Aviation University of China. Big Congrats! Jiamei published IJCAI and PRICAI papers during her visiting.

• 10/08/2018: Dongyu and Jie received National Scholarship for Graduate Students. Big Congrats!

• 09/04/2018: Prof. Chia-Wen Lin visited our lab.

• 07/03/2018: Another paper was accepted to ECCV

• 07/02/2018: One paper was accepted to ACM MM.

• 06/26/2018: Xiaoxiao was named as Excellent Graduate, and received Outstanding Dissertations Award from Nankai University.

• 06/18/2018: Another paper was accepted to TIP.

• 05/26/2018: One paper was accepted to TIP.

• 05/24/2018: Xiaoxiao defended her dissertation successfully. Congratulations! She would join Singapore University of Technology and Design (SUTD) as a Ph. D. student.

• 04/16/2018: One paper was accepted to IJCAI 2018.

• 02/18/2018: Two papers were accepted to CVPR 2018, one of which was selected as spotlight.

• 01/18/2018: Jufeng received a research grant from NLPR.

• 12/18/2017: Jufeng served as a conference co-chair of the 2017 Young Artificial Intelligence Scientists Forum: New Trends in Media Computing.

• 11/08/2017: Three papers were accepted to AAAI 2018, one of which was selected as oral presentation.

• 10/08/2017: Dongyu started her visiting to Cardiff University. She would work with Prof. Paul Rosin and Yu-Kun Lai in the next couple of weeks.

• 09/29/2017: Xiaoxiao received National Scholarship for Graduate Students. Dongyu and Xiaoxiao received Merit Student Awards from Nankai University. Congratulations!

• 06/10/2017: Ming was named as Excellent Graduate, and received Outstanding Dissertations Award from Nankai University.

• 05/20/2017: Ming and Hui defended their dissertations successfully. Congratulations! Ming would join Baidu IDL as a research engineer, and Hui would join a startup Untouch as a research engineer.

• 04/24/2017: One paper was accepted to IJCAI 2017.

• 04/12/2017: Prof. Yu-Kun Lai visited our lab.

• 04/1/2017: Prof. Xin Geng visited our lab.

• 12/21/2016: Prof. Paul Rosin visited our lab.

• 11/24/2016: Prof. Huchuan Lu visited our lab.

• 11/12/2016: One paper was accepted to AAAI 2017.

• 10/10/2016: Ming received National Scholarship for Graduate Students. Congratulations!

• 09/01/2016: The Chinese version of 'The C++ Programming Language' was published. I worked on this book with Prof. Gang Wang.

• 07/11/2016: One paper was accepted to ECCV 2016. I received this message at a szechuan restaurant of Portland. Nice food and good moment!

• 05/18/2016: Bo and Guanhua defended their dissertations successfully. Congratulations! Bo would join tevens Institute of Technology as a Ph.D. student, and Guanhua would join Standard Chartered Group as a research engineer.

• 03/12/2016: Two papers were accepted to ICME 2016, one of which was selected as oral presentation.

• 11/25/2015: Congchao defended his dissertation successfully. Congratulations! He would join the Computational Bioinformatics and Bioimaging Laboratory(CBIL), Virginia Tech as a Ph.D. student.

Service and Activities

Selected Publications

• Xin Liu, Rong Qin, Junchi Yan, Jufeng Yang
  NCMNet: Neighbor consistency mining network for two-view correspondence pruning
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

• Zhicheng Zhang, Song Chen, Zichuan Wang, Jufeng Yang
  PlaneSeg: Building a plug-in for boosting planar region segmentation
  IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
  [Project page]

• Yingjie Zhai, Guoli Jia, Yu-Kun Lai, Jing Zhang, Jufeng Yang, Dacheng Tao
  Looking into gait for perceiving emotions via bilateral posture and movement graph convolutional networks
  IEEE Transactions on Affective Computing (TAFFC)

• Shihao Zhou, Duosheng Chen, Jinshan Pan, Jinglei Shi, Jufeng Yang
  Adapt or perish: Adaptive sparse transformer with attentive feature refinement for image restoration
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Pancheng Zhao, Peng Xu, Pengda Qin, Deng-Ping Fan, Zhicheng Zhang, Guoli Jia, Bowen Zhou, Jufeng Yang
  LAKE-RED: Camouflaged images generation by latent background knowledge retrieval-augmented diffusion
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)
  [Project page]

• Zhicheng Zhang, Junyao Hu, Wentao Cheng, Danda Paudel, Jufeng Yang
  ExtDM: Dual distribution extrapolation diffusion model for video prediction
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Zhicheng Zhang, Pancheng Zhao, Eunil Park, Jufeng Yang
  MART: Masked affective representation learning via masked temporal distribution distillation
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Shihao Zhou, Jinshan Pan, Jinglei Shi, Duosheng Chen, Lishen Qu, Jufeng Yang
  Seeing the unseen: A frequency prompt guided Transformer for image restoration
  European Conference on Computer Vision (ECCV)

• Chenxi Zhao, Jinglei Shi, Liqiang Nie, Jufeng Yang
  To err like human: Affective bias-inspired measures for visual emotion recognition evaluation
  Annual Conference on Neural Information Processing Systems (NeurIPS)

• Wuyou Xia, Shengzhe Liu, Rong Qin, Guoli Jia, Eunil Park, Jufeng Yang
  Perceive before Respond: Improving sticker response selection by emotion distillation and hard mining
  ACM International Conference on Multimedia (MM)

• Tinglei Feng, Yingjie Zhai, Jufeng Yang, Jie Liang, Deng-Ping Fan, Jing Zhang, Ling Shao, Dacheng Tao
  IC9600: A benchmark dataset for automatic image complexity assessment
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 45(7): 8577-8593
  [English version] [中译版] [Project page] [BibTeX]

• Sicheng Zhao, Xiaopeng Hong, Jufeng Yang, Yanyan Zhao, Guiguang Ding
  Towards label-efficient emotion and sentiment analysis
  Proceedings of the IEEE (PIEEE), 111(10): 1159-1197

• Kun Zhang, Jinyi Zhang, Jufeng Yang
  The influence of human elements in photographs on tourists' destination perceptions and intentions
  Tourism Management, 95: Article 104684

• Kun Zhang, Jinyi Zhang, Xiao Shang, Jufeng Yang, Chunlin Li
  Linking UGP’s affective and cognitive concepts together for tourism destination image development
  Current Issues in Tourism

• Xin Liu, Jufeng Yang
  Progressive neighbor consistency mining for correspondence pruning
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Zhicheng Zhang, Lijuan Wang, Jufeng Yang
  Weakly supervised video emotion detection and prediction via cross-modal temporal erasing network
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Tinglei Feng, Jiaxuan Liu, Jufeng Yang
  Probing sentiment-oriented pre-training inspired by human sentiment perception mechanism
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Changsong Wen, Guoli Jia, Jufeng Yang
  DIP: Dual incongruity perceiving network for sarcasm detection
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)

• Zhicheng Zhang, Shengzhe Liu, Jufeng Yang
  Multiple planar object tracking
  International Conference on Computer Vision (ICCV)

• Changsong Wen, Xin Zhang, Xingxu Yao, Jufeng Yang
  Ordinal label distribution learning
  International Conference on Computer Vision (ICCV)

• Sicheng Zhao, Xingxu Yao, Jufeng Yang, Guoli Jia, Guiguang Ding, Tat-Seng Chua, Bjorn W. Schuller, Kurt Keutzer
  Affective image content analysis: Two decades review and new perspectives
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 44(10): 6729-6751
  

• Song Chen, Jing-Hao Xue, Jianlong Chang, Jianzhong Zhang, Jufeng Yang, Qi Tian
  SSL++: Improving self-supervised learning by mitigating the proxy task-specificity problem
  IEEE Transactions on Image Processing (TIP), 31: 1134-1148
  

• Guoli Jia, Jufeng Yang
  S2-VER: Semi-supervised visual emotion recognition
  European Conference on Computer Vision (ECCV), 493-509
  

• Lijuan Wang, Guoli Jia, Ning Jiang, Haiying Wu, Jufeng Yang
  EASE: Robust facial expression recognition via emotion ambiguity-sensitive cooperative networks
  ACM International Conference on Multimedia (MM), 218-227
  

• Zhicheng Zhang, Jufeng Yang
  Temporal sentiment localization: Listen and look in untrimmed videos
  ACM International Conference on Multimedia (MM), 199-208
  

• Shengzhe Liu, Xin Zhang, Jufeng Yang
  SER30K: A large-scale dataset for sticker emotion recognition
  ACM International Conference on Multimedia (MM), 33-41
  

• Sicheng Zhao, Guoli Jia, Jufeng Yang, Guiguang Ding, Kurt Keutzer
  Emotion recognition from multiple modalities: Fundamentals and methodologies
  IEEE Signal Processing Magazine, 38(6): 59-73
  

• Yingjie Zhai, Deng-Ping Fan, Jufeng Yang, Ali Borji, Ling Shao, Junwei Han, Liang Wang
  Bifurcated backbone strategy for RGB-D salient object detection
  IEEE Transactions on Image Processing (TIP), 30: 8727-8742
  

• Xiaoping Wu, Jianlong Chang, Yu-Kun Lai, Jufeng Yang, Qi Tian
  BiSPL: Bidirectional self-paced learning for recognition from web data
  IEEE Transactions on Image Processing (TIP), 30: 6512-6527
  

• Xingxu Yao, Sicheng Zhao, Yu-Kun Lai, Dongyu She, Jie Liang, Jufeng Yang
  APSE: Attention-aware polarity-sensitive embedding for emotion-based image retrieval
  IEEE Transactions on Multimedia (TMM), 23: 4469-4482
  

• Xingxu Yao, Dongyu She, Haiwei Zhang, Jufeng Yang, Ming-Ming Cheng, Liang Wang
  Adaptive deep metric learning for affective image retrieval and classification
  IEEE Transactions on Multimedia (TMM), 23: 1640-1653
  

• Wenya Guo, Ying Zhang, Xiangrui Cai, Lei Meng, Jufeng Yang, Xiaojie Yuan
  LD-MAN: Layout-driven multimodal attention network for online news sentiment recognition
  IEEE Transactions on Multimedia (TMM), 23: 1785-1798
  

• Lijuan Wang, Wenya Guo, Xingxu Yao, Yuxiang Zhang, Jufeng Yang
  Multimodal event-aware network for sentiment analysis in tourism
  IEEE Multimedia, 28(2): 49-58
  

• Xingxu Yao, Sicheng Zhao, Pengfei Xu, Jufeng Yang
  Multi-source domain adaptation for object detection
  IEEE/CVF International Conference on Computer Vision (ICCV), 3253-3262
  

• Jufeng Yang, Jie Liang, Kai Wang, Paul L. Rosin, Ming-Hsuan Yang
  Subspace clustering via good neighbors
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 42(6): 1537-1544
  

• Dongyu She, Jufeng Yang, Ming-Ming Cheng, Yu-Kun Lai, Paul L. Rosin, Liang Wang
  WSCNet: Weakly supervised coupled networks for visual sentiment classification and detection
  IEEE Transactions on Multimedia (TMM), 22(5): 1358-1371
  

• Jufeng Yang, Xiaoping Wu, Jie Liang, Xiaoxiao Sun, Ming-Ming Cheng, Paul L. Rosin, Liang Wang
  Self-paced balance learning for clinical skin disease recognition
  IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 31(8): 2832-2846
  

• Dongyu She, Ming Sun, Jufeng Yang
  Learning discriminative sentiment representation from strongly- and weakly-supervised CNNs
  ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 15(3s): Article No.: 96
  

• Deng-Ping Fan, Yingjie Zhai, Ali Borji, Jufeng Yang, Ling Shao
  BBS-net: RGB-D salient object detection with a bifurcated backbone strategy network
  European Conference on Computer Vision (ECCV)
  

• Sicheng Zhao, Yaxian Li, Xingxu Yao, Weizhi Nie, Pengfei Xu, Jufeng Yang, Kurt Keutzer
  Emotion-Based End-to-End Matching Between Image and Music in Valence-Arousal Space
  ACM International Conference on Multimedia (MM)
  

• Sicheng Zhao, Yunsheng Ma, Yang Gu, Jufeng Yang, Tengfei Xing, Pengfei Xu, Runbo Hu, Hua Chai, Kurt Keutzer
  An End-to-End Visual-Audio Attention Network for Emotion Recognition in User-Generated Videos
  AAAI Conference on Artificial Intelligence (AAAI)
  

• Jie Liang, Jufeng Yang, Ming-Ming Cheng, Paul L. Rosin, Liang Wang
  Simultaneous subspace clustering and cluster number estimating based on triplet relationship
  IEEE Transactions on Image Processing (TIP), 28(8): 3973-3985
  

• Xiaoping Wu, Chi Zhan, Yu-Kun Lai, Ming-Ming Cheng, Jufeng Yang
  IP102: A large-scale benchmark dataset for insect pest recognition
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR oral)
  [Project page] [Dataset (Google Drive)]

• Xiaoping Wu, Ni Wen, Jie Liang, Yu-Kun Lai, Dongyu She, Ming-Ming Cheng, Jufeng Yang
  Joint acne image grading and counting via label distribution learning
  IEEE/CVF International Conference on Computer Vision (ICCV)
  

• Xingxu Yao, Dongyu She, Sicheng Zhao, Jie Liang, Yu-Kun Lai, Jufeng Yang
  Attention-aware polarity sensitive embedding for affective image retrieval
  IEEE/CVF International Conference on Computer Vision (ICCV)
  

• Chi Zhan, Dongyu She, Sicheng Zhao, Ming-Ming Cheng, Jufeng Yang
  Zero-shot emotion recognition via affective structural embedding
  IEEE/CVF International Conference on Computer Vision (ICCV)
  

• Jiaxing Zhao, Jiang-Jiang Liu, Deng-Ping Fan, Yang Cao, Jufeng Yang, Ming-Ming Cheng
  EGNet: Edge guidance network for salient object detection
  IEEE/CVF International Conference on Computer Vision (ICCV)
  

• Xiaoxiao Sun, Liyi Chen, Jufeng Yang
  Learning from web data using adversarial discriminative neural networks for fine-grained classification
  AAAI Conference on Artificial Intelligence (AAAI)
  

• Liyi Chen, Jufeng Yang
  Recognizing the Style of Visual Arts via Adaptive Cross-layer Correlation
  ACM International Conference on Multimedia (MM)
  

• Jufeng Yang, Xiaoxiao Sun, Yu-Kun Lai, Liang Zheng, Ming-Ming Cheng
  Recognition from web data: A progressive filtering approach
  IEEE Transactions on Image Processing (TIP), 27(11): 5303-5315
  

• Jufeng Yang, Jie Liang, Hui Shen, Kai Wang, Paul L. Rosin, Ming-Hsuan Yang
  Dynamic match kernel with deep convolutional features for image retrieval
  IEEE Transactions on Image Processing (TIP), 27(11): 5288-5302
  

• Jufeng Yang, Dongyu She, Ming Sun, Ming-Ming Cheng, Paul L. Rosin, Liang Wang
  Visual sentiment prediction based on automatic discovery of affective regions
  IEEE Transactions on Multimedia (TMM), 20(9): 2513-2525
  

• Jufeng Yang, Dongyu She, Yu-Kun Lai, Paul L. Rosin, Ming-Hsuan Yang
  Weakly supervised coupled networks for visual sentiment analysis
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR spotlight)
  

• Jufeng Yang, Xiaoxiao Sun, Jie Liang, Paul L. Rosin
  Clinical skin lesion diagnosis using representations inspired by dermatologist criteria
  IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR)
  

• Jie Liang, Jufeng Yang, Hsin-Ying Lee, Kai Wang, Ming-Hsuan Yang
  Sub-GAN: An unsupervised generative model via subspaces
  European Conference on Computer Vision (ECCV)
  

• Jufeng Yang, Liyi Chen, Le Zhang, Xiaoxiao Sun, Dongyu She, Shao-Ping Lu, Ming-Ming Cheng
  Historical context-based style classification of painting images via label distribution learning
  ACM International Conference on Multimedia (MM)
  

• Jufeng Yang, Dongyu She, Yu-Kun Lai, Ming-Hsuan Yang
  Retrieving and classifying affective images via deep metric learning
  AAAI Conference on Artificial Intelligence (AAAI)
  

• Jufeng Yang, Jie Liang, Kai Wang, Yong-Liang Yang, Ming-Ming Cheng
  Automatic model selection in subspace clustering via triplet relationships
  AAAI Conference on Artificial Intelligence (AAAI)
  

• Yuxiang Zhang, Jiamei Fu, Dongyu She, Ying Zhang, Senzhang Wang, Jufeng Yang
  Text emotion distribution learning via multi-task convolutional neural network
  International Joint Conference on Artificial Intelligence (IJCAI)
  

• Jiamei Fu, Dongyu She, Xingxu Yao, Yuxiang Zhang, Jufeng Yang
  Deep coordinated textual and visual network for sentiment-oriented cross-modal retrieval
  Pacific Rim International Conferences on Artificial Intelligence (PRICAI)
  

• Congchao Wang, Jufeng Yang, Kai Wang, Shang-Hong Lai
  Multi-scale energy optimization for object proposal generation
  Multimedia Tools and Applications, 76(8): 10481-10499
  

• Jun Chen, Hong Zhao, Jufeng Yang, Jian Zhang, Tao Li, Kai Wang
  An intelligent character recognition method to filter spam images on cloud
  Soft Computing, 21(3): 753-763
  

• Jufeng Yang, Ming Sun, Xiaoxiao Sun
  Learning visual sentiment distributions via augmented conditional probability neural network
  AAAI Conference on Artificial Intelligence (AAAI)
  

• Jufeng Yang, Dongyu She, Ming Sun
  Joint image emotion classification and distribution learning via deep convolutional neural network
  International Joint Conference on Artificial Intelligence (IJCAI)
  

• Xiaoxiao Sun, Jufeng Yang, Ming Sun, Kai Wang
  A benchmark for automatic visual classification of clinical skin disease images
  European Conference on Computer Vision (ECCV)
  

• Ming Sun, Jufeng Yang, Bo Sun, Kai Wang
  Shape-guided segmentation for fine-grained visual categorization
  IEEE International Conference on Multimedia & Expo (ICME oral)
  

• Ming Sun, Jufeng Yang, Kai Wang, Hui Shen
  Discovering affective regions in deep convolutional neural networks for visual sentiment prediction
  IEEE International Conference on Multimedia & Expo (ICME)
  

Current and Former Students

• Zhicheng Zhang

• Xin Zhang

• Pancheng Zhao

• Wuyou Xia

• Duosheng Chen

• Xin Liu

• Shihao Zhou

• Weicheng Wang

• Chenxi Zhao

• Rong Qin

• Congchao Wang (Google, USA)

• Bo Sun (Adobe, USA)

• Shuaipeng Liu (Meituan, China)

• Guanhua Gao (Standard Chartered Group, China)

• Ming Sun (Kuaishou, China)

• Hui Shen (Baidu, China)

• Xiaoxiao Sun (Australian National University, Australia)

• Jie Liang (Hong Kong Polytechnic University, China)

• Dongyu She (Tsinghua University, China)

• Liyi Chen (Nankai University, China)

• Xiaoping Wu (MeiTuan, China)

• Xingxu Yao (DiDi, China)

• Song Chen (Baidu, China)

• Yingjie Zhai (Huawei, China)

• Lijuan Wang (Tencent, China)

• Tinglei Feng (ByteDance, China)

• Shengzhe Liu (Huawei, China)

• Guoli Jia (Tsinghua University, China)

• Changsong Wen (Shanghai Jiao Tong University, China)

• Jiaxuan Liu (Baidu, China)