论文题目:基于自适应对比学习的无源域数据域适应方法
作者列表:张子逸†(南京大学)、陈伟凯(腾讯美国)、程卉(中山大学)、李镇(香港中文大学深圳)、李思远(西湖大学)、林倞(中山大学)、李冠彬* (中山大学)
论文摘要:
We investigate a practical domain adaptation task, called source-free domain adaptation (SFUDA), where the source-pretrained model is adapted to the target domain without access to the source data. Existing techniques mainly leverage self-supervised pseudo labeling to achieve class-wise global alignment [1] or rely on local structure extraction that encourages feature consistency among neighborhoods [2]. While impressive progress has been made, both lines of methods have their own drawbacks - the "global" approach is sensitive to noisy labels while the "local" counterpart suffers from source bias. In this paper, we present Divide and Contrast (DaC), a new paradigm for SFUDA that strives to connect the good ends of both worlds while bypassing their limitations. Based on the prediction confidence of the source model, DaC divides the target data into source-like and target-specific samples, where either group of samples is treated with tailored goals under an adaptive contrastive learning framework. Specifically, the source-like samples are utilized for learning global class clustering thanks to their relatively clean labels. The more noisy target-specific data are harnessed at the instance level for learning the intrinsic local structures. We further align the source-like domain with the target-specific samples using a memory bank-based Maximum Mean Discrepancy (MMD) loss to reduce the distribution mismatch. Extensive experiments on VisDA, Office-Home, and the more challenging DomainNet have verified the superior performance of DaC over current state-of-the-art approaches.
论文信息:
[1] Z. Zhang, W. Chen, H. Cheng, M. Mao, L. Lin, and G. Li. Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution. In NeurIPS, 2022.
论文链接:
https://arxiv.org/abs/2211.06612
代码链接:
https://github.com/ZyeZhang/DaC.git.