LAUSR.org creates dashboard-style pages of related content for over 1.5 million academic articles. Sign Up to like articles & get recommendations!

Constraining pseudo‐label in self‐training unsupervised domain adaptation with energy‐based model

Photo by homajob from unsplash

Deep learning is usually data starved, and the unsupervised domain adaptation (UDA) is developed to introduce the knowledge in the labeled source domain to the unlabeled target domain. Recently, deep… Click to show full abstract

Deep learning is usually data starved, and the unsupervised domain adaptation (UDA) is developed to introduce the knowledge in the labeled source domain to the unlabeled target domain. Recently, deep self‐training presents a powerful means for UDA, involving an iterative process of predicting the target domain and then taking the confident predictions as hard pseudo‐labels for retraining. However, the pseudo‐labels are usually unreliable, thus easily leading to deviated solutions with propagated errors. In this paper, we resort to the energy‐based model and constrain the training of the unlabeled target sample with an energy function minimization objective. It can be achieved via a simple additional regularization or an energy‐based loss. This framework allows us to gain the benefits of the energy‐based model, while retaining strong discriminative performance following a plug‐and‐play fashion. The convergence property and its connection with classification expectation minimization are investigated. We deliver extensive experiments on the most popular and large‐scale UDA benchmarks of image classification as well as semantic segmentation to demonstrate its generality and effectiveness.

Keywords: training; energy; energy based; domain; based model

Journal Title: International Journal of Intelligent Systems
Year Published: 2022

Link to full text (if available)


Share on Social Media:                               Sign Up to like & get
recommendations!

Related content

More Information              News              Social Media              Video              Recommended



                Click one of the above tabs to view related content.