A data-centric review of deep transfer learning with applications to text data

Research output: Contribution to journalArticleScientificpeer-review

28 Downloads (Pure)

Abstract

In recent years, many applications are using various forms of deep learning models. Such methods are usually based on traditional learning paradigms requiring the consistency of properties among the feature spaces of the training and test data and also the availability of large amounts of training data, e.g., for performing supervised learning tasks. However, many real-world data do not adhere to such assumptions. In such situations transfer learning can provide feasible solutions, e.g., by simultaneously learning from data-rich source data and data-sparse target data to transfer information for learning a target task. In this paper, we survey deep transfer learning models with a focus on applications to text data. First, we review the terminology used in the literature and introduce a new nomenclature allowing the unequivocal description of a transfer learning model. Second, we introduce a visual taxonomy of deep learning approaches that provides a systematic structure to the many diverse models introduced until now. Furthermore, we provide comprehensive information about text data that have been used for studying such models because only by the application of methods to data, performance measures can be estimated and models assessed.

Original languageEnglish
Pages (from-to)498-528
Number of pages31
JournalInformation Sciences
Volume585
Early online date27 Nov 2021
DOIs
Publication statusPublished - Mar 2022
Publication typeA1 Journal article-refereed

Keywords

  • Deep learning
  • Domain adaptation
  • Machine learning
  • Natural language processing
  • Transfer learning

Publication forum classification

  • Publication forum level 2

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'A data-centric review of deep transfer learning with applications to text data'. Together they form a unique fingerprint.

Cite this