Word-length entropies and correlations of natural language written texts

M. Kalimeri, V. Constantoudis, C. Papadimitriou, K. Karamanos, F. K. Diakonos, H. Papageorgiou

    Research output: Contribution to journalArticleScientificpeer-review

    18 Citations (Scopus)

    Abstract

    We study the frequency distributions and correlations of the word lengths of 10 European languages. Our findings indicate that (a) the word-length distribution of short words quantified by the mean value and the entropy distinguishes the Uralic (Finnish) corpus from the others, (b) the tails at long words, manifested in the high-order moments of the distributions, differentiate the Germanic languages (except for English) from the Romanic languages and Greek and (c) the correlations between nearby word lengths measured by the comparison of the real entropies with those of the shuffled texts are found to be smaller in the case of Germanic and Finnish languages.

    Original languageEnglish
    Pages (from-to)101-118
    Number of pages18
    JournalJournal of Quantitative Linguistics
    Volume22
    Issue number2
    DOIs
    Publication statusPublished - 3 Apr 2015
    Publication typeA1 Journal article-refereed

    Publication forum classification

    • Publication forum level 1

    ASJC Scopus subject areas

    • Language and Linguistics
    • Linguistics and Language

    Fingerprint

    Dive into the research topics of 'Word-length entropies and correlations of natural language written texts'. Together they form a unique fingerprint.

    Cite this