Entropy analysis of word-length series of natural language texts: Effects of text language and genre

Maria Kalimeri; Vassilios Constantoudis; Constantinos Papadimitriou; Konstantinos Karamanos; Fotis K. Diakonos; Haris Papageorgiou

doi:10.1142/S0218127412502239

Entropy analysis of word-length series of natural language texts: Effects of text language and genre

Maria Kalimeri, Vassilios Constantoudis, Constantinos Papadimitriou, Konstantinos Karamanos, Fotis K. Diakonos, Haris Papageorgiou

Research output: Contribution to journal › Article › Scientific › peer-review

14 Citations (Scopus)

Abstract

We estimate the n-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated n-gram entropies.

Original language	English
Article number	1250223
Journal	INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS
Volume	22
Issue number	9
DOIs	https://doi.org/10.1142/S0218127412502239
Publication status	Published - Sept 2012
Publication type	A1 Journal article-refereed

Keywords

N-gram entropies
Quantitative linguistics
Symbolic dynamics
Time series
Word-length representation

ASJC Scopus subject areas

Applied Mathematics
General
Engineering(all)
Modelling and Simulation

Access to Document

10.1142/S0218127412502239

Cite this

@article{91a16a3ded604d818101bc3582625dc3,

title = "Entropy analysis of word-length series of natural language texts: Effects of text language and genre",

abstract = "We estimate the n-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated n-gram entropies.",

keywords = "N-gram entropies, Quantitative linguistics, Symbolic dynamics, Time series, Word-length representation",

author = "Maria Kalimeri and Vassilios Constantoudis and Constantinos Papadimitriou and Konstantinos Karamanos and Diakonos, {Fotis K.} and Haris Papageorgiou",

note = "EXT={"}Kalimeri, Maria{"}",

year = "2012",

month = sep,

doi = "10.1142/S0218127412502239",

language = "English",

volume = "22",

journal = "INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS",

issn = "0218-1274",

publisher = "World Scientific Publishing",

number = "9",

}

TY - JOUR

T1 - Entropy analysis of word-length series of natural language texts

T2 - Effects of text language and genre

AU - Kalimeri, Maria

AU - Constantoudis, Vassilios

AU - Papadimitriou, Constantinos

AU - Karamanos, Konstantinos

AU - Diakonos, Fotis K.

AU - Papageorgiou, Haris

N1 - EXT="Kalimeri, Maria"

PY - 2012/9

Y1 - 2012/9

N2 - We estimate the n-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated n-gram entropies.

AB - We estimate the n-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated n-gram entropies.

KW - N-gram entropies

KW - Quantitative linguistics

KW - Symbolic dynamics

KW - Time series

KW - Word-length representation

UR - http://www.scopus.com/inward/record.url?scp=84867518276&partnerID=8YFLogxK

U2 - 10.1142/S0218127412502239

DO - 10.1142/S0218127412502239

M3 - Article

AN - SCOPUS:84867518276

SN - 0218-1274

VL - 22

JO - INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS

JF - INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS

IS - 9

M1 - 1250223

ER -

Entropy analysis of word-length series of natural language texts: Effects of text language and genre

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this