AttributesValues
type
owl:sameAs
http://swrc.ontowa...ntology#publisher
http://swrc.ontoware.org/ontology#author
http://swrc.ontowa...ontology#keywords
  • mybook texts zipf
http://swrc.ontowa...ontology#abstract
  • Zipf’s law is a fundamental paradigm in the statistics of written and spoken natural language as well as in other communication systems. We raise the question of the elementary units for which Zipf’s law should hold in the most natural way, studying its validity for plain word forms and for the corresponding lemma forms. We analyze several long literary texts comprising four languages, with different levels of morphological complexity. In all cases Zipf’s law is fulfilled, in the sense that a power-law distribution of word or lemma frequencies is valid for several orders of magnitude. We investigate the extent to which the word-lemma transformation preserves two parameters of Zipf’s law: the exponent and the low-frequency cut-off. We are not able to demonstrate a strict invariance of the tail, as for a few texts both exponents deviate significantly, but we conclude that the exponents are very similar, despite the remarkable transformation that going from words to lemmas represents, considerably affecting all ranges of frequencies. In contrast, the low-frequency cut-offs are less stable, tending to increase substantially after the transformation.
http://swrc.ontoware.org/ontology#number
  • 7
http://swrc.ontoware.org/ontology#volume
  • 10
http://swrc.ontoware.org/ontology#month
  • 07
http://swrc.ontoware.org/ontology#pages
  • 1-23
http://swrc.ontoware.org/ontology#title
  • Zipf’s Law for Word Frequencies: Word Forms versus Lemmas in Long Texts
http://swrc.ontoware.org/ontology#date
  • Mon Dec 04 16:45:18 CET 2017
http://swrc.ontoware.org/ontology#year
  • 2015
http://swrc.ontowa.../ontology#journal
  • PLOS ONE
http://swrc.ontowa...ogy#hasExtraField
Alternative Linked Data Views: Sponger | iSPARQL | ODE     Raw Data in: CXML | CSV | RDF ( N-Triples N3/Turtle JSON XML ) | OData ( Atom JSON )    About   
This material is Open Knowledge   W3C Semantic Web Technology [RDF Data] This material is Open Knowledge Creative Commons License Valid XHTML + RDFa
This work is licensed under a Creative Commons Attribution-Share Alike 3.0 Unported License.
OpenLink Virtuoso version 06.01.3127, on Linux (x86_64-pc-linux-gnu), Standard Edition
Copyright © 2009-2011 OpenLink Software