Other Open Access

LIFCACH 2.0: Word Frequency List of Chilean Spanish (Lista de Frecuencias de Palabras del Castellano de Chile), version 2.0

Sadowsky, Scott; Martínez-Gamboa, Ricardo


DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-3" xsi:schemaLocation="http://datacite.org/schema/kernel-3 http://schema.datacite.org/meta/kernel-3/metadata.xsd">
  <identifier identifierType="DOI">10.5281/zenodo.268043</identifier>
  <creators>
    <creator>
      <creatorName>Sadowsky, Scott</creatorName>
      <affiliation>Pontificia Universidad Católica de Chile</affiliation>
    </creator>
    <creator>
      <creatorName>Martínez-Gamboa, Ricardo</creatorName>
      <affiliation>Universidad de Chile</affiliation>
    </creator>
  </creators>
  <titles>
    <title>Lifcach 2.0: Word Frequency List Of Chilean Spanish (Lista De Frecuencias De Palabras Del Castellano De Chile), Version 2.0</title>
  </titles>
  <publisher>Zenodo</publisher>
  <publicationYear>2012</publicationYear>
  <subjects>
    <subject>Frequency list</subject>
    <subject>Spanish</subject>
    <subject>Chilean Spanish</subject>
    <subject>Corpus</subject>
    <subject>Lexical frequency</subject>
  </subjects>
  <dates>
    <date dateType="Issued">2012-08-01</date>
  </dates>
  <resourceType resourceTypeGeneral="Text">Other</resourceType>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/268043</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsIdenticalTo">http://sadowsky.cl/lifcach.html</relatedIdentifier>
  </relatedIdentifiers>
  <rightsList>
    <rights rightsURI="https://creativecommons.org/licenses/by-nc/4.0/">Creative Commons Attribution-NonCommercial 4.0</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">&lt;p&gt;&lt;strong&gt;LIFCACH 2.0&lt;br&gt;
Word Frequency List of Chilean Spanish (Lista de Frecuencias de Palabras del Castellano de Chile), version 2.0&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;More information, as well as the Spanish version of this document, is available in the included README file.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;1. Description&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The Word Frequency List of Chilean Spanish (LIFCACH) is a set of 102 frequency lists derived from the sub-corpora of the &lt;em&gt;Corpus Dinámico del Castellano de Chile&lt;/em&gt; (Dynamic Corpus of Chilean Spanish, CODICACH), a database of contemporary written&lt;sup&gt;1&lt;/sup&gt; Chilean Spanish developed by Sadowsky between 1997 and 2002; this corpus contained approximately 450 million words when the LIFCACH was created&lt;sup&gt;2&lt;/sup&gt;. The LIFCACH also contains a non-weighted list of total frequencies (the &lt;em&gt;Total Occurrences&lt;/em&gt; column), which is the sum of the frequencies of the 102 individual lists (in other words, the list of frequencies of the entire CODICACH corpus.)&lt;/p&gt;

&lt;p&gt;The CODICACH is an opportunistic corpus with a bias toward press-based sources; it does not seek to be a BNC-style representative sampling of the overall written language. The modular nature of the CODICACH and of the 102 individual LIFCACH lists, however, allows researchers to use one or more of these lists alone, to combine them as needed, or to create their own frequency lists for Chilean Spanish by weighting each of the LIFCACH’s individual lists as they see fit.&lt;/p&gt;

&lt;p&gt;The LIFCACH 2.0 contains 476,776 lemmas&lt;sup&gt;3&lt;/sup&gt; derived from the approximately 4.5 million types found in the 450 million running words contained in the CODICACH at the time the lists were created.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Creation of the LIFCACH&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The steps in creating the LIFCACH were as follows:&lt;/p&gt;

&lt;ol&gt;
	&lt;li&gt;
	&lt;p&gt;Type frequency lists based on the running words of each of the 102 sub-corpora of the CODICACH were generated.&lt;/p&gt;
	&lt;/li&gt;
	&lt;li&gt;
	&lt;p&gt;Each type frequency list was lemmatized and POS-tagged using the Universitat Politecnica de Catalunya’s MS-Tools v2.0&lt;sup&gt;4&lt;/sup&gt;.&lt;/p&gt;
	&lt;/li&gt;
	&lt;li&gt;
	&lt;p&gt;Lemmas with a frequency of 1 were removed (approximately 300,000) in the case of the …No-Hapax.xlsx version. Eliminating these was considered an acceptable trade-off in exchange for a far more manageable file size.&lt;/p&gt;
	&lt;/li&gt;
	&lt;li&gt;
	&lt;p&gt;The resulting lemma frequency lists were assembled and total occurrences were calculated.&lt;/p&gt;
	&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;An important caveat regarding this methodology must be mentioned. The use of type frequency lists instead of running words in the POS tagging and lemmatizing process was a practical necessity, due to the speed of the software used and the computing resources available at the time the LIFCACH was created. However, this reduced the accuracy of the lemmatization process by eliminating context. As a result, the software had to analyze words such as &lt;em&gt;canto&lt;/em&gt; without the information required to decide if a given instance of this word is a form of the verb &lt;em&gt;cantar&lt;/em&gt; or the noun &lt;em&gt;canto&lt;/em&gt;.&lt;/p&gt;

&lt;p&gt;It should also be noted that the lemmatizing and tagging software that was used is based on European Spanish, a national dialect that is rather removed from Chilean Spanish.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Part of Speech Categories&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The following are the POS codes used in the frequency lists:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;AJ = Adjective&lt;/li&gt;
	&lt;li&gt;AV = Adverb&lt;/li&gt;
	&lt;li&gt;C = Conjunction&lt;/li&gt;
	&lt;li&gt;D = Determiner&lt;/li&gt;
	&lt;li&gt;I = Interjection&lt;/li&gt;
	&lt;li&gt;N = Noun, Common&lt;/li&gt;
	&lt;li&gt;NG = Noun, Geographic (Toponym)&lt;/li&gt;
	&lt;li&gt;NP = Noun, Proper&lt;/li&gt;
	&lt;li&gt;PN = Pronoun&lt;/li&gt;
	&lt;li&gt;PP = Preposition&lt;/li&gt;
	&lt;li&gt;SG = Abbreviation&lt;/li&gt;
	&lt;li&gt;V = Verb&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;4. List of Sources&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Each frequency list in the LIFCACH is derived from a different sub-corpus of the CODICACH. The codes used for these lists are as follows:&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;ACAD_CCAA = Academic Texts - Applied Sciences&lt;/li&gt;
	&lt;li&gt;ACAD_CCNN = Academic Texts - Natural Sciences&lt;/li&gt;
	&lt;li&gt;ACAD_CCSS = Academic Texts - Social Sciences&lt;/li&gt;
	&lt;li&gt;ACAD_Hum = Academic Texts - Humanities&lt;/li&gt;
	&lt;li&gt;DIAR_CEN_Estrella_Valpo = Newspaper – Central Chile – Estrella de Valparaíso&lt;/li&gt;
	&lt;li&gt;DIAR_CEN_Gran_Valpo = Newspaper – Central Chile – Gran Valparaíso&lt;/li&gt;
	&lt;li&gt;DIAR_CEN_Lider_San_Antonio = Newspaper – Central Chile – El Líder, San Antonio&lt;/li&gt;
	&lt;li&gt;DIAR_CEN_Mercurio_Valpo = Newspaper – Central Chile – El Mercurio, Valparaíso&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Estrella_Arica = Newspaper – North Chile – La Estrella, Arica&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Estrella_Iquique = Newspaper – North Chile – La Estrella, Iquique&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Estrella_Loa = Newspaper – North Chile – La Estrella, Loa&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Estrella_Norte_Antofagasta = Newspaper – North Chile – La Estrella, Antofagasta&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Mercurio_Antofagasta = Newspaper – North Chile – El Mercurio, Antofagasta&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Mercurio_Calama = Newspaper – North Chile – El Mercurio, Calama&lt;/li&gt;
	&lt;li&gt;DIAR_NOR_Nortino_Iquique = Newspaper – North Chile – El Nortino, Iquique&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Cuarta = Newspaper – Santiago – La Cuarta&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Estrategia = Newspaper – Santiago – Estrategia&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Firme = Newspaper – Santiago – La Firme&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Mercurio = Newspaper – Santiago – El Mercurio&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Metropolitano = Newspaper – Santiago – El Metropolitano&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Mostrador = Newspaper – Santiago – El Mostrador&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Primera_Linea = Newspaper – Santiago – Primera Línea&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Primera_Pagina-El_Area = Newspaper – Santiago – Primera Página / El Área&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Segunda = Newspaper – Santiago – La Segunda&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Tercera = Newspaper – Santiago – La Tercera&lt;/li&gt;
	&lt;li&gt;DIAR_SAN_Ultimas_Noticias = Newspaper – Santiago – Las Últimas Noticias&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Austral_Osorno = Newspaper – South Chile – Austral, Osorno&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Austral_Temuco = Newspaper – South Chile – Austral, Temuco&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Austral_Valdivia = Newspaper – South Chile – Austral, Valdivia&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Cronica = Newspaper – South Chile – Crónica&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_El_Sur = Newspaper – South Chile – El Sur&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Enc_BioBio = Newspaper – South Chile – Enciclop. Bío-Bío&lt;/li&gt;
	&lt;li&gt;DIAR_SUR_Llanquihue_Pto_Montt = Newspaper – South Chile – El Llanquihue, Pto. Montt&lt;/li&gt;
	&lt;li&gt;ESPER_CartasDirector = Personal Writings – Letters to Editor&lt;/li&gt;
	&lt;li&gt;ESPER_ForosInet = Personal Writings – Internet Site Forums&lt;/li&gt;
	&lt;li&gt;ESPER_Clasificados = Personal Writings – Classified Ads&lt;/li&gt;
	&lt;li&gt;ESPER_ForosMedios = Personal Writings – Media Forums&lt;/li&gt;
	&lt;li&gt;ESPER_Usenet = Personal Writings – Usenet&lt;/li&gt;
	&lt;li&gt;LEX_Jurisprudencia = Legal – Jurisprudence&lt;/li&gt;
	&lt;li&gt;LEX_Leyes = Legal – Laws&lt;/li&gt;
	&lt;li&gt;LEX_Libros = Legal – Law Books&lt;/li&gt;
	&lt;li&gt;LEX_Misc = Legal – Miscellaneous&lt;/li&gt;
	&lt;li&gt;LIBR_Ficcion = Books – Fiction&lt;/li&gt;
	&lt;li&gt;LIBR_NoFiccion = Books – Non-Fiction&lt;/li&gt;
	&lt;li&gt;OBRC_CandiaCares_DicoCoa = Reference Works – Dictionary of Coa&lt;/li&gt;
	&lt;li&gt;OBRC_GonzalezParra_ManualProvrb = Reference Works – Book of Chilean Proverbs&lt;/li&gt;
	&lt;li&gt;ORAL_Entrevistas_Lgtcas = Oral – Linguistic Interviews&lt;/li&gt;
	&lt;li&gt;ORAL_TV = Oral – Television&lt;/li&gt;
	&lt;li&gt;PUB_Misc = Advertising – General 1&lt;/li&gt;
	&lt;li&gt;PUB_Publicidad = Advertising – General 2&lt;/li&gt;
	&lt;li&gt;REV_CMP_ChileTech = Magazine – Computers – ChileTech&lt;/li&gt;
	&lt;li&gt;REV_CMP_CompuChile = Magazine – Computers – CompuChile&lt;/li&gt;
	&lt;li&gt;REV_CMP_ComputerWorld = Magazine – Computers – ComputerWorld&lt;/li&gt;
	&lt;li&gt;REV_CMP_Informatica = Magazine – Computers – Informática&lt;/li&gt;
	&lt;li&gt;REV_CMP_Infoweek = Magazine – Computers – Infoweek&lt;/li&gt;
	&lt;li&gt;REV_CMP_Internet21 = Magazine – Computers – Internet21&lt;/li&gt;
	&lt;li&gt;REV_CMP_Mouse = Magazine – Computers – Mouse&lt;/li&gt;
	&lt;li&gt;REV_DEP_All = Magazine – Sports&lt;/li&gt;
	&lt;li&gt;REV_ESP_Capital = Magazine – Specialty – Capital&lt;/li&gt;
	&lt;li&gt;REV_ESP_CiudadArquitectura = Magazine – Specialty – CiudadArquitectura&lt;/li&gt;
	&lt;li&gt;REV_ESP_Conicyt = Magazine – Specialty – Conicyt Scientific&lt;/li&gt;
	&lt;li&gt;REV_ESP_CopropInmob = Magazine – Specialty – Copropiedad Inmobiliaria&lt;/li&gt;
	&lt;li&gt;REV_ESP_DiarioSocCivil = Magazine – Specialty – Diario de la Sociedad Civil&lt;/li&gt;
	&lt;li&gt;REV_ESP_Educar = Magazine – Specialty – Educar&lt;/li&gt;
	&lt;li&gt;REV_ESP_LemuChile = Magazine – Specialty – LemuChile&lt;/li&gt;
	&lt;li&gt;REV_ESP_Lignum = Magazine – Specialty – Lignum&lt;/li&gt;
	&lt;li&gt;REV_ESP_Mensaje = Magazine – Specialty – Mensaje&lt;/li&gt;
	&lt;li&gt;REV_ESP_Notas_CESAF = Magazine – Specialty – Notas CESAF&lt;/li&gt;
	&lt;li&gt;REV_ESP_Publimark = Magazine – Specialty – Publimark&lt;/li&gt;
	&lt;li&gt;REV_ESP_Rev_Inf_Musical = Magazine – Specialty – Revista Musical&lt;/li&gt;
	&lt;li&gt;REV_ESP_Rev_Scielo = Magazine – Specialty – Scielo Scientific&lt;/li&gt;
	&lt;li&gt;REV_ESP_Rev_Social = Magazine – Specialty – Revista Social&lt;/li&gt;
	&lt;li&gt;REV_ESP_Rev_Trabajo_Social = Magazine – Specialty – Revista de Trabajo Social&lt;/li&gt;
	&lt;li&gt;REV_ESP_RevChil_Cirujia = Magazine – Specialty – Revista Chilena de Cirujía&lt;/li&gt;
	&lt;li&gt;REV_ESP_Revistas_Industriales = Magazine – Specialty – Industrial Magazines&lt;/li&gt;
	&lt;li&gt;REV_ESP_Sidhartha = Magazine – Specialty – Siddhartha&lt;/li&gt;
	&lt;li&gt;REV_GEN_Asuntos_Publicos = Magazine – General – Asuntos Públicos&lt;/li&gt;
	&lt;li&gt;REV_GEN_Cosas = Magazine – General – Cosas&lt;/li&gt;
	&lt;li&gt;REV_GEN_Cultura_Urbana = Magazine – General – Cultura Urbana&lt;/li&gt;
	&lt;li&gt;REV_GEN_El_Siglo = Magazine – General – El Siglo&lt;/li&gt;
	&lt;li&gt;REV_GEN_Ercilla = Magazine – General – Ercilla&lt;/li&gt;
	&lt;li&gt;REV_GEN_Hacer_Familia = Magazine – General – Hacer Familia&lt;/li&gt;
	&lt;li&gt;REV_GEN_Man = Magazine – General – Man&lt;/li&gt;
	&lt;li&gt;REV_GEN_Mujer_a_mujer = Magazine – General – Mujer a mujer&lt;/li&gt;
	&lt;li&gt;REV_GEN_Nos = Magazine – General – Nos&lt;/li&gt;
	&lt;li&gt;REV_GEN_Puerto_Paralelo = Magazine – General – Puerto Paralelo&lt;/li&gt;
	&lt;li&gt;REV_GEN_Punto_Final = Magazine – General – Punto Final&lt;/li&gt;
	&lt;li&gt;REV_GEN_Que_Pasa = Magazine – General – Qué Pasa&lt;/li&gt;
	&lt;li&gt;REV_GEN_Revista_ED = Magazine – General – Revista ED&lt;/li&gt;
	&lt;li&gt;REV_GEN_Rocinante = Magazine – General – Rocinante&lt;/li&gt;
	&lt;li&gt;REV_INF_Dirigible = Magazine – Children’s – Dirigible&lt;/li&gt;
	&lt;li&gt;REV_INF_Icarito = Magazine – Children’s – Icarito&lt;/li&gt;
	&lt;li&gt;REV_INF_Papas_Fritas = Magazine – Children’s – Papas Fritas&lt;/li&gt;
	&lt;li&gt;REV_INF_Volare = Magazine – Children’s – Volare&lt;/li&gt;
	&lt;li&gt;REV_JUV_All = Magazines – Youth&lt;/li&gt;
	&lt;li&gt;REV_LOC_All = Magazines – Local&lt;/li&gt;
	&lt;li&gt;RVDI_ECN_Diario_PyME = Financial Mags &amp;amp; Newspapers – Diario PyME&lt;/li&gt;
	&lt;li&gt;RVDI_ECN_El_Diario = Financial Mags &amp;amp; Newspapers – El Diario&lt;/li&gt;
	&lt;li&gt;RVDI_ECN_Emprendedores = Financial Mags &amp;amp; Newspapers – Emprendedores&lt;/li&gt;
	&lt;li&gt;RVDI_ECN_Negocios_Ambientales = Financial Mags &amp;amp; Newspapers – Negoc. Ambientales&lt;/li&gt;
	&lt;li&gt;SIT_INS_All = Government Sites 1&lt;/li&gt;
	&lt;li&gt;SIT_INS_Old = Government Sites 2&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;NOTES&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;sup&gt;1&lt;/sup&gt; Although the CODICACH does contain two oral corpora, &lt;em&gt;ORAL_Entrevistas_Lgtcas&lt;/em&gt; and &lt;em&gt;ORAL_TV&lt;/em&gt;, these are of such negligible size that the CODICACH must be considered a corpus of written Spanish.&lt;/p&gt;

&lt;p&gt;&lt;sup&gt;2&lt;/sup&gt; The CODICACH currently contains approximately 850 million words.&lt;/p&gt;

&lt;p&gt;&lt;sup&gt;3&lt;/sup&gt; This is the number of non-hapax lemmas. The total number of lemmas in the LIFCACH, including hapax legomena, is 844,370.&lt;/p&gt;

&lt;p&gt;&lt;sup&gt;4&lt;/sup&gt; MS-Tools was the predecessor of FreeLing.&lt;/p&gt;

&lt;p&gt; &lt;/p&gt;</description>
  </descriptions>
</resource>

Share

Cite as