corpus_reshape.Rd
For a corpus, reshape (or recast) the documents to a different level of aggregation. Units of aggregation can be defined as documents, paragraphs, or sentences. Because the corpus object records its current "units" status, it is possible to move from recast units back to original units, for example from documents, to sentences, and then back to documents (possibly after modifying the sentences).
corpus_reshape(x, to = c("sentences", "paragraphs", "documents"), use_docvars = TRUE, ...)
x | corpus whose document units will be reshaped |
---|---|
to | new document units in which the corpus will be recast |
use_docvars | if |
... | additional arguments passed to |
A corpus object with the documents defined as the new units, including document-level meta-data identifying the original documents.
# simple example corp1 <- corpus(c(textone = "This is a sentence. Another sentence. Yet another.", textwo = "Premiere phrase. Deuxieme phrase."), docvars = data.frame(country=c("UK", "USA"), year=c(1990, 2000)), metacorpus = list(notes = "Example showing how corpus_reshape() works.")) summary(corp1)#> Corpus consisting of 2 documents: #> #> Text Types Tokens Sentences country year #> textone 8 11 3 UK 1990 #> textwo 4 6 2 USA 2000 #> #> Source: /Users/stefan/GitHub/quanteda/docs/reference/* on x86_64 by stefan #> Created: Mon Jan 28 14:03:10 2019 #> Notes: Example showing how corpus_reshape() works.#> Corpus consisting of 5 documents: #> #> Text Types Tokens Sentences _document _docid _segid country year #> textone.1 5 5 1 textone 1 1 UK 1990 #> textone.2 3 3 1 textone 1 2 UK 1990 #> textone.3 3 3 1 textone 1 3 UK 1990 #> textwo.1 3 3 1 textwo 2 1 USA 2000 #> textwo.2 3 3 1 textwo 2 2 USA 2000 #> #> Source: /Users/stefan/GitHub/quanteda/docs/reference/* on x86_64 by stefan #> Created: Mon Jan 28 14:03:10 2019 #> Notes: corpus_reshape.corpus(corp1, to = "sentences")#> Corpus consisting of 4 documents and 3 docvars.corp2para <- corpus_reshape(corp2, to = "paragraphs") corp2para#> Corpus consisting of 138 documents and 3 docvars.#> Corpus consisting of 138 documents, showing 50 documents: #> #> Text Types Tokens Sentences _document _docid _segid Year President #> 2005-Bush.1 773 2319 100 2005-Bush 1 1 2005 Bush #> 2009-Obama.1 4 4 1 2009-Obama 2 1 2009 Obama #> 2009-Obama.2 42 53 2 2009-Obama 2 2 2009 Obama #> 2009-Obama.3 62 86 4 2009-Obama 2 3 2009 Obama #> 2009-Obama.4 12 15 2 2009-Obama 2 4 2009 Obama #> 2009-Obama.5 76 108 5 2009-Obama 2 5 2009 Obama #> 2009-Obama.6 39 47 2 2009-Obama 2 6 2009 Obama #> 2009-Obama.7 36 47 4 2009-Obama 2 7 2009 Obama #> 2009-Obama.8 19 22 1 2009-Obama 2 8 2009 Obama #> 2009-Obama.9 29 33 1 2009-Obama 2 9 2009 Obama #> 2009-Obama.10 56 82 2 2009-Obama 2 10 2009 Obama #> 2009-Obama.11 71 106 5 2009-Obama 2 11 2009 Obama #> 2009-Obama.12 21 21 1 2009-Obama 2 12 2009 Obama #> 2009-Obama.13 20 24 1 2009-Obama 2 13 2009 Obama #> 2009-Obama.14 17 20 1 2009-Obama 2 14 2009 Obama #> 2009-Obama.15 43 51 2 2009-Obama 2 15 2009 Obama #> 2009-Obama.16 73 108 7 2009-Obama 2 16 2009 Obama #> 2009-Obama.17 85 144 8 2009-Obama 2 17 2009 Obama #> 2009-Obama.18 52 62 3 2009-Obama 2 18 2009 Obama #> 2009-Obama.19 97 150 5 2009-Obama 2 19 2009 Obama #> 2009-Obama.20 76 117 3 2009-Obama 2 20 2009 Obama #> 2009-Obama.21 90 137 4 2009-Obama 2 21 2009 Obama #> 2009-Obama.22 60 83 3 2009-Obama 2 22 2009 Obama #> 2009-Obama.23 92 142 5 2009-Obama 2 23 2009 Obama #> 2009-Obama.24 82 126 3 2009-Obama 2 24 2009 Obama #> 2009-Obama.25 65 103 3 2009-Obama 2 25 2009 Obama #> 2009-Obama.26 63 84 3 2009-Obama 2 26 2009 Obama #> 2009-Obama.27 81 115 4 2009-Obama 2 27 2009 Obama #> 2009-Obama.28 69 96 3 2009-Obama 2 28 2009 Obama #> 2009-Obama.29 95 158 7 2009-Obama 2 29 2009 Obama #> 2009-Obama.30 9 10 1 2009-Obama 2 30 2009 Obama #> 2009-Obama.31 20 22 1 2009-Obama 2 31 2009 Obama #> 2009-Obama.32 53 65 1 2009-Obama 2 32 2009 Obama #> 2009-Obama.33 67 95 6 2009-Obama 2 33 2009 Obama #> 2009-Obama.34 34 53 1 2009-Obama 2 34 2009 Obama #> 2009-Obama.35 75 106 4 2009-Obama 2 35 2009 Obama #> 2009-Obama.36 11 16 3 2009-Obama 2 36 2009 Obama #> 2013-Obama.1 20 23 1 2013-Obama 3 1 2013 Obama #> 2013-Obama.2 56 82 4 2013-Obama 3 2 2013 Obama #> 2013-Obama.3 33 41 1 2013-Obama 3 3 2013 Obama #> 2013-Obama.4 76 111 4 2013-Obama 3 4 2013 Obama #> 2013-Obama.5 10 10 1 2013-Obama 3 5 2013 Obama #> 2013-Obama.6 34 42 2 2013-Obama 3 6 2013 Obama #> 2013-Obama.7 22 26 1 2013-Obama 3 7 2013 Obama #> 2013-Obama.8 21 21 1 2013-Obama 3 8 2013 Obama #> 2013-Obama.9 23 24 1 2013-Obama 3 9 2013 Obama #> 2013-Obama.10 44 54 2 2013-Obama 3 10 2013 Obama #> 2013-Obama.11 89 130 4 2013-Obama 3 11 2013 Obama #> 2013-Obama.12 68 93 5 2013-Obama 3 12 2013 Obama #> 2013-Obama.13 90 131 4 2013-Obama 3 13 2013 Obama #> FirstName #> George W. #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> Barack #> #> Source: Gerhard Peters and John T. Woolley. The American Presidency Project. #> Created: Mon Jan 28 14:03:11 2019 #> Notes: corpus_reshape.corpus(corp2, to = "paragraphs")## Note that Bush 2005 is recorded as a single paragraph because that text ## used a single \n to mark the end of a paragraph.