Creates a serialized object of tokens, called by tokens()
.
serialize_tokens(x, types_reserved = NULL, ...)
x | a list of character vectors |
---|---|
types_reserved | optional pre-existing types for mapping of tokens |
... | additional arguments |
a list the serialized tokens found in each text