Creates a serialized object of tokens, called by tokens
.
tokens_serialize(x, types_reserved = NULL, ...)
x | a list of character vectors |
---|---|
types_reserved | optional pre-existing types for mapping of tokens |
... | additional arguments |
a list the serialized tokens found in each text