tokens_xptr is a external pointer-based tokens object designed to process a large corpus efficiently.

is.tokens_xptr(x)

as.tokens_xptr(x)

# S3 method for tokens
as.tokens_xptr(x)

# S3 method for tokens_xptr
as.tokens_xptr(x)

Arguments

x

a tokens object to convert or a tokens_xptr object to deep copy.