indices slot

The "" is assigned a regular index in unigrams[7], which is not how the tokens() constructor would treat this special element. big777 slot The token "life" is the last indexed token in unigrams (index 160) but this index position is dropped when the tokens object is reprocessed, for instance by dfm(), which means that there is no corresponding index for 160