One-hot encode a text into a list of word indexes in a vocabulary of size n.
One-hot encode a text into a list of word indexes in a vocabulary of size n.
text_one_hot(text, n, filters = "!\"#$%&()*+,-./:;<=>?@[\\]^_`{|}~\t\n",
lower = TRUE, split = " ")Arguments
| text | Input text (string). |
| n | Size of vocabulary (integer) |
| filters | Sequence of characters to filter out such as punctuation. Default includes basic punctuation, tabs, and newlines. |
| lower | Whether to convert the input to lowercase. |
| split | Sentence split marker (string). |
Value
List of integers in [1, n]. Each integer encodes a word (unicity
non-guaranteed).
See also
Other text preprocessing: make_sampling_table,
pad_sequences, skipgrams,
text_hashing_trick,
text_to_word_sequence