|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|

Public Attributes | |
| int | prev |
| int | next |
| size_t | off |
| size_t | n |
Definition at line 139 of file spm_tokenizer.h.
| size_t ember::SpmTokenizer::Symbol::n |
Definition at line 141 of file spm_tokenizer.h.
Referenced by ember::SpmTokenizer::encode_fragment().
| int ember::SpmTokenizer::Symbol::next |
Definition at line 140 of file spm_tokenizer.h.
| size_t ember::SpmTokenizer::Symbol::off |
Definition at line 141 of file spm_tokenizer.h.
| int ember::SpmTokenizer::Symbol::prev |
Definition at line 140 of file spm_tokenizer.h.