|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|

Public Attributes | |
| std::string | prompt |
| int | prompt_tokens = 0 |
| int | turns_used = 0 |
| std::string | error |
Definition at line 121 of file server.cpp.
| std::string BpePrompt::error |
Definition at line 125 of file server.cpp.
| std::string BpePrompt::prompt |
Definition at line 122 of file server.cpp.
Referenced by bpe_build_prompt().
| int BpePrompt::prompt_tokens = 0 |
Definition at line 123 of file server.cpp.
| int BpePrompt::turns_used = 0 |
Definition at line 124 of file server.cpp.