|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|
#include <graph_ir.h>

Public Attributes | |
| int | seq_len = 0 |
| std::vector< std::vector< float > > | k |
| std::vector< std::vector< float > > | v |
| std::vector< int > | ts_seg |
| std::vector< int > | ts_sidx |
| std::vector< int > | kv_pos |
| int | evicted_below = 0 |
| std::vector< std::vector< int > > | mor_rows |
| std::vector< int > | mor_depth |
| std::vector< float > | rec |
| int | rec_pos = 0 |
| std::map< int, std::vector< float > > | rec_snaps |
| std::vector< int > | ids |
| bool | rope_long = false |
Definition at line 202 of file graph_ir.h.
| int ember_ir::Interpreter::State::evicted_below = 0 |
Definition at line 206 of file graph_ir.h.
| std::vector<int> ember_ir::Interpreter::State::ids |
Definition at line 212 of file graph_ir.h.
| std::vector<std::vector<float> > ember_ir::Interpreter::State::k |
Definition at line 204 of file graph_ir.h.
| std::vector<int> ember_ir::Interpreter::State::kv_pos |
Definition at line 205 of file graph_ir.h.
| std::vector<int> ember_ir::Interpreter::State::mor_depth |
Definition at line 208 of file graph_ir.h.
| std::vector<std::vector<int> > ember_ir::Interpreter::State::mor_rows |
Definition at line 207 of file graph_ir.h.
| std::vector<float> ember_ir::Interpreter::State::rec |
Definition at line 209 of file graph_ir.h.
| int ember_ir::Interpreter::State::rec_pos = 0 |
Definition at line 210 of file graph_ir.h.
Definition at line 211 of file graph_ir.h.
Definition at line 213 of file graph_ir.h.
| int ember_ir::Interpreter::State::seq_len = 0 |
Definition at line 203 of file graph_ir.h.
Referenced by ember_ir::Interpreter::save_state().
| std::vector<int> ember_ir::Interpreter::State::ts_seg |
Definition at line 205 of file graph_ir.h.
| std::vector<int> ember_ir::Interpreter::State::ts_sidx |
Definition at line 205 of file graph_ir.h.
| std::vector<std::vector<float> > ember_ir::Interpreter::State::v |
Definition at line 204 of file graph_ir.h.