|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|

Public Member Functions | |
| float | eval (const E &e) const |
| void | assign (const Assign &a, float *out) const |
Public Attributes | |
| std::vector< std::string > | index_names |
| std::vector< int > | index_sizes |
| std::map< std::string, int > | index_of |
| std::vector< Tensor > | tensors |
| std::map< std::string, int > | tensor_of |
| std::vector< int > | inputs |
| std::vector< int > | weights |
| std::vector< int > | states |
| std::vector< int > | lets |
| int | out = -1 |
| std::vector< Assign > | init |
| std::vector< Assign > | let |
| std::vector< Assign > | update |
| Assign | readout |
| std::vector< int > | init_of_state |
| std::vector< Recurrence::StateTensor > | state_info |
| std::vector< Recurrence::WeightDecl > | weight_info |
| std::vector< size_t > | in_widths |
| size_t | out_width = 0 |
| bool | exact = true |
| std::vector< int > | iv |
| std::vector< const float * > | data |
| std::vector< std::vector< float > > | let_buf |
| std::vector< std::vector< float > > | new_state |
Definition at line 153 of file graph_ir_recurrence.cpp.
Definition at line 523 of file graph_ir_recurrence.cpp.
References a, eval(), index_sizes, iv, j, k, n, out, and tensors.
Definition at line 472 of file graph_ir_recurrence.cpp.
References c, data, eval(), index_sizes, iv, j, n, and tensors.
Definition at line 171 of file graph_ir_recurrence.cpp.
Referenced by eval(), ember_ir::rec::Recurrence::init(), and ember_ir::rec::Recurrence::step().
Definition at line 168 of file graph_ir_recurrence.cpp.
| std::vector<size_t> ember_ir::rec::Program::in_widths |
Definition at line 166 of file graph_ir_recurrence.cpp.
| std::vector<std::string> ember_ir::rec::Program::index_names |
Definition at line 154 of file graph_ir_recurrence.cpp.
| std::map<std::string, int> ember_ir::rec::Program::index_of |
Definition at line 156 of file graph_ir_recurrence.cpp.
| std::vector<int> ember_ir::rec::Program::index_sizes |
Definition at line 155 of file graph_ir_recurrence.cpp.
| std::vector<Assign> ember_ir::rec::Program::init |
Definition at line 161 of file graph_ir_recurrence.cpp.
| std::vector<int> ember_ir::rec::Program::init_of_state |
Definition at line 163 of file graph_ir_recurrence.cpp.
| std::vector<int> ember_ir::rec::Program::inputs |
Definition at line 159 of file graph_ir_recurrence.cpp.
|
mutable |
Definition at line 170 of file graph_ir_recurrence.cpp.
| std::vector<Assign> ember_ir::rec::Program::let |
Definition at line 161 of file graph_ir_recurrence.cpp.
|
mutable |
Definition at line 172 of file graph_ir_recurrence.cpp.
| std::vector<int> ember_ir::rec::Program::lets |
Definition at line 159 of file graph_ir_recurrence.cpp.
| std::vector<std::vector<float> > ember_ir::rec::Program::new_state |
Definition at line 172 of file graph_ir_recurrence.cpp.
| int ember_ir::rec::Program::out = -1 |
Definition at line 160 of file graph_ir_recurrence.cpp.
Referenced by assign().
| size_t ember_ir::rec::Program::out_width = 0 |
Definition at line 167 of file graph_ir_recurrence.cpp.
| Assign ember_ir::rec::Program::readout |
Definition at line 162 of file graph_ir_recurrence.cpp.
| std::vector<Recurrence::StateTensor> ember_ir::rec::Program::state_info |
Definition at line 164 of file graph_ir_recurrence.cpp.
Referenced by ember_ir::rec::Recurrence::state().
| std::vector<int> ember_ir::rec::Program::states |
Definition at line 159 of file graph_ir_recurrence.cpp.
| std::map<std::string, int> ember_ir::rec::Program::tensor_of |
Definition at line 158 of file graph_ir_recurrence.cpp.
| std::vector<Tensor> ember_ir::rec::Program::tensors |
Definition at line 157 of file graph_ir_recurrence.cpp.
| std::vector<Assign> ember_ir::rec::Program::update |
Definition at line 161 of file graph_ir_recurrence.cpp.
| std::vector<Recurrence::WeightDecl> ember_ir::rec::Program::weight_info |
Definition at line 165 of file graph_ir_recurrence.cpp.
| std::vector<int> ember_ir::rec::Program::weights |
Definition at line 159 of file graph_ir_recurrence.cpp.