|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|

Public Member Functions | |
| bool | quantised () const |
Public Attributes | |
| std::vector< float > | f32 |
| std::vector< uint8_t > | q |
| const uint8_t * | qp = nullptr |
| size_t | qbytes = 0 |
| GGMLType | type = GGMLType::GGML_TYPE_F32 |
| size_t | numel = 0 |
Definition at line 234 of file graph_ir.h.
|
inline |
| std::vector<float> ember_ir::Interpreter::Weight::f32 |
Definition at line 235 of file graph_ir.h.
Referenced by ember_ir::Interpreter::bind_tensor().
| size_t ember_ir::Interpreter::Weight::numel = 0 |
Definition at line 240 of file graph_ir.h.
Referenced by ember_ir::Interpreter::bind_tensor().
| std::vector<uint8_t> ember_ir::Interpreter::Weight::q |
Definition at line 236 of file graph_ir.h.
| size_t ember_ir::Interpreter::Weight::qbytes = 0 |
Definition at line 238 of file graph_ir.h.
Definition at line 237 of file graph_ir.h.
Referenced by ember_ir::Interpreter::bind_tensor(), and quantised().
| GGMLType ember_ir::Interpreter::Weight::type = GGMLType::GGML_TYPE_F32 |
Definition at line 239 of file graph_ir.h.