ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
ember_ir::Interpreter::State Struct Reference

#include <graph_ir.h>

Collaboration diagram for ember_ir::Interpreter::State:
Collaboration graph

Public Attributes

int seq_len = 0
 
std::vector< std::vector< float > > k
 
std::vector< std::vector< float > > v
 
std::vector< int > ts_seg
 
std::vector< int > ts_sidx
 
std::vector< int > kv_pos
 
int evicted_below = 0
 
std::vector< std::vector< int > > mor_rows
 
std::vector< int > mor_depth
 
std::vector< float > rec
 
int rec_pos = 0
 
std::map< int, std::vector< float > > rec_snaps
 
std::vector< int > ids
 
bool rope_long = false
 

Detailed Description

Definition at line 202 of file graph_ir.h.

Member Data Documentation

◆ evicted_below

int ember_ir::Interpreter::State::evicted_below = 0

Definition at line 206 of file graph_ir.h.

◆ ids

std::vector<int> ember_ir::Interpreter::State::ids

Definition at line 212 of file graph_ir.h.

◆ k

std::vector<std::vector<float> > ember_ir::Interpreter::State::k

Definition at line 204 of file graph_ir.h.

◆ kv_pos

std::vector<int> ember_ir::Interpreter::State::kv_pos

Definition at line 205 of file graph_ir.h.

◆ mor_depth

std::vector<int> ember_ir::Interpreter::State::mor_depth

Definition at line 208 of file graph_ir.h.

◆ mor_rows

std::vector<std::vector<int> > ember_ir::Interpreter::State::mor_rows

Definition at line 207 of file graph_ir.h.

◆ rec

std::vector<float> ember_ir::Interpreter::State::rec

Definition at line 209 of file graph_ir.h.

◆ rec_pos

int ember_ir::Interpreter::State::rec_pos = 0

Definition at line 210 of file graph_ir.h.

◆ rec_snaps

std::map<int, std::vector<float> > ember_ir::Interpreter::State::rec_snaps

Definition at line 211 of file graph_ir.h.

◆ rope_long

bool ember_ir::Interpreter::State::rope_long = false

Definition at line 213 of file graph_ir.h.

◆ seq_len

int ember_ir::Interpreter::State::seq_len = 0

Definition at line 203 of file graph_ir.h.

Referenced by ember_ir::Interpreter::save_state().

◆ ts_seg

std::vector<int> ember_ir::Interpreter::State::ts_seg

Definition at line 205 of file graph_ir.h.

◆ ts_sidx

std::vector<int> ember_ir::Interpreter::State::ts_sidx

Definition at line 205 of file graph_ir.h.

◆ v

std::vector<std::vector<float> > ember_ir::Interpreter::State::v

Definition at line 204 of file graph_ir.h.


The documentation for this struct was generated from the following file: