ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
ember::ScoreModel Struct Reference

#include <score.h>

Collaboration diagram for ember::ScoreModel:
Collaboration graph

Public Attributes

size_t vocab = 0
 
size_t state_k = 0
 
int eot = -1
 
int user = -1
 
int assistant = -1
 
size_t ctx = 0
 

Detailed Description

Definition at line 42 of file score.h.

Member Data Documentation

◆ assistant

int ember::ScoreModel::assistant = -1

Definition at line 45 of file score.h.

◆ ctx

size_t ember::ScoreModel::ctx = 0

Definition at line 46 of file score.h.

◆ eot

int ember::ScoreModel::eot = -1

Definition at line 45 of file score.h.

◆ state_k

size_t ember::ScoreModel::state_k = 0

Definition at line 44 of file score.h.

◆ user

int ember::ScoreModel::user = -1

Definition at line 45 of file score.h.

◆ vocab

size_t ember::ScoreModel::vocab = 0

Definition at line 43 of file score.h.

Referenced by main().


The documentation for this struct was generated from the following file: