ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
score.h File Reference
#include <algorithm>
#include <cmath>
#include <cstddef>
#include <string>
#include <vector>
#include <nlohmann/json.hpp>
Include dependency graph for score.h:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

struct  ember::ScoreModel
 
struct  ember::ScoreItem
 

Namespaces

namespace  ember
 

Functions

std::string ember::score_state_ids_error (const std::vector< int > &ids, const ScoreModel &m)
 
std::string ember::parse_score_body (const nlohmann::json &body, const ScoreModel &m, std::vector< ScoreItem > &out)
 
std::vector< char > ember::score_banned (const std::vector< std::string > &tokens, size_t vocab)
 
void ember::score_fill (nlohmann::json &rec, const std::vector< int > &c, const float *rows, size_t V, const std::vector< char > &banned)