|
ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
|
#include <algorithm>#include <cmath>#include <cstddef>#include <string>#include <vector>#include <nlohmann/json.hpp>

Go to the source code of this file.
Classes | |
| struct | ember::ScoreModel |
| struct | ember::ScoreItem |
Namespaces | |
| namespace | ember |
Functions | |
| std::string | ember::score_state_ids_error (const std::vector< int > &ids, const ScoreModel &m) |
| std::string | ember::parse_score_body (const nlohmann::json &body, const ScoreModel &m, std::vector< ScoreItem > &out) |
| std::vector< char > | ember::score_banned (const std::vector< std::string > &tokens, size_t vocab) |
| void | ember::score_fill (nlohmann::json &rec, const std::vector< int > &c, const float *rows, size_t V, const std::vector< char > &banned) |