ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
chat_reply.h File Reference
#include <functional>
#include <string>
#include <utility>
#include <vector>
#include "chat_tokenizer.h"
#include "utf8_text.h"
Include dependency graph for chat_reply.h:
This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes

struct  ember::ChatReply
 
class  ember::ReplyBuilder
 

Namespaces

namespace  ember
 

Typedefs

using ember::ChatDecode = std::function< std::string(const std::vector< int > &)>
 

Functions

std::string ember::strip_reply_ws (const std::string &s)
 
ChatReply ember::reply_of (const std::vector< int > &ids, int call_id, const ChatDecode &decode)
 
template<class Json >
Json ember::tool_calls_json (const std::vector< chat::ToolCall > &calls)