api.h File Reference

#include <chrono>
#include <functional>
#include <map>
#include <memory>
#include <stdexcept>
#include <string>
#include <vector>
#include <random>
#include <sstream>
#include "chat_tokenizer.h"
#include "state_tokens.h"
#include "model.h"
#include "tokenizer.h"

Include dependency graph for api.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
struct	tinyllama::TtftBreakdown
	Where the time went between generate() being called and its first output token being emitted (docs/TTFT.md). More...
class	tinyllama::TinyLlamaSession
	Represents an active TinyLlama session holding the loaded model and tokenizer. More...

Namespaces
namespace	ember_ir
namespace	tinyllama