|
TinyLlama.cpp 1.0
A lightweight C++ implementation of the TinyLlama language model
|
This is the complete list of members for CPUBatchProcessor, including all inherited members.
| CPUBatchProcessor(TinyLlamaModel *model) | CPUBatchProcessor | explicit |
| forward_cpu_batch(const std::vector< float > &batch_input_activations, int num_tokens_in_batch, int num_cpu_layers_to_process, int start_pos_in_sequence, KVCache *kv_cache, const std::vector< int > &prompt_lengths) | CPUBatchProcessor | |
| model_ | CPUBatchProcessor | private |