TinyLlama.cpp 1.0
A lightweight C++ implementation of the TinyLlama language model
Loading...
Searching...
No Matches
CPUBatchProcessor Member List

This is the complete list of members for CPUBatchProcessor, including all inherited members.

CPUBatchProcessor(TinyLlamaModel *model)CPUBatchProcessorexplicit
forward_cpu_batch(const std::vector< float > &batch_input_activations, int num_tokens_in_batch, int num_cpu_layers_to_process, int start_pos_in_sequence, KVCache *kv_cache, const std::vector< int > &prompt_lengths)CPUBatchProcessor
model_CPUBatchProcessorprivate