ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
CPUBatchProcessor Member List

This is the complete list of members for CPUBatchProcessor, including all inherited members.

CPUBatchProcessor(TinyLlamaModel *model)CPUBatchProcessorexplicit
forward_cpu_batch(const std::vector< float > &batch_input_activations, int num_tokens_in_batch, int num_cpu_layers_to_process, int start_pos_in_sequence, KVCache *kv_cache, const std::vector< int > &prompt_lengths)CPUBatchProcessor
model_CPUBatchProcessorprivate