ember.cpp 0.1.0
C++ inference engine for Llama-family and paperkiln models (CPU, CUDA, WebAssembly)
Loading...
Searching...
No Matches
model_utils.h
Go to the documentation of this file.
1#pragma once
2
3#include "model.h"
4#include <vector>
5
6class SafeTensorsLoader;
7class GGUFData;
SafeTensorsLoader
Main class for loading tensors from SafeTensors format files (single or sharded)
Definition safetensors_loader.h:120
GGUFData
Complete representation of a GGUF file's contents.
Definition gguf_structs.h:80