TinyLlama.cpp 1.0
A lightweight C++ implementation of the TinyLlama language model
Loading...
Searching...
No Matches
Public Attributes | List of all members
block_q8_0 Struct Reference

Simple 8-bit quantized block structure. More...

#include <quantization.h>

Collaboration diagram for block_q8_0:
Collaboration graph

Public Attributes

uint16_t d
 
int8_t qs [GGML_QK8_0]
 

Detailed Description

Simple 8-bit quantized block structure.

Definition at line 120 of file quantization.h.

Member Data Documentation

◆ d

uint16_t block_q8_0::d

Block scale

Definition at line 121 of file quantization.h.

Referenced by dequantize_q8_0_block().

◆ qs

int8_t block_q8_0::qs[GGML_QK8_0]

Quantized values

Definition at line 122 of file quantization.h.

Referenced by dequantize_q8_0_block().


The documentation for this struct was generated from the following file: