microtorch::llama3::Tokenizer::Bigram Struct Reference

Collaboration diagram for microtorch::llama3::Tokenizer::Bigram:

Public Attributes
int	left
int	right
int	rank
std::string	text

Detailed Description

Definition at line 352 of file llama3_tokenizer.h.

Member Data Documentation

left

int microtorch::llama3::Tokenizer::Bigram::left

Definition at line 353 of file llama3_tokenizer.h.

rank

int microtorch::llama3::Tokenizer::Bigram::rank

Definition at line 353 of file llama3_tokenizer.h.

right

int microtorch::llama3::Tokenizer::Bigram::right

Definition at line 353 of file llama3_tokenizer.h.

text

std::string microtorch::llama3::Tokenizer::Bigram::text

Definition at line 354 of file llama3_tokenizer.h.

---

The documentation for this struct was generated from the following file:

• llama3_tokenizer.h