Collaboration diagram for BpeChatRequest:

Public Attributes
ember::Conversation	conv

int	max_new_tokens = 60

float	temperature = 0.1f

int	top_k = 40

float	top_p = 0.9f

bool	has_seed = false

unsigned	seed = 0

bool	want_ids = false

float	repeat_penalty = 1.0f

int	repeat_last_n = 64

Detailed Description

Definition at line 83 of file server.cpp.

Member Data Documentation

◆ conv

ember::Conversation BpeChatRequest::conv

Definition at line 84 of file server.cpp.

Referenced by main().

◆ has_seed

bool BpeChatRequest::has_seed = false

Definition at line 89 of file server.cpp.

◆ max_new_tokens

int BpeChatRequest::max_new_tokens = 60

Definition at line 85 of file server.cpp.

◆ repeat_last_n

int BpeChatRequest::repeat_last_n = 64

Definition at line 93 of file server.cpp.

◆ repeat_penalty

float BpeChatRequest::repeat_penalty = 1.0f

Definition at line 92 of file server.cpp.

◆ seed

unsigned BpeChatRequest::seed = 0

Definition at line 90 of file server.cpp.

◆ temperature

float BpeChatRequest::temperature = 0.1f

Definition at line 86 of file server.cpp.

Referenced by main().

◆ top_k

int BpeChatRequest::top_k = 40

Definition at line 87 of file server.cpp.

◆ top_p

float BpeChatRequest::top_p = 0.9f

Definition at line 88 of file server.cpp.

◆ want_ids

bool BpeChatRequest::want_ids = false

Definition at line 91 of file server.cpp.

The documentation for this struct was generated from the following file:

server.cpp

Public Attributes