numeric Namespace Reference

Constants for ensuring numeric stability. More...

Variables
constexpr float	MIN_NORM_EPS = 1e-5f
constexpr float	DEFAULT_EPS = 1e-6f
constexpr float	MAX_LOGIT_THRESHOLD = 100.0f

Detailed Description

Constants for ensuring numeric stability.

These constants define thresholds and epsilon values used throughout the model to prevent numerical issues.

Variable Documentation

DEFAULT_EPS

constexpr float numeric::DEFAULT_EPS = 1e-6f

constexpr

Default epsilon for general numerical stability

Definition at line 69 of file model_constants.h.

MAX_LOGIT_THRESHOLD

constexpr float numeric::MAX_LOGIT_THRESHOLD = 100.0f

constexpr

Maximum absolute value for logits to prevent overflow

Definition at line 70 of file model_constants.h.

MIN_NORM_EPS

constexpr float numeric::MIN_NORM_EPS = 1e-5f

constexpr

Minimum epsilon for normalization operations

Definition at line 68 of file model_constants.h.

Referenced by rmsnorm_vector_cpu().