tinyllama::DistributedCoordinator::NodeInfo Struct Reference

#include <distributed_coordinator.h>

Collaboration diagram for tinyllama::DistributedCoordinator::NodeInfo:

Public Attributes
int	rank
std::string	hostname
NodeRole	role
bool	has_gpu
size_t	gpu_memory_mb
int	gpu_layers
std::atomic< bool >	is_busy {false}
std::atomic< int >	active_requests {0}

Detailed Description

Definition at line 30 of file distributed_coordinator.h.

Member Data Documentation

active_requests

std::atomic<int> tinyllama::DistributedCoordinator::NodeInfo::active_requests {0}

Definition at line 38 of file distributed_coordinator.h.

{0};

gpu_layers

int tinyllama::DistributedCoordinator::NodeInfo::gpu_layers

Definition at line 36 of file distributed_coordinator.h.

gpu_memory_mb

size_t tinyllama::DistributedCoordinator::NodeInfo::gpu_memory_mb

Definition at line 35 of file distributed_coordinator.h.

has_gpu

bool tinyllama::DistributedCoordinator::NodeInfo::has_gpu

Definition at line 34 of file distributed_coordinator.h.

hostname

std::string tinyllama::DistributedCoordinator::NodeInfo::hostname

Definition at line 32 of file distributed_coordinator.h.

is_busy

std::atomic<bool> tinyllama::DistributedCoordinator::NodeInfo::is_busy {false}

Definition at line 37 of file distributed_coordinator.h.

{false};

rank

int tinyllama::DistributedCoordinator::NodeInfo::rank

Definition at line 31 of file distributed_coordinator.h.

Referenced by tinyllama::DistributedCoordinator::discover_cluster().

role

NodeRole tinyllama::DistributedCoordinator::NodeInfo::role

Definition at line 33 of file distributed_coordinator.h.

---

The documentation for this struct was generated from the following file:

• distributed_coordinator.h