distributed_coordinator.h File Reference

#include <memory>
#include <string>
#include <vector>
#include <functional>
#include <map>
#include <atomic>

Include dependency graph for distributed_coordinator.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	tinyllama::DistributedCoordinator
	Distributed coordinator for multi-node LLM inference. More...
struct	tinyllama::DistributedCoordinator::NodeInfo
struct	tinyllama::DistributedCoordinator::InferenceRequest
struct	tinyllama::DistributedCoordinator::InferenceResult
struct	tinyllama::DistributedCoordinator::LoadStats
	Get load balancing statistics. More...

Namespaces
namespace	tinyllama