tinyllama::DistributedCoordinator::InferenceResult Struct Reference

#include <distributed_coordinator.h>

Collaboration diagram for tinyllama::DistributedCoordinator::InferenceResult:

Public Attributes
std::string	request_id
std::string	generated_text
int	tokens_generated
float	inference_time_ms
int	processing_node
bool	success
std::string	error_message

Detailed Description

Definition at line 52 of file distributed_coordinator.h.

Member Data Documentation

error_message

std::string tinyllama::DistributedCoordinator::InferenceResult::error_message

Definition at line 59 of file distributed_coordinator.h.

generated_text

std::string tinyllama::DistributedCoordinator::InferenceResult::generated_text

Definition at line 54 of file distributed_coordinator.h.

inference_time_ms

float tinyllama::DistributedCoordinator::InferenceResult::inference_time_ms

Definition at line 56 of file distributed_coordinator.h.

processing_node

int tinyllama::DistributedCoordinator::InferenceResult::processing_node

Definition at line 57 of file distributed_coordinator.h.

request_id

std::string tinyllama::DistributedCoordinator::InferenceResult::request_id

Definition at line 53 of file distributed_coordinator.h.

Referenced by tinyllama::DistributedCoordinator::process_inference_locally(), and tinyllama::DistributedCoordinator::submit_request().

success

bool tinyllama::DistributedCoordinator::InferenceResult::success

Definition at line 58 of file distributed_coordinator.h.

tokens_generated

int tinyllama::DistributedCoordinator::InferenceResult::tokens_generated

Definition at line 55 of file distributed_coordinator.h.

Referenced by tinyllama::DistributedCoordinator::deserialize_result().

---

The documentation for this struct was generated from the following file:

• distributed_coordinator.h