TinyLlama.cpp 1.0
A lightweight C++ implementation of the TinyLlama language model
Loading...
Searching...
No Matches
cuda_safe_headers.h File Reference

Safe CUDA header inclusion wrapper for Windows CUDA 12.1+ compatibility. More...

Go to the source code of this file.

Detailed Description

Safe CUDA header inclusion wrapper for Windows CUDA 12.1+ compatibility.

This header provides a workaround for Windows CUDA 12.1+ where cuda_fp16.hpp and cuda_bf16.hpp try to include non-existent 'nv/target' files.

Definition in file cuda_safe_headers.h.