Using this demo you can run Bonsai (1-bit) and Ternary-Bonsai language models locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU. Below are featured community demos and additional ...
Using this demo you can run 1-bit Bonsai language models locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU. llama.cpp (GGUF) — C/C++, runs on Mac (Metal), Linux/Windows (CUDA, Vulkan, ...