From 4319dfdf91098f6e6fb8fb87f4152231cb77159e Mon Sep 17 00:00:00 2001 From: Vincenzo Date: Wed, 8 Jul 2026 08:42:44 +0200 Subject: [PATCH] Add model download huggingface section to README Added download instructions for the GLM-5.2 int4 model on Hugging Face. --- README.md | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/README.md b/README.md index 8dff2d2..32ee534 100644 --- a/README.md +++ b/README.md @@ -55,6 +55,22 @@ This is not fast. It is a 744B frontier-class model **answering correctly on a m ### SSD Wear Warning Cold starts are heavy on random reads (~11 GB/token). Reads themselves are safe, but the OS page cache can generate writes. Heavy use may accelerate wear on cheaper SSDs. Use with caution and monitor your drive health. +## Download the model + +A pre-converted **GLM-5.2 int4** model for colibrì is available on Hugging Face: + +**https://huggingface.co/jlnsrk/GLM-5.2-colibri-int4** + +Download the repository and point `COLI_MODEL` to its directory: + +```bash +COLI_MODEL=/path/to/GLM-5.2-colibri-int4 ./coli chat +``` + +This skips the FP8 → int4 conversion step entirely. + +Thanks DatPat for your help! + ### Quick start ```bash