colibri-strix

__pycache__

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

scripts

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

tests

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

tools

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

.gitignore

Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs (#40 )

2026-07-11 12:59:49 +02:00

backend_cuda.cu

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68 )

2026-07-13 14:30:36 +02:00

backend_cuda.h

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00

backend_hip.cpp

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

backend_hip.o

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

backend_loader.c

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00

backend_metal.h

Metal backend (Apple Silicon): batched experts + fused attention on GPU, unified-memory zero-copy, gated behind COLI_METAL — 2.06 tok/s M5 Max (#72 , #87 , #103 )

2026-07-13 08:57:10 +02:00

backend_metal.mm

Metal backend (Apple Silicon): batched experts + fused attention on GPU, unified-memory zero-copy, gated behind COLI_METAL — 2.06 tok/s M5 Max (#72 , #87 , #103 )

2026-07-13 08:57:10 +02:00

coli

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

compat.h

Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs (#40 )

2026-07-11 12:59:49 +02:00

decode_batch.h

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68 )

2026-07-13 14:30:36 +02:00

doctor.py

coli doctor: read-only setup/health diagnostics (path, config, shards, disk, RAM budget, placement) (#33 )

2026-07-11 19:39:13 +02:00

glm

perf: znver5 + LTO + OMP 32T + GPU DENSE/ASYNC (Strix Halo optimiert)

2026-07-14 23:56:35 +02:00

glm_cpu_backup

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

glm_cpu_v1

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

glm_hip

Initial: Colibri upstream + HIP/ROCm port (Strix Halo / Radeon 8060S)

2026-07-14 23:53:20 +02:00

glm_old

perf: znver5 + LTO + OMP 32T + GPU DENSE/ASYNC (Strix Halo optimiert)

2026-07-14 23:56:35 +02:00

glm_znver5

perf: znver5 + LTO + OMP 32T + GPU DENSE/ASYNC (Strix Halo optimiert)

2026-07-14 23:56:35 +02:00

glm.c

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00

grammar.h

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

iobench.c

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

json.h

colibrì: pure-C GLM-5.2 (744B MoE) engine with disk-streamed experts

2026-07-05 20:57:25 +02:00

Makefile

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00

olmoe.c

olmoe: reject quant_bits outside 2..8 (fixes degenerate output, #134 ) + correct ref.json to OLMoE-0125-Instruct oracle (#133 )

2026-07-13 20:33:47 +02:00

openai_server.py

openai server: type tool arguments from schema + implement tool_choice, 9 new tool-calling tests (#118 )

2026-07-13 16:11:31 +02:00

ref_glm.json

colibrì: pure-C GLM-5.2 (744B MoE) engine with disk-streamed experts

2026-07-05 20:57:25 +02:00

resource_plan.py

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00

setup.sh

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

st.h

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

tier.h

Unify continuous batching + heterogeneous runtime: decode batching, physical-core planning, disjoint VRAM/RAM placement, topp-policy warning (CPU-validated, CUDA on 6x5090) (#68 )

2026-07-13 14:30:36 +02:00

tok_unicode.h

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

tok.h

Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test (#67 , #85 )

2026-07-12 13:38:40 +02:00

warmup.ps1

Windows native port: serve-mode pipe fix + RAM detection + POSIX guards, AVX-VNNI kernel, gated CUDA DLL (#131 , fixes #123 )

2026-07-13 20:54:30 +02:00