2416bc9079
Translate user-facing runtime output to English, machine prefixes preserved, + CLI output test ( #67 , #85 )
...
* feat: standardize runtime output in English
* test: cover English CLI output
2026-07-12 13:38:40 +02:00
cec7d6b648
Grammar-forced speculative drafts: GBNF grammar as a third draft source, guaranteed-accepted forced spans, lossless + opt-in ( #48 , #70 )
...
New byte-level GBNF-subset engine (c/grammar.h: parser + set-of-stacks PDA
walker) wired into spec_decode as a third draft source ("metodo F"), tried
before MTP/n-gram. Wherever the grammar admits exactly one legal byte, the
forced span is tokenized and injected as drafts; the existing batch-union
verification confirms them, so a wrong or out-of-sync grammar can never
change the output. Lazy arming skips preambles; adaptive guard (same
pattern as MTP) disables the source below 50% acceptance; grammar-accepted
tokens no longer pollute the MTP acceptance counter.
GRAMMAR=file.gbnf enables it in run and serve modes (also with DRAFT=0 and
with the int4 MTP head from #8 ); GRAMMAR_DRAFT=n caps the span (default 24).
Measured on M3 Max / int8-MTP container, greedy, MTP=0 DRAFT=0, NDJSON
classification: 0.37 -> 0.50 tok/s (1.60 tok/forward, 81 fw per 130 tok),
100% acceptance (48/48), output byte-identical to baseline.
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-07-12 01:35:39 +02:00
8f5f3e3a2b
coli doctor: read-only setup/health diagnostics (path, config, shards, disk, RAM budget, placement) ( #33 )
...
* Add read-only coli doctor diagnostics
* Fix doctor JSON output assertion
2026-07-11 19:39:13 +02:00
89d95fc73b
Windows 11 native port, phase 1: MinGW-w64 static build, compat shims, setup + docs ( #40 )
...
* fix: Windows port audit fixes — _FILE_OFFSET_BITS guard, O_BINARY st.h, getrusage peak, oracle diagnostic, setup.sh wmic
Audit remediation (all MEDIUM issues fixed):
- compat.h: compile-time #error if _FILE_OFFSET_BITS < 64 on _WIN32
- compat.h: COMPAT_O_RDONLY macro (O_RDONLY|O_BINARY on Windows, belt-and-braces)
- st.h: use COMPAT_O_RDONLY in both open() call sites (plan §1 row 1)
- compat.h: getrusage shim now uses PeakWorkingSetSize (ru_maxrss = peak, not current)
- glm.c: oracle mismatch diagnostic — prints position/expected/got on TF failures
- setup.sh: replace deprecated wmic with /proc/meminfo (MSYS2 provides it)
- .gitignore: *.exe, glm_tiny/, olmoe_hf/, olmoe_i4/
LOW issues addressed:
- _FILE_OFFSET_BITS guard prevents silent 32-bit off_t wrap at >4GB offsets
- coli Windows venv path (Scripts/python.exe) fixed earlier
- posix_fadvise do{}while(0) kept intentionally — no caller checks return code
Verification: oracle 32/32, 27/27 Python tests, rename EEXIST, >4GB pread offset.
* docs: add Windows 11 native port section to README
- Toolchain: MinGW-w64 (winlibs or MSYS2), GCC 16.1 tested
- Build instructions: make glm.exe, tiny oracle verification
- Runtime: SNAP=..., coli chat, coli serve all work
- Status: Phase 1 complete (compiles, correct, static-linked)
- Update platform requirements to include Windows 11 natively
2026-07-11 12:59:49 +02:00
9e6e1ac327
Isolated sequence KV contexts: KVState extraction, KV_SLOTS serve contexts with per-slot persistence, budget-aware pool accounting ( #29 )
...
* Add isolated sequence KV contexts
* Log projected multi-slot KV footprint
2026-07-10 16:19:43 +02:00
76e858a80f
Bounded FIFO inference scheduling: admission queue, OpenAI-shaped 429/503, queued-disconnect detection ( #28 )
2026-07-10 12:52:07 +02:00
3cbc52ab00
coli plan: read-only Disk/RAM/VRAM placement planner (mirrors engine budget math, versioned --json, --auto-tier) ( #27 )
...
* Add tiered resource planner
* Apply resource plans to runner configuration
---------
Co-authored-by: JustVugg <JustVugg@users.noreply.github.com >
2026-07-10 12:51:23 +02:00
1453dab7ae
REPIN follows live session heat (decaying heat map; .coli_usage stays the persistent signal) + disk→RAM→VRAM promotion ( #26 )
2026-07-10 12:48:53 +02:00
3e4d08b6bf
OpenAI-compatible HTTP API: stdlib-only gateway over SERVE with KV prefix reuse across stateless requests ( #21 )
...
* Add OpenAI-compatible HTTP API
* Support browser API clients
* Handle missing KV cache during rewind
2026-07-10 11:04:56 +02:00
13e8f09ffc
Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) ( #22 )
2026-07-10 10:08:39 +02:00
8a2e4439ba
Local project checks and contribution templates: make check, dependency-free C/python tests, issue forms + blank issues, CONTRIBUTING ( #20 )
...
* Add lightweight project checks and templates
* Ignore generated test binaries
* Keep project checks local
2026-07-10 08:56:41 +02:00
Sidd