 ZacharyZcR
|
9e6e1ac327
|
Isolated sequence KV contexts: KVState extraction, KV_SLOTS serve contexts with per-slot persistence, budget-aware pool accounting (#29)
* Add isolated sequence KV contexts
* Log projected multi-slot KV footprint
|
2026-07-10 16:19:43 +02:00 |
|
|
ZacharyZcR
|
76e858a80f
|
Bounded FIFO inference scheduling: admission queue, OpenAI-shaped 429/503, queued-disconnect detection (#28)
|
2026-07-10 12:52:07 +02:00 |
|
|
ZacharyZcR
|
3cbc52ab00
|
coli plan: read-only Disk/RAM/VRAM placement planner (mirrors engine budget math, versioned --json, --auto-tier) (#27)
* Add tiered resource planner
* Apply resource plans to runner configuration
---------
Co-authored-by: JustVugg <JustVugg@users.noreply.github.com>
|
2026-07-10 12:51:23 +02:00 |
|
|
ZacharyZcR
|
1453dab7ae
|
REPIN follows live session heat (decaying heat map; .coli_usage stays the persistent signal) + disk→RAM→VRAM promotion (#26)
|
2026-07-10 12:48:53 +02:00 |
|
|
ZacharyZcR
|
3e4d08b6bf
|
OpenAI-compatible HTTP API: stdlib-only gateway over SERVE with KV prefix reuse across stateless requests (#21)
* Add OpenAI-compatible HTTP API
* Support browser API clients
* Handle missing KV cache during rewind
|
2026-07-10 11:04:56 +02:00 |
|
|
ZacharyZcR
|
13e8f09ffc
|
Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22)
|
2026-07-10 10:08:39 +02:00 |
|
|
ZacharyZcR
|
8a2e4439ba
|
Local project checks and contribution templates: make check, dependency-free C/python tests, issue forms + blank issues, CONTRIBUTING (#20)
* Add lightweight project checks and templates
* Ignore generated test binaries
* Keep project checks local
|
2026-07-10 08:56:41 +02:00 |
|