2 Commits

Author	SHA1	Message	Date
ZacharyZcR	76e858a80f	Bounded FIFO inference scheduling: admission queue, OpenAI-shaped 429/503, queued-disconnect detection (#28)	2026-07-10 12:52:07 +02:00
ZacharyZcR	3e4d08b6bf	OpenAI-compatible HTTP API: stdlib-only gateway over SERVE with KV prefix reuse across stateless requests (#21) ... * Add OpenAI-compatible HTTP API * Support browser API clients * Handle missing KV cache during rewind	2026-07-10 11:04:56 +02:00