 ZacharyZcR
|
57706a0200
|
Tiered CUDA acceleration for routed experts (opt-in, CPU default untouched) + REPLAY fixture harness (#16)
* feat: add experimental CUDA backend for resident tensors
* feat: promote pinned experts to a bounded VRAM tier
* feat: preload the GPU expert tier at startup
* fix: harden CUDA backend failure handling
* feat: add deterministic multi-GPU tensor placement
* test: add deterministic CUDA benchmark fixture
* perf: make routed experts the default CUDA path
|
2026-07-10 07:41:09 +02:00 |
|