Organize project tools and local workflows: c/tools, c/scripts, c/tests, root Makefile (flat C core untouched) (#22)

2026-07-10 16:08:39 +08:00
parent a2942b2172
commit 13e8f09ffc
23 changed files with 87 additions and 52 deletions
@@ -0,0 +1,16 @@
+# Tools
+
+These scripts support model preparation and offline engineering work. They are
+not runtime dependencies of the C engine.
+
+- `convert_fp8_to_int4.py`, `download_glm52.py`: model preparation
+- `make_glm_oracle.py`, `make_glm_bench_model.py`: deterministic fixtures
+- `benchmark_cuda_fixture.py`, `eval_glm.py`, `fetch_benchmarks.py`: benchmarks
+- `gen_unicode.py`: tokenizer table generation
+
+Run them from `c/`, for example:
+
+```sh
+python3 tools/convert_fp8_to_int4.py --selftest
+python3 tools/make_glm_bench_model.py --output /tmp/colibri-bench
+```