woolcoxm
2319b942d2
Rebased onto current dev, split into 3 logical parts (all validated): 1. CPU portability (serve-mode _O_BINARY pipe fix — stock main hangs on MinGW without it; RAM detection cap 0->9/layer; POSIX guards for select/mmap/madvise; warmup script). 2. AVX-VNNI 128-bit int8/int4 dot kernel (Alder Lake+/Meteor Lake+), bit-identical to AVX2 (author-verified on Meteor Lake; compiles out to AVX2 elsewhere) + _mm256_extracti128_si256 typo fix that blocked -march=native. 3. CUDA DLL via LoadLibrary, gated behind CUDA_DLL=1 (host never links cudart; silent CPU fallback if absent; author-verified on RTX 5070 Ti). Validated here: make check 59/59, oracle 32/32 TF, Windows cross-compile clean + glm.exe loads+runs via WSL interop. Fixes the #123 Windows build failure.
63 lines
1.0 KiB
Plaintext
63 lines
1.0 KiB
Plaintext
# ambienti python / cache
|
|
c/mio_env/
|
|
__pycache__/
|
|
**/__pycache__/
|
|
*.pyc
|
|
web/node_modules/
|
|
web/dist/
|
|
web/*.tsbuildinfo
|
|
desktop/src-tauri/target/
|
|
desktop/src-tauri/gen/
|
|
|
|
# binari compilati (si rigenerano con make / coli build)
|
|
c/glm
|
|
c/glm.exe
|
|
c/olmoe
|
|
c/olmoe.exe
|
|
c/iobench
|
|
c/iobench.exe
|
|
c/tok_test
|
|
c/backend_cuda.o
|
|
c/backend_cuda_test
|
|
c/backend_loader.o
|
|
c/coli_cuda.dll
|
|
c/coli_cuda.lib
|
|
c/coli_cuda.exp
|
|
c/tests/test_json
|
|
c/tests/test_json.exe
|
|
c/tests/test_st
|
|
c/tests/test_st.exe
|
|
c/tests/test_tier
|
|
c/tests/test_tier.exe
|
|
c/tests/test_grammar
|
|
c/tests/test_grammar.exe
|
|
|
|
# oracoli tiny generati (make_glm_oracle.py) e dati benchmark scaricati
|
|
c/glm_tiny/
|
|
c/glm_tiny_i2/
|
|
c/glm_tiny_i4/
|
|
c/glm_tiny_mix/
|
|
c/glm_bench_medium/
|
|
c/bench/
|
|
|
|
# pesi modello / artefatti di run
|
|
*.safetensors
|
|
stats*.txt
|
|
*.log
|
|
|
|
# script di ricerca stadio-0 (esperimenti locali, non parte del motore)
|
|
/engine.py
|
|
/run.py
|
|
/validate_ref.py
|
|
/s0_costmodel.py
|
|
/s1_trace_hitrate.py
|
|
/s2_research.py
|
|
/quant_test.py
|
|
/profile_run.py
|
|
/sweep.py
|
|
c/backend_metal.o
|
|
c/backend_metal_test
|
|
c/tests/test_tier
|
|
c/mio_env/
|
|
c/bench/
|