JustVugg
1f0e1b7076
#134: olmoe.c stored experts as int8_t but silently accepted any bits argv; bits=16 (falsely documented as f32) truncated in quantize_rows -> wraparound garbage experts. Guard bits to 2..8 with a clear error (int8 is token-exact; f32 experts are not implemented here, unlike glm.c's fmt=0 path). Doc corrected. #133: shipped ref.json was from a different checkpoint (continued 'The capital of the United States is Washington'); the intended target is allenai/OLMoE-1B-7B-0125-Instruct (per convert_olmoe.py), whose greedy oracle continues 'The official language of France is French'. full_ids/text updated to the reporter's verified oracle (engine is already token-exact 12/12 vs it). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
31 lines
381 B
JSON
31 lines
381 B
JSON
{
|
|
"prompt": "The capital of France is",
|
|
"prompt_ids": [
|
|
510,
|
|
5347,
|
|
273,
|
|
6181,
|
|
310
|
|
],
|
|
"full_ids": [
|
|
510,
|
|
5347,
|
|
273,
|
|
6181,
|
|
310,
|
|
7785,
|
|
15,
|
|
187,
|
|
187,
|
|
510,
|
|
3565,
|
|
3448,
|
|
273,
|
|
6181,
|
|
310,
|
|
5112,
|
|
15
|
|
],
|
|
"text": "The capital of France is Paris.\n\nThe official language of France is French."
|
|
}
|