AI from scratch

16. What this is not

A short list of things the earlier chapters should have knocked out, gathered in one place.

It is not a program. There is no inner if. Personality, knowledge, and coding skill are the same function, pointed at different prompts.

It is not a database. When it says something true, that is usually because the true continuation was common, or because a tool just put the fact in the prompt. When it says something false with confidence, that is the same mechanism.

It is not reading your mind, and it is not reading files. It sees tokens. A file exists for it only after some program stuffed the file into the prompt, or after a tool returned the file's contents as more tokens.

Thinking is not a second brain. It is more tokens. Useful ones, if the training worked. Expensive ones, always.

MoE is not a committee of little models voting on the answer. It is one model whose feed-forward layer is a spare parts bin. Eleven parts run. The rest are storage.

Open weights are not open science. You can run the function. You cannot replay the education. You also cannot assume the license is Apache just because earlier Qwens were.

Bigger is not a personality upgrade. 2.4T total / 95B active is a capacity and cost story. Whether it is better for your task is an eval, not a parameter count.

The API name is not the filename. qwen3.8-max is the product. Qwen3.8-2.4T-A95B is the dump. Vision, optional non-thinking, and the default million-token window live on the product side.

A vendor benchmark is a claim. The architecture numbers in config.json are not.

If you want a single picture to keep:

flowchart TB T["text"] --> TOK["tokenizer → IDs"] TOK --> EMB["embedding table → vectors"] EMB --> L["92 layers"] subgraph L["each layer"] direction TB A["mix tokens
DeltaNet or full attention"] --> E["11 of 512 experts"] end L --> HEAD["last vector → 248k scores"] HEAD --> S["sample one token"] S --> T

That loop, with a very large pile of numbers found by guessing the next token on a lot of text, then steered by instruction data and reinforcement in agent environments, is the model.

The rest is product.

If you read this in order, you should be able to open the model card, look at the bullet list under "Model Overview," and know what every line is doing. That was the first assignment.

The second assignment is why one GPU dies.