13 posts found
A model does not look anything up and does not decide what is true. It estimates which token comes next. Almost everythi...
Models do not see characters or words. They see tokens — and once you know how text becomes tokens, several odd behaviou...
An embedding turns text into coordinates, and nearby coordinates mean related meaning. That single idea is what makes se...
Bigger context windows did not give models memory. They gave you a larger envelope to fill on every single request — and...
Given a real design system, a model stops inventing interfaces and starts assembling them. The difference is not the mod...
A token that only names a hex value has saved you nothing. A token that names a job tells a model which decision it is m...
Generated layouts usually look almost right, and "almost" is where the eye catches. Most of the fix is stating the rules...
A human reads a bad component name and opens the file. A model reads it and guesses. Naming quietly became an interface...
Generated interfaces fail in a predictable set of places. Knowing which ones turns review from a vague unease into a lis...
Retrieval-augmented generation is three steps and a lot of tuning. The architecture is simple; the quality lives almost...
Teams spend weeks on rerankers and leave chunking at the default. It is usually the other way round that pays — how you...
If every request begins with the same two thousand tokens of instructions, you are paying full price to resend them. Ord...