Skip to content
Weights Not Walls
Menu

Will it run on my machine

For each reviewed model we take the largest format of 4 bits per weight or more that fits: memory needed is the file size (measured on the Hub where we read the files, otherwise estimated from the parameter count) plus the context cache plus 0.5 GB. A graphics card can use its memory less 0.5 GB, a Mac about 70% of unified memory, a CPU 80% of RAM. "Fits" leaves 10% spare; "tight" does not. It says nothing about speed: a large model on a CPU fits and runs slowly. The full method

Choose a machine to see which reviewed models fit and in which format. We do not guess your hardware; the choice stays in this browser.