← Journal · · Note
A calculator for GPU memory for LLMs
Hi! Look what a cool thing I found: a calculator for computing GPU memory for your LLMs.
If you've ever wondered how much memory you need for training or inference, you can use this project. It'll compute it for pre-made LLMs and for ones assembled from your own parameters.
So dive in :)