Stop Guessing! I Built an LLM Hardware Calculator

Post Content

I Built an LLM Hardware Calculator.

Thanks to Sevalla for sponsoring and hosting it! Check them out at: https://sevalla.com

Gear Links
Thunderbolt 5 external SSD: https://amzn.to/3XqetZO
Favorite 15″ display with magnet: https://amzn.to/3zD1DhQ
Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
My nvme ssd: https://amzn.to/3YLEySo
My gear: https://www.amazon.com/shop/alexziskind

* Mini PC portable setup –
https://youtu.be/4RYmsrarOSw
* Dev setup on Mac –
https://youtu.be/KiKUN4i1SeU
* Cheap mini runs a 70B LLM – https://youtu.be/xyKEQjUzfAk
* RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* REALITY vs Apple’s Memory Claims | vs RTX4090m – https://youtu.be/fdvzQAWXU7A
* Set up Conda – https://youtu.be/2Acht_5_HTo
* INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k

* Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
AI for Coding Playlist: – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

My Calculator here: https://llm-inference-calculator-rki02.kinsta.page/
GitHub: https://github.com/alexziskind1/llm-inference-calculator

Other’s calcs
https://llm-dev-tools.streamlit.app/Memory
https://llm-calc.rayfernando.ai/
https://rahulschand.github.io/gpu_poor/
https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
https://vram.asmirnov.xyz/

— — — — — — — — —

SUBSCRIBE TO MY YOUTUBE CHANNEL
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1