Post Content
I Built an LLM Hardware Calculator.
Thanks to Sevalla for sponsoring and hosting it! Check them out at: https://sevalla.com
🛒 Gear Links 🛒
💻☕ Thunderbolt 5 external SSD: https://amzn.to/3XqetZO
💻☕ Favorite 15″ display with magnet: https://amzn.to/3zD1DhQ
🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo
📦🎮 My gear: https://www.amazon.com/shop/alexziskind
* 🛠️ Mini PC portable setup –
https://youtu.be/4RYmsrarOSw
* 🛠️ Dev setup on Mac –
https://youtu.be/KiKUN4i1SeU
* 🛠️ Cheap mini runs a 70B LLM 🤯 – https://youtu.be/xyKEQjUzfAk
* 🌗 RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* 🛠️ FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* 🌗 REALITY vs Apple’s Memory Claims | vs RTX4090m – https://youtu.be/fdvzQAWXU7A
* 🛠️ Set up Conda – https://youtu.be/2Acht_5_HTo
* 🤖 INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
* 🛠️ Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
🔗 AI for Coding Playlist: 📚 – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
My Calculator here: https://llm-inference-calculator-rki02.kinsta.page/
GitHub: https://github.com/alexziskind1/llm-inference-calculator
Other’s calcs
https://llm-dev-tools.streamlit.app/Memory
https://llm-calc.rayfernando.ai/
https://rahulschand.github.io/gpu_poor/
https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
https://vram.asmirnov.xyz/
— — — — — — — — —
❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
— — — — — — — — —
Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
— — — — — — — — —
📱 ALEX ON X: https://twitter.com/digitalix
#macstudio #macmini #m3ultra Read More Alex Ziskind
