…I tried this LLM on a CLUSTER!

Estimated read time 2 min read

Post Content

​ I test the cluster workflow that allowed Alex to run Llama 405B model on 2 laptops!

Check out DevStarterPack here: https://devstarterpack.io

🛒 Gear Links 🛒
* 🍏💥 K9 Mini with 32GB RAM: https://amzn.to/3ZiKjcp
* 🛠️🚀 96GB RAM kit: https://amzn.to/3ZhQ4qR
* 💻🔄 Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk
* 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
* 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo
* 📦🎮 My gear: https://www.amazon.com/shop/alexziskind

🎥 Related Videos 🎥
* 🤖 REALITY vs Apple’s Memory Claims – https://youtu.be/fdvzQAWXU7A
* 🌗 RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* 🛠️ FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* 🛠️ Set up Conda – https://youtu.be/2Acht_5_HTo
* 🤖 INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
* 🛠️ Conda setup for Python dev – https://youtu.be/2Acht_5_HTo

* 🛠️ Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
🔗 AI for Coding Playlist: 📚 – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

— — — — — — — — —

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

— — — — — — — — —

📱 ALEX ON X: https://twitter.com/digitalix

#machinelearning #llm #softwaredevelopment   Read More Alex Ziskind 

You May Also Like

More From Author