Running LLM Clusters on ALL THIS 🚀

Estimated read time 2 min read

Post Content

​ I test the cluster workflow on MacBook Pro and MacBook Airs, all sharing LLM models via an all-SSD NAS, while talking to each other via Thunderbolt.

🛒 Gear Links 🛒
* 🍏💥 All SSD NAS: https://amzn.to/3YCTr9R
* 💻🔄 Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk
* 💻🔄 MacBook Air M2 Deal: https://amzn.to/3Ay78PC
* 🛠️🚀 MacBook Air M3: https://amzn.to/4fz8Hvq
* 🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
* 🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo
* 📦🎮 My gear: https://www.amazon.com/shop/alexziskind

🎥 Related Videos 🎥
* 🤖 REALITY vs Apple’s Memory Claims – https://youtu.be/fdvzQAWXU7A
* 🌗 RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* 🛠️ FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* 🛠️ Set up Conda – https://youtu.be/2Acht_5_HTo
* 🤖 INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
* 🛠️ Conda setup for Python dev – https://youtu.be/2Acht_5_HTo

* 🛠️ Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
🔗 AI for Coding Playlist: 📚 – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

Exo project: https://github.com/exo-explore/exo

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

— — — — — — — — —

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

— — — — — — — — —

📱 ALEX ON X: https://twitter.com/digitalix

#machinelearning #llm #softwaredevelopment   Read More Alex Ziskind 

You May Also Like

More From Author