…I tried this LLM on a CLUSTER!

Estimated read time 2 min read

Post Content

โ€‹ย I test the cluster workflow that allowed Alex to run Llama 405B model on 2 laptops!

Check out DevStarterPack here: https://devstarterpack.io

๐Ÿ›’ Gear Links ๐Ÿ›’
* ๐Ÿ๐Ÿ’ฅ K9 Mini with 32GB RAM: https://amzn.to/3ZiKjcp
* ๐Ÿ› ๏ธ๐Ÿš€ 96GB RAM kit: https://amzn.to/3ZhQ4qR
* ๐Ÿ’ป๐Ÿ”„ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk
* ๐ŸŽงโšก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
* ๐Ÿ› ๏ธ๐Ÿš€ My nvme ssd: https://amzn.to/3YLEySo
* ๐Ÿ“ฆ๐ŸŽฎ My gear: https://www.amazon.com/shop/alexziskind

๐ŸŽฅ Related Videos ๐ŸŽฅ
* ๐Ÿค– REALITY vs Appleโ€™s Memory Claims – https://youtu.be/fdvzQAWXU7A
* ๐ŸŒ— RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* ๐Ÿ› ๏ธ FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* ๐Ÿ› ๏ธ Set up Conda – https://youtu.be/2Acht_5_HTo
* ๐Ÿค– INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
* ๐Ÿ› ๏ธ Conda setup for Python dev – https://youtu.be/2Acht_5_HTo

* ๐Ÿ› ๏ธ Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
๐Ÿ”— AI for Coding Playlist: ๐Ÿ“š – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€”

โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐Ÿ“บ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€”

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€” โ€”

๐Ÿ“ฑ ALEX ON X: https://twitter.com/digitalix

#machinelearning #llm #softwaredevelopmentย ย ย Read Moreย Alex Ziskindย 

You May Also Like

More From Author