Smaller and cheaper dev machine that runs LLMs

Post Content

I test the Geekom A6 for my software developer tests, and an extensive LLM test, along with M4 Mac Mini Comparison.

Use this coupon code for 5% Off the A6: AlexZR7A6
GEEKOM Official US: https://www.geekompc.com/geekom-a6-mini-pc/
GEEKOM Amazon US: https://www.amazon.com/dp/B0DRP316J1?maas=maas_adg_BD9B0D022C07772DC6215645DD2B4890_afap_abs&ref_=aa_maas&tag=maas
GEEKOM Official UK: https://www.geekom.co.uk/geekom-a6-mini-pc
GEEKOM Amazon UK: https://www.amazon.co.uk/dp/B0DRP2CPR1?maas=maas_adg_A2B8AB1911C239C3DAC5C07DDF855C9E_afap_abs&ref_=aa_maas&tag=maas
GEEKOM Official CA:https://www.geekom.ca/geekom-a6-mini-pc/
GEEKOM Amazon CA:https://www.amazon.ca/dp/B0DRP316J1

🛒 Gear Links 🛒
👍🚗 My favorite Thumb drive: https://amzn.to/4h1M9DU
🪛🪛Highly rated precision driver kit: https://amzn.to/4fkMVfg
⌨️🏢 Keyboard for office (heavy): https://www.keychron.com/products/keychron-q1-max-qmk-via-wireless-custom-mechanical-keyboard?ref=azisk
⌨️☕ Keyboard for cafe (light): https://www.keychron.com/products/keychron-k7-max-qmk-via-wireless-custom-mechanical-keyboard?ref=azisk
💻☕ Favorite 15″ display with magnet: https://amzn.to/3zD1DhQ
🎧⚡ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
🛠️🚀 My nvme ssd: https://amzn.to/3YLEySo
📦🎮 My gear: https://www.amazon.com/shop/alexziskind

🎥 Related Videos 🎥

* 🛠️ Mini PC portable setup –
https://youtu.be/4RYmsrarOSw
* 🛠️ Dev setup on Mac –
https://youtu.be/KiKUN4i1SeU
* 🛠️ Cheap mini runs a 70B LLM 🤯 – https://youtu.be/xyKEQjUzfAk
* 🌗 RAM torture test on Mac – https://youtu.be/l3zIwPgan7M
* 🛠️ FREE Local LLMs on Apple Silicon | FAST! – https://youtu.be/bp2eev21Qfo
* 🌗 REALITY vs Apple’s Memory Claims | vs RTX4090m – https://youtu.be/fdvzQAWXU7A
* 🛠️ Set up Conda – https://youtu.be/2Acht_5_HTo
* 🤖 INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k

* 🛠️ Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
🔗 AI for Coding Playlist: 📚 – https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1

— — — — — — — — —

Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join

— — — — — — — — —

📱 ALEX ON X: https://twitter.com/digitalix

— — — — — — — — —

⏱️ Chapters
00:00 Intro & Pocket PC
00:18 Geekom A6 Overview
00:41 Specs & Dev Tasks
01:22 Ports vs. Mac Mini
02:17 Design & Future Models
03:09 Starbucks Dev Setup
04:15 SSD & Speed Tests
04:37 Geekbench & CPU Test
05:18 Multitasking Demo
06:12 Running Local LLMs
07:15 LLM Model Sizes Explained
07:37 LM Studio Setup
09:21 GPU & Quantization
10:17 1B Model GPU vs CPU
12:04 7B Model Performance
13:59 Testing 32B Model
15:14 Extreme Test & Crash
17:01 Recovery & Stability
17:39 Power Use & Summary