Post Content
Llama.cpp Web UI + GGUF Setup Walkthrough and Ollama comparisons.
Check out ChatLLM: https://chatllm.abacus.ai/ltf
My USB-C portable hub: https://amzn.to/4kw0hrf
👀 My favorite external drive (dependable): https://amzn.to/3Os9Wi3
👀 Thunderbolt 4 dock: https://amzn.to/3yVRicC
⚡ *Other gear I use:* https://www.amazon.com/shop/alexziskind
▶️ M2 MacBook Air | INSTANTLY connect 4K monitors – https://youtu.be/KLI65HnvNMg
▶️ Unity on Steroids M3 Max and RTX 4090m – https://youtu.be/COpEtHzdPG0
▶️ INSANE Machine Learning on Neural Engine – https://youtu.be/Y2FOUg_jo7k
▶️ Ultimate Web Developer MacBook – https://youtu.be/72fneIUHXyY
▶️ This is what spending more on a MacBook Pro gets you – https://youtu.be/iLHrYuQjKPU
▶️ Apple Silicon and Developers Playlist – https://youtube.com/playlist?list=PLPwbI_iIX3aR88msMh-cHoJiBqS6YMUUH
Developer productivity Playlist – https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
— — — — — — — — —
❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
— — — — — — — — —
📱LET’S CONNECT ON SOCIAL MEDIA
ALEX ON TWITTER: https://twitter.com/digitalix
— — — — — — — — —
Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
⏱️ Chapters
00:00 – Local LLMs, many stacks
01:05 – Building from source
04:15 – Picking a GGUF model
07:56 – New Llama.cpp Web UI
09:06 – Ollama UI & speed check
10:44 – Ollama’s concurrency limit
11:48 – Llama.cpp parallel chats
#llm #llamacpp #macbook Read More Alex Ziskind
