Graph RAG with Local LLMs – Its Complicated!!!

Estimated read time 2 min read

Post Content

 

​ Learn how to set up a local model using OLAMA and the Groq API for Project GraphRAG. We will also look at the limitation of using smaller local open weight models.

LINKS:
Graph RAG: https://tinyurl.com/y3f9cbnd
Github: https://github.com/microsoft/graphrag
GraphRAG flowchart: https://tinyurl.com/2s4ytcur
RAG flowchart: https://tinyurl.com/56mwzkk7
Community Creation: https://tinyurl.com/54n88c2j
Ollama OpenAI API: https://ollama.com/blog/openai-compatibility
Groq API: https://console.groq.com/docs/openai

? RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/courses/rag

Let’s Connect:
? Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|? Patreon: https://www.patreon.com/PromptEngineering
?Consulting: https://calendly.com/engineerprompt/consulting-call
? Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h

? Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0

TIMESTAMPS
00:00 Introduction to Project GraphRAG
00:30 Setting Up OLAMA and Choosing Models
01:14 Configuring GraphRAG with OLAMA
02:32 Using Groq API with GraphRAG
04:35 Running Local Indexing and Entity Extraction
07:15 Testing and Comparing Models
08:15 Importance of LLM Choice in GraphRAG
10:58 Optimizing Prompts for Different LLMs

All Interesting Videos:
Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr

Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw

Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw

AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z   Read More Prompt Engineering 

#AI #promptengineering

You May Also Like

More From Author

+ There are no comments

Add yours