Agents powered by llama 3.1 – Are they good at function calling? Powered by Groq API

Estimated read time 2 min read

Post Content

 

​ llama 3.1 is the new SOTA for open source but how good is it at function calling or tool usage for Agents? In this video, we test the new 70B, 8B llamas via the Groq API for parallel and Nested function calls along with a specialized fine-tune for function calling. Results will surprise you!

LINKS:

Check out Langtrace: https://langtrace.ai/
Github: https://github.com/Scale3-Labs/langtrace
Langtrace Discord: https://discord.langtrace.ai/

Notebooks:
llama3.1 70B: https://tinyurl.com/3p4w4zvc
llama3.1 8B: https://tinyurl.com/yz6erxm2
llama3 70B fine-tuned: https://tinyurl.com/523av9ut

? RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/courses/rag

Let’s Connect:
? Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|? Patreon: https://www.patreon.com/PromptEngineering
?Consulting: https://calendly.com/engineerprompt/consulting-call
? Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h

? Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0

TIMESTAMPS:
00:00 Introduction to Llama 3.1 and Function Calling
01:13 Setting Up the Environment
03:30 Testing Basic Function Calls
09:43 Exploring Parallel Function Calls
15:29 Nested Function Calls with Movie Recommendations
17:43 Comparing Models: 70B vs 8B
20:13 Specialized Function Calling Models from Groq
21:43 Final Thoughts and Recommendations

All Interesting Videos:
Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr

Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw

Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw

AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z   Read More Prompt Engineering 

#AI #promptengineering

You May Also Like

More From Author

+ There are no comments

Add yours