LLAMA-3.1 ?: EASIET WAY To FINE-TUNE ON YOUR DATA ?

Estimated read time 2 min read

Post Content

 

​ Learn how to efficiently fine-tuning the Llama 3.1 model using Unsloth, LoRa, and QLoRa techniques.

LINKS:
Colab: https://tinyurl.com/bdzxhy5n
Unsloth: https://unsloth.ai/blog/llama3-1
Huggingface blog: https://huggingface.co/blog/mlabonne/sft-llama3
Unsloth UI: https://tinyurl.com/24shjemu
Dataset: https://tinyurl.com/2jh5ajr3

? RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/courses/rag

Let’s Connect:
? Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|? Patreon: https://www.patreon.com/PromptEngineering
?Consulting: https://calendly.com/engineerprompt/consulting-call
? Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h

? Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).

Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0

TIMESTAMPS:
00:00 Introduction to Open Weight Models
00:26 Fine-Tuning Lama 3 with UnSloth
00:46 Stages of Model Training
02:21 Supervised Fine-Tuning Techniques
04:43 Setting Up the Training Environment
06:07 Understanding LoRa and QLoRa
09:15 Data Preparation for Fine-Tuning
10:51 Training and Inference
12:46 Saving and Loading Models
13:40 UnSloth’s Chat UI Demo
14:44 Conclusion and Next Steps

All Interesting Videos:
Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr

Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw

Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw

AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z   Read More Prompt Engineering 

#AI #promptengineering

You May Also Like

More From Author

+ There are no comments

Add yours