Post Content
In this video, we will talk about web scrapping. We will use crawl4ai for scrapping websites, then use LLMs like DeepSeek and Gemini Flash to answer user queries using LLMs. We will also talk about cost and the need for data validation.
https://github.com/unclecode/crawl4ai
https://docs.crawl4ai.com/
https://beautiful-soup-4.readthedocs.io/en/latest/
https://web.lmarena.ai/leaderboard
code: https://tinyurl.com/2fuueuft
Website: https://engineerprompt.ai/
RAG Beyond Basics Course:
https://prompt-s-site.thinkific.com/courses/rag
Let’s Connect:
Discord: https://discord.com/invite/t4eYQRUcXB
Buy me a Coffee: https://ko-fi.com/promptengineering
| Patreon: https://www.patreon.com/PromptEngineering
Consulting: https://calendly.com/engineerprompt/consulting-call
Business Contact: engineerprompt@gmail.com
Become Member: http://tinyurl.com/y5h28s6h
Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off).
Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0
00:00 Introduction to Web Scraping
00:14 Traditional vs Modern Web Scraping
00:57 Setting Up Crawl for AI
01:54 Installing Necessary Packages
03:07 Cost Considerations in Web Scraping
04:32 Code Walkthrough
10:22 Using Different Models for Web Scraping
12:25 Conclusion and Next Steps Read More Prompt Engineering
#AI #promptengineering