Web Scraping in Python BeautifulSoup, Selenium & Scrapy 2024
Updated 2024 | 4 projects with BS4, Selenium & Scrapy | ChatGPT for web scraping
Created by Frank Andrade | 10.5 hours on-demand video course
Welcome to Web Scraping in Python BeautifulSoup, Selenium & Scrapy 2024 The most complete and project-oriented course. In this course, we’re going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
What you’ll learn
- Learn to scrape website from scratch with Beautiful Soup
- How I monetized my web scraping skills over the past 2 years
- Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)
- How to use ChatGPT for web scraping
- 4 web scraping projects (from beginner to advanced projects)
- Handle pagination with any scraping tool
- Learn to scrape JavaScript website with Selenium and Scrapy-Splash
- Store the extracted Data in MongoDb & SQLite3
- Scrape infinite scroll websites
- Login to websites using Selenium & Scrapy
Recommended Course
The Ultimate Web Scraping With Python Bootcamp 2024
Web Scraping and API Fundamentals in Python
Who this course is for:
- Anyone who wants to scrape data from any website with Beautiful Soup, Selenium, and Scrapy
- Data Scientists who want to take their skills to the next level
- Web developers looking to obtain new information or automate tasks
- Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task