Intersection between the Browser Automation (Selenium Web Driver) and Web Scraping (Beautiful Soup)
In this tutorial we will focus on the combination of 2 powerful libraries: Selenium & Beautiful Soup. The requirement is to navigate with Selenium Web Driver to the result page where the data is strored. In the next step we have to extrct our required data with Beautiful Soup and Requests. We will use the IMDB Movie Database for this particular project.
Especially for people who work with data it is important to be able to create own datasets. Often we rely on datasets from someone else. This course should show all data enthusiasts how to scrape and store data in Excel Files.
After this course you will have the knowledge and the experience to scrape your own data and create your own dataset. With the help of the course resources you will always have documents you can refer to. If you have a question or if a concept just does not make sense to you, you can ask your questions anytime inside the Q&A - Forum. Either the instructor or other students will answer your question. Thanks to the community you will never have the feeling to learn alone by yourself.
What you’ll learn
Web Scraping
Beautiful Soup
Data Extraction
Web Scraping for Data Science
Data Mining
Data Scraping & Data Cleaning
Selenium Web Driver
Browser Automation
Are there any course requirements or prerequisites?
Basic understanding of Python Programming
Basic Unterstanding of Beautiful Soup
Basic understanding of Selenium Web Driver
Who this course is for:
Everybody who is interested in Web Scraping, for example Data Scientists
Professionals who want to create their own dataset without being dependent on some else
People who want to understand how to combine Selenium & Beautiful Soup in one project
Disclaimer : I teach web scraping as a tutor for educational purposes. That's it.
The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.