The Complete Web Scraping Course with Projects 2019
Become a Professional Web Scraper | Learn how to scrape websites and obtain useful data by using Selenium and NodeJS
Course Curriculum
- Lec 1 What is NodeJS (4:11)
- Lec 2 Installing NodeJS (3:02)
- Lec 3 NPM (6:39)
- Lec 4 Editor (1:39)
- Lec 5 Scraping Parts (2:46)
- Lec 6 Driver (4:32)
- Lec 7 Seleinum Elements (3:42)
- Lec 8 Selenium methods (2:26)
- Lec 9 Basic Scrape (7:26)
- Lec 10 Selenium wait (3:27)
- Lec 11 Quiting Browser (3:51)
- Lec 12 Writing Method (16:11)
- Lec 13 Exception Handling (14:01)
- Lec 14 ScreenShot (9:51)
- lec 14.1 Project Division (1:58)
- Lec 15 1st Project Preview (2:49)
- Lec 16 Getting Language id (15:30)
- Lec 17 Getting Language Related to Array (7:00)
- Lec 18 Creating Language File (7:29)
- Lec 19 Deleting Existing File (5:07)
- Lec 20 Removing Bug and Running the Process in BackGround (6:56)
- Lec 21 Building Scrape File (9:36)
- Lec 22 Scrape GoogleTranslate Function Part 1 (6:50)
- Lec 23 Scrape GoogleTranslate Function Part 2 (14:50)
- Lec 24 Adding Data to CSV File (5:33)
- Lec 25 Limiting the Characters according to Google (5:54)
- Lec 26 Adding Delays (5:34)
- Lec 27 Final Testing (3:41)
- 1 Google Translate 2019 Preview (2:10)
- 2 Opening Language Box (8:02)
- 3 Getting Class (14:40)
- 4 Getting Language Id (10:56)
- 5 Getting Name (18:32)
- 6 Creating File (9:25)
- 7 Deleting Existing File (7:47)
- 8 Reading Client CSV File (9:36)
- 9 Starting Scrape function (7:29)
- 10 Running Script (16:31)
- 11 Exception Handling (10:08)
- 12 Limiting Translation Content (3:56)
- 13 Saving Output Data for Client (10:06)
- 14 Adding Delay Factor and Testing (11:20)
- Lec 28 2nd Project Preview (3:56)
- Lec 29 Understanding Test Cases (5:41)
- Lec 30 Adding Const and Variables (6:22)
- Lec 31 Looping Params (4:47)
- Lec 32 Executing Test Case and Sending it to Index.JS file (11:00)
- Lec 34 Starting Index File (13:10)
- Lec 35 Convert Date Function (7:17)
- Lec 36 Selecting 1st Two Fields (6:05)
- Lec 37 Trip Duration (9:23)
- Lec 38 Finishing Current Page (9:19)
- Lec 39 Compiling Results (13:14)
- lec 40 Appending to CSV File (4:36)
- lec 41 Debugging (16:42)
- lec 42 Final Testing Travel Pro (7:33)
- Goodbye (0:48)
Web scraping is the Data Science technique of gathering or storing useful and public information from websites in a suitable format like spreadsheets that can be used later for any purpose. It basically removes the burden of copying the data manually, instead it provides an automated way to do it.
The data extraction is done from websites using some sort of a code written called “scraper” which takes the a Web URL, parses the HTML DOM of that site and then return the result which we can save in some format say CSV for future use. The data that we parse can be in form of texts, images, package names and their corresponding prices, videos and contact information like email, name, phone numbers and so on.
This course is built in NODEJS that is light weight, efficient, and scale-able due to its non-blocking I/O and event driven. The main advantage of node is that its asynchronous in nature which means that you don’t have to wait for a request to complete before making another one which in turn provides a very high performance. This course is made in so much easy way so that one who doesn’t have any knowledge of NODEJS can easily understand and hence build own scraper in NODEJS.
We are using Selenium which is automation testing tool that provides various elements and methods to interact with HTML DOM in order to parse the website.
This course is divided into 3 parts
- Setting up the environment
- Building Blocks and Syntax
- Projects
In the Project Section course will cover 3 Projects
- Google Translate 2018 Project
- Google Translate 2019 Project
- Travel Insurance Website Project
Bonuses:
- Reading Data from CSV File
- How to Save scraped Data into New CSV file
- How to apply Validations
This course offers you a 30 Days Money Back Guarantee, in case if the course does not meet your expectations you can get a full re-fund immediately . Also i will answer all of your questions on top priority.
Now if you want to learn Web Scraping by building projects and start your professional career, Take this course now
Note :
- Basic HTML Knowledge required.
- Basic Programming Knowledge required.
- No Knowledge of NodeJS required.