Skip to content

Files

Latest commit

220bee2 · Mar 25, 2023

History

History
25 lines (17 loc) · 801 Bytes

README.md

File metadata and controls

25 lines (17 loc) · 801 Bytes

Python Web Scraper

This Python code scrapes data from any table contained in a website using BeautifulSoup and Pandas.

Requirements

  • Python3
  • BeautifulSoup
  • Pandas
  • requests
  • dotenv
  • smptlib
  • ssl

Installation

  • To install the required libraries, run the following command ina terminal in your application:

    pip install beautifulsoup4 pandas requests python-dotenv

Usage

  • run the scraped_data.pyfile. It will scrape data from the website indicate at URL.
  • If there are a number of tables on the webpage you wish to scrape, indicate the desire tables number using indexing starting from 0 in the bracket located at dframe.
  • once the scrape is done it will rename it with the current date and time the scrape occured and send an email to a designated email address.