Loading repository data…
ShahilPatel-IITDh / repository
scrapio
This repository contains a Python code for web scraping. The code is capable of extracting HTML, CSS, JavaScript, Favicons, and Screenshots from web pages. It utilizes the PhishTank library for enhanced functionality. This code was developed as part of a research paper published at IEEE SOLI 2023.
#beautifulsoup#ieee#python#scrapio#selenium#soli
Live repository statistics
★ 2Stars
⑂ 1Forks
◯ 0Open issues
◉ 2Watchers
49/100
OPENREPOHUB HEALTH SIGNAL
Mixed signals
A transparent discovery signal based on current public GitHub metadata.
Recent activity35% weight
52
Community adoption25% weight
5
Maintenance state20% weight
100
License clarity10% weight
0
Project information10% weight
100
This score does not audit code, security, maintainers, documentation quality, or suitability. Verify the repository and its current documentation before adoption.
README preview
scrapio
A Python library that is helpful in scrapping complete webpages including HTML, JavaScript, CSS, and Favicons. Just plug and play.
Webpage Content Downloader Python Library
A Python library that allows you to download the HTML, JavaScript, CSS, and favicons of a webpage. This library is useful for web scraping, archiving web pages, or analyzing web content locally.
Table of Contents
Usage
To use this code you need to install the following libraries on your system.
- pandas
- BeautifulSoup
- Selenium
- webdriver-manager
- requests
- pillow
pip install pandas
pip install beautifulsoup4
pip install selenium
pip install webdriver-manager
pip install requests
pip install pillow
Change the name of the LogFile to whatever name you require (make sure the extension is .xlsx). Change the mainPage_URL to the URL of the PhishTank page containing legitimate URLs if you want to scrape the data for legitimate or to the page containing Phishy URLs if you want to scrape the data for phishy.