Amazon-Web-Scraper

A comprehensive set of Jupyter notebooks for scraping data from Amazon. Extract product details, prices, ratings, and table data efficiently. Perfect for data analysis, research, and e-commerce insights. Easy setup and use with detailed documentation and examples.

Overview

This project includes Jupyter notebooks designed to scrape data from Amazon's website. The goal is to extract relevant information from product pages and tables for further analysis.

Notebooks

• Amazon Web Scraper Project.ipynb: A comprehensive notebook for scraping product details from Amazon.
• Scraping a Table from a Website (FINAL).ipynb: A final version of a notebook that focuses on scraping table data from a website.

Features

• Extract product names, prices, ratings, and other details from Amazon product pages.
• Scrape table data efficiently for structured information.
• Handle pagination and dynamic content loading.

Requirements

• Python 3.x
• Jupyter Notebook
• BeautifulSoup
• Requests
• Pandas
• Selenium (if applicable)

Setup

1. Clone the repository:

   git clone https://github.com/yourusername/Amazon-Web-Scraper.git
   

2. Install the required packages:

   pip install -r requirements.txt
   

3. Open the Jupyter notebooks:

   jupyter notebook
   

Usage

1. Open Amazon Web Scraper Project.ipynb or Scraping a Table from a Website (FINAL).ipynb.
2. Run the cells to execute the scraping scripts.
3. Modify the parameters as needed for different product searches or table data.

Contributing

1. Fork the repository.
2. Create a new branch (git checkout -b feature-branch).
3. Commit your changes (git commit -am 'Add new feature').
4. Push to the branch (git push origin feature-branch).
5. Create a new Pull Request.

License

This project is licensed under the MIT License.

Acknowledgments

• BeautifulSoup
• Pandas
• Requests

Necessary Files

pycache/ .ipynb_checkpoints/ .env *.pyc *.pyo *.pyd

requirements.txt:

List of required packages beautifulsoup4 requests pandas selenium # If your scripts use Selenium

Repository Structure

Amazon-Web-Scraper/ │ ├── Amazon Web Scraper Project.ipynb ├── Scraping a Table from a Website (FINAL).ipynb ├── README.md ├── requirements.txt