Loading repository data…
Ananya0902 / repository
Develop a web scraping website that dynamically extracts and displays comprehensive product information from Amazon, including titles, prices, availability, images, and descriptions.
A transparent discovery signal based on current public GitHub metadata.
This score does not audit code, security, maintainers, documentation quality, or suitability. Verify the repository and its current documentation before adoption.
Welcome to our Web Scraping Project repository! This project aims to demonstrate web scraping of Amazon products using Node.js and various tools like ScraperAPI and Cheerio.
This project showcases how to scrape product details from Amazon using a Node.js backend. It includes functionalities to fetch product data, store it in a database, and display it on a web interface. The scraping process utilizes ScraperAPI for fetching dynamic content and Cheerio for parsing HTML.
Clone the repository:
git clone <repository-url>
cd web-scraping-project
Install dependencies:
npm install
Set up environment variables:
.env file in the root directory.PORT=3000
MONGODB_URI=<your-mongodb-uri>
SCRAPER_API_KEY=<your-scraperapi-key>
SMTP_HOST=<your-smtp-host>
SMTP_PORT=<your-smtp-port>
SMTP_USER=<your-smtp-user>
SMTP_PASS=<your-smtp-password>
Start the server:
npm start
Open your browser and go to:
http://localhost:3000
Scrape a product:
Selected from shared topics, language and repository description—not editorial ratings.
Rotaralexc /
Developed using Next.js and Bright Data's webunlocker, this e-commerce product scraping site is designed to assist users in making informed decisions. It notifies users when a product drops in price and helps competitors by alerting them when the product is out of stock, all managed through cron jobs.
31/100 healthContributions are welcome! Please follow these steps to contribute:
git checkout -b feature/improvement).git commit -am 'Add new feature').git push origin feature/improvement).This project is licensed under the MIT License - see the LICENSE file for details.
### Notes:
- **Environment Variables**: Make sure to replace placeholders like `<your-mongodb-uri>`, `<your-scraperapi-key>`, `<your-smtp-host>`, `<your-smtp-port>`, `<your-smtp-user>`, and `<your-smtp-password>` with actual values from your environment setup.