scrappy
powerful web spidering, scraping, creeping crawling framework
Install
- All systems
-
curl cmd.cat/scrappy.sh
- Debian
-
apt-get install libscrappy-perl - Ubuntu
-
apt-get install libscrappy-perl - Kali Linux
-
apt-get install libscrappy-perl - Windows (WSL2)
-
sudo apt-get updatesudo apt-get install libscrappy-perl - Raspbian
-
apt-get install libscrappy-perl - Dockerfile
- dockerfile.run/scrappy
libscrappy-perl
powerful web spidering, scraping, creeping crawling framework
Scrappy is an easy (and hopefully fun) way of scraping, spidering, and/or harvesting information from web pages, web services, and more. Scrappy is a feature rich, flexible, intelligent web automation tool.