harvestman
a flexible web crawler application
Install
- All systems
-
curl cmd.cat/harvestman.sh
- Raspbian
-
apt-get install harvestman - Dockerfile
- dockerfile.run/harvestman
harvestman
a flexible web crawler application
HarvestMan can be used to download files from websites, according to a number of user-specified rules. The latest version of HarvestMan supports as much as 60 plus customization options. HarvestMan is a console (command-line) application.