On Ubuntu 14.04.1 or newer:
sudo apt-get install --no-install-recommends build-essential python3-dev python3-pip
pip3 install --user wpull manhole lmdb
git clone https://github.com/ludios/grab-site
Usage:
./grab-site URL
./grab-site URL --ignore-sets blogs,forums
Note: --ignore-sets=
with =
will not work.
License:
This repo is almost entirely code from ArchiveBot, please see the ArchiveBot license.
Description
Languages
Python
50.7%
HTML
47.2%
Shell
2.1%