659b25481e
(we want to avoid hanging crawls forever, but we don't want to prevent the downloading of large files from very slow hosts.)