Separate out download code from the rest. Re-do the download code to store URLs alongside HTML, and add support for resuming from the last-seen URL. |
||
|---|---|---|
| .. | ||
| download.js | ||
| track-rejections.js | ||
| worm-scraper.js | ||
Separate out download code from the rest. Re-do the download code to store URLs alongside HTML, and add support for resuming from the last-seen URL. |
||
|---|---|---|
| .. | ||
| download.js | ||
| track-rejections.js | ||
| worm-scraper.js | ||