#wget
2 one-liners with this tag.
All one-liners tagged wget
Find broken links on a website with wget --spider
$LC_ALL=C wget --spider -r -l 2 -nd -nv -w 1 -o /tmp/spider.log https://example.com/; grep -A 100 'broken link' /tmp/spider.log
Roughly measure the total size of a page with all assets
$wget -q -p -H -nd -e robots=off -P /tmp/page-weight https://example.com/; du -sh /tmp/page-weight; ls -lhS /tmp/page-weight | head -15