Difference between revisions of "wget directory listing"
From thelinuxwiki
(Created page with "wget --spider -r --no-parent https://www.example.com/ --spider When invoked with this option, Wget will behave as a Web spider, which means that it will not download th...") |
Revision as of 17:24, 6 March 2021
wget --spider -r --no-parent https://www.example.com/
--spider When invoked with this option, Wget will behave as a Web spider, which means that it will not download the pages, just check that they are there. For example, you can use Wget to check your bookmarks:
wget --spider --force-html -i bookmarks.html
This feature needs much more work for Wget to get close to the functionality of real web spiders.
