Wget
From KevinWiki
(Difference between revisions)
(New page: Category:Network ==Download File== -To download a file from the web site secured by SSL and requires username and password. <pre> wget --no-check-certificate --http-user=<username> --h...) |
|||
| Line 5: | Line 5: | ||
wget --no-check-certificate --http-user=<username> --http-password=<password> https://site.url.com ~/<location to save> | wget --no-check-certificate --http-user=<username> --http-password=<password> https://site.url.com ~/<location to save> | ||
</pre> | </pre> | ||
| + | |||
| + | |||
| + | -To download an entire website | ||
| + | wget --wait=20 --limit-rate=20K -r -p -U Mozilla http://www.somesite.com | ||
| + | |||
| + | --wait=20: 20 seconds between retrievals. | ||
| + | --limit-rate=20K: limit download rate to 20KBps (=20: 20Bps / =20K: 20KBps) | ||
| + | -r: download recursively | ||
| + | -p: --page-requisites get all images, etc. needed to display HTML page | ||
| + | -U: set user-agent (e.g. -U Mozilla: user-agent is Mozilla) | ||
| + | |||
| + | ==References== | ||
| + | http://linuxreviews.org/quicktips/wget/ | ||
Latest revision as of 16:22, 14 May 2010
Download File
-To download a file from the web site secured by SSL and requires username and password.
wget --no-check-certificate --http-user=<username> --http-password=<password> https://site.url.com ~/<location to save>
-To download an entire website
wget --wait=20 --limit-rate=20K -r -p -U Mozilla http://www.somesite.com --wait=20: 20 seconds between retrievals. --limit-rate=20K: limit download rate to 20KBps (=20: 20Bps / =20K: 20KBps) -r: download recursively -p: --page-requisites get all images, etc. needed to display HTML page -U: set user-agent (e.g. -U Mozilla: user-agent is Mozilla)
