Different ways to use wget command in Linux

Wget is non-interactive network downloaded meaning all the download operation will run in the background. Therefore you can download any file from the Internet with wget command.
Wget also lets user to download the entire website. The download process start with simple wget command followed by the website URL. Wget supports HTTP, HTTPS and FTP protocol to download file.
Download web pages using wget
For example you want to download the front page of jijokjose.com. You can simply follow the command
wget jijokjose.com
the download start and saved your file in home directory which you can use for later off-line uses. Now lets suppose you have connection problem or the jijokjose server has some problem. Wget try to reconnect to the server 20 times by default. You can limit the reconnection limit by following command
wget -t jijokjose.com

Now the wget will try to reconnect to the server 8 times. The above will download index.html file only. What if you want to download complete website. The below command will download the website up to five level depth than the usual
wget -r jijokjose.com

To convert all the website into off-line viewer
wget –convert-links -r linux.about.com -o logfile

Download and Resume your download using Wget
Suppose you are downloading  file certainly get disconnected from the Internet. With wget you can resume you download with a command second time. Therefore wget acts as a download manager. To download the file simply open your terminal and enter the following the  command wget followed by website URL. See the example
wget URL
wget http://www.jijokjose.com/projects/images/extension/Extension%20Fetcher%20for%2032%20bit%20OS.zip
Now what if you are downloading large file for example game and you are disconnected from the server Now you have to download from the start if you haven’t use any download manager. Wget let you t o download the file from the level you have disconnected from the Internet. For that purpose use the following command line
wget -c http://www.jijokjose.com/projects/images/extension/Extension%20Fetcher%20for%2032%20bit%20OS.zip
This process will resume your download

Download the dynamic website to static local copy
What if you want to download the dynamic website made by WordPress Joomla or Durpal that has lots of stuff in database. For this purpose you can use the following command which will convert all dynamic to static web page which you can use for local uses
wget –mirror –convert-links URL
wget –mirror –convert-links jijokjose.com

Analyze HTTP request
For this purpose we will use the following command line.
wget -r –spider URL
wget -r –spider jijokjose.com

You can leave a response, or trackback from your own site.

Leave a Reply