We’ll show you ten wget command examples. Wget is a free utility that can be used for retrieving files using HTTP, HTTPS, and FTP which are considered as the most widely-used Internet protocols. Its name comes from World Wide Web + get. Wget has many features which makes it a very easy task when it comes to retrieving large files, recursive downloads, multiple file downloads or mirroring entire web or FTP sites. Wget is non-interactive which gives great flexibility in using it. It can be easily called from scripts, cron jobs, terminals etc. It can work in the background even if a user is not logged in. This allows you to start a file download and disconnect from the system, letting wget finish the work. In this article, we will demonstrate the use of wget through some practical examples that you can use to accomplish some of the most common tasks such as downloading files or even mirroring entire websites.
For the purpose of this demonstration, we will install wget on an Ubuntu 16.04 VPS. Please note that even though this has been tested on Ubuntu 16.04, the instructions can be used on any other Linux distribution as well.
Log in to your server and install wget
The first step is to log in to your server via SSH.
You can also make sure that your server is up to date with the following commands:
apt-get update apt-get upgrade
After the upgrades have been installed, you can then install the wget software package with the following command:
apt-get install wget
After the installation is completed, you can now start using the wget command on your server.
1. Wget Command example, to download a single file
The most common and simple usage of wget is to download a single file and store it in your current directory.
For example, to download the latest WordPress version you can use the following command:
This is the output you will get while the file is downloading:
--2017-10-14 03:46:06-- https://wordpress.org/latest.zip Resolving wordpress.org (wordpress.org)... 220.127.116.11, 18.104.22.168 Connecting to wordpress.org (wordpress.org)|22.214.171.124|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 8912693 (8.5M) [application/zip] Saving to: 'latest.zip' latest.zip 100%[=====================================================================================================>] 8.50M 5.03MB/s in 1.7s 2017-10-14 03:46:07 (5.03 MB/s) - 'latest.zip' saved [8912693/8912693]
As you can see, it also shows you the download progress, current download speed, the size, date, time and the name of the file.
In our case, this command will download the file and save it in your current directory under the “latest.zip” name.
2. Wget Command example, to download a file and save it under different name
You may want to save the file under a different name. To do this, you can use the -O option like this:
wget -O wordpress.zip https://wordpress.org/latest.zip
This will download and save the latest WordPress installation in your current directory under the name “wordpress.zip”.
3. Wget Command example, to Download a file and save it in specific directory
To download the file and save it in a different directory, you can use the -P option, for example:
wget -P /opt/wordpress https://wordpress.org/latest.zip
This will download and store the file in the /opt/wordpress directory on your server.
4. Wget Command example, to Set the download speed
If you happen to download a huge file which takes longer to complete, you can also limit the download speed to prevent wget from using the full possible bandwidth of your connection.
To limit the download speed to 300k, for example, you can use the following command:
wget --limit-rate=300k https://wordpress.org/latest.zip
5. Wget Command example, to Continue interrupted download
Sometimes, when you download a very big file which would take a longer time to complete, you may temporarily lose your internet connection and your download will get interrupted.
To avoid starting the whole download again, you can continue from where it got interrupted using the -c option:
wget -c https://wordpress.org/latest.zip
If the download is interrupted, and you start the whole download again without the -c option, wget will append “.1” to the end of the filename because the filename with the previous name already exists.
6. Wget Command example, to Download in background
For bigger files, you can also use the -b option, to download the file in the background.
wget -b http://example.com/big-file.zip
The output will be written in the “wget-log” file in the same directory, and you can always check the status of the download with the following command:
tail -f wget-log
7. Wget Command example, to Increase retry attempts
If you are having issues with your internet connection, and your download is getting interrupted multiple times, you can increase the retry attempts to download the file with the -tries option:
wget -tries=100 https://example.com/file.zip
8. Wget Command example, to Download multiple files
If you want to download multiple files at the same time, you can create a text file (for example download.txt) where you place all the URLs of the files you wish to download. To create a text file do the following:
Then you can edit the file with nano, and enter all the URLs of all the files you want to download:
http://example.com/file1.zip http://example.com/file2.zip http://example.com/file3.zip
After you save the file, you can then use the -i option to download all the files stored in that text file:
wget -i download.txt
9. Wget Command example, to Download through FTP
You can also use wget to download a file directly through FTP using a set username and password, with the following command:
wget --ftp-user=username --ftp-password=password ftp://url-to-ftp-file
10. Wget Command example, to Download entire website
You can even use wget to download an entire website, which you can then view locally, offline, without the need of internet connection. To do this you can use the following comand:
wget --mirror --convert-links --page-requisites --no-parent -P /path/to/download https://example-domain.com
With —mirror, you turn on all the options required for mirroring.
With –convert-links, you will convert all the links so they would work offline.
With –page-requisites, you download all the necessary files such as CSS style sheets and images required to properly display the pages offline.
With –no-parent, you can restrict the download only to a specific portion of the site.
Additionally, you can set the path to where we want to download the files with the -P command followed by the path to the directory.
We have covered some of the most common uses of wget command. To learn more about wget, you can always check its man page with the man wget command.
PS. If you enjoy reading our post, on Wget Command Examples, feel free to share it on social networks using the shortcuts below, or simply leave a comment.