Command to download a series of urls with zero padding files…

for ((i=1;i<20;i++))
do wget "http://img55.onemanga.com/mangas/00000004/00000000/Naruto-Pilot-`printf "%02d" $i`.jpg"; done
done

Use this command to download numbered content…

for ((i=1; i<9; i++)) ; do  wget "http://www.example.com/$i.txt" ; done

Show the headers of an URL from the command line. This will need perl, lwp installed on the system.

lwp-request -ed "http:/lindesk.com/"

URL Headers using Curl

Show the headers of an URL using Curl

curl http://example.com -I

wget -m http://www.tldp.org/HOWTO/Serial-Programming-HOWTO/

-m, –mirror

shortcut for -N -r -l inf –no-remove-listing.

wget -H -r --level=1 -k -p http://www.tldp.org/HOWTO/Serial-Programming-HOWTO/

-r, –recursive

Specify recursive download.

-l, –level=NUMBER

Maximum recursion depth (inf or 0 for infinite).

-k, –convert-links

Make links in downloaded HTML point to local files.

-p, –page-requisites

Get all images, etc. needed to display HTML page.

Original Article
wget Manual