Web Development Cloning sites with terminal [wget]

Joined
Dec 29, 2021
Messages
29
Hellcoins
♆711
The simplest use -
, a little more difficult -
QUOTE:
wget -r -k -i 10 -p -E -nc http://site.domain
example more details
wget -r -k -l 9 -p -E -np -e robots=off -U mozilla -np https://site.domain
-r Enable recursive download.
-k After download is complete, convert links in document for offline viewing
-l 0 Maximum recursive download depth
-p Download all files needed to display HTML pages
-E If downloaded file type is text/html and its address does not end with \. [Hh][Tt][Mm][Ll]? .html will be appended to its name
-np Don't rise above the start address when loading recursively.
-nc If the connection is lost while loading the site, specify this parameter to continue from the same place.
-e robots=off - do not use robots.txt
-U mozilla - how to introduce yourself
 
Top