Download And Parse All HTML Files
Parsing Limit Per Profile Run:
Enquire Timestamp And Size For Files
Enquire Precise Info If Index Page Provides Approximate Data
Download default (index) pages for all folders
Consider Locally Existing Files Current (Don't Check For Changes)
Assume That Local Files Also Exist On Web Server
Avoid Re-Downloading Dynamic Web Pages
Links Above Initial Folder:
Links To Other Domains:
Note: the program will only go into parent folders as long as the root directory on the other (local) side is not reached.