I need a utility that can search through the internet site, starting at particular address (e.g. [[login to view URL]][1]) and download files of predefined extensions, when those are found. The robot should be similar to the crawler, that goes from one url to another, just no need to crawl any data.
Downloaded files should be save on the local drive
Predefined extensions are docx, xlsx, et., and should be configurable via .config file.
The utility should be written in C# and delivered as VS solution