The Crawler-Lib Engine is a workflow enabled task and request processor. It is currently available as NuGet package. It is the frontend of the Crawler-Lib framework, but can also be used standalone.
Zip-File package, samples and training vidoes will follow in the next days.
Is a C# or VB sample available, that shows how to crawl a website?