CrawlerLib.Engine Namespace |
Class | Description | |
---|---|---|
AccessPathAdressBlock |
A block of AccessPathAddressBase based addresses with a AccessPathManager name.
| |
AccessPathManagerOperationsInfo |
Operations Info about an AccessPathManager | |
CachedValue ItemType |
A cached value which is updated via delegate on the getter
| |
CrawlerEngine |
The crawler engine
| |
CrawlerEngineConfig |
The crawler engine configuration
| |
CrawlerEngineEventArgs |
The crawler engine event args.
| |
CrawlerEngineOperationsInfo |
The crawler engine operations info.
| |
DatacenterAddress |
The datacenter address.
| |
DnsServerAddress |
The dns server address.
| |
ElapsedTimeSlicer |
Cuts elapsed time into slices
| |
ExceptionInfo |
Information about a exception
| |
GroupingTag | ||
LicenseException |
Represents an licensing error
| |
LicenseInfo |
License information about the found license
| |
LongestDurationQueue ItemType |
Queues items according to their duration. Items with longer duration displace items with shorter duration Newer
Items with same duration displace older items
| |
MaxCostsExceededException |
Represents a maximum costs exceeded error
| |
MaxDownloadSizeExceededException |
Represents a maximum download size exceeded error
| |
NotAllowedServerHeaderException |
Represents a not allowed server header error
| |
NoTaskProcessingBuffer | ||
OperationTimeoutException |
Represents an operation timeout error
| |
ProxyAddress |
The proxy address.
| |
ResponseTimeoutException |
Represents a response timeout error
| |
TaskBase |
Base class for tasks that can be processed by a CrawlerEngine | |
TaskFactoryBase | ||
TaskProcessor | ||
TaskProcessor TaskFactoryId | ||
TaskProcessorConfig | ||
TaskRequestBase |
The task request base.
| |
TaskResultBase |
The task result base.
| |
TaskSourceBase |
Structure | Description | |
---|---|---|
TickDuration |
A duration based on TickTimestamp comparisons.
| |
TickTimestamp |
A TickCount based timestamp, which is much faster than using Now |
Interface | Description | |
---|---|---|
ITaskFactory | ||
ITaskProcessingBuffer | ||
ITaskSource |
Delegate | Description | |
---|---|---|
CachedValue ItemType GetCurrentValueDelegate |
The get current value delegate.
| |
CrawlerEngineConfig LogMessageDelegate |
The log message delegate.
|
Enumeration | Description | |
---|---|---|
ConcurrencyEnum | ||
LicenseInfo LicenseTypeEnum |
The license type enumeration.
| |
ProxyAnonymityEnum |
The proxy anonymity enum.
|