Some  content of site/page is rendered with using Javascript/Ajax.
Actually Crawler lib Engine does not have a Javascript rendering engine.

Maybe a solution would be to use CefSharp (eg CefSharp OffScreen ) in Crawler Lib Engine to enable Javascript and Ajax rendering?

Christian.

That means to go away from HttpRequest / HtmlAgilityPack and use a browser to render a page. It is not very hard to program workflow elements that can do this. But at the moment I have absolutely no time to do such a project without a customer paying for it.

The Crawler-Lib Engine is completely extendable. I've shown how to use the LinqToTwitter API to build a twitter workflow element:  
http://www.crawler-lib.net/twitter-crawler-status-anlyzer

Anybody could build own workflow elements to support certain technologies or APIs

Tom,

Class to create a CefSharp Chromium Web Browser workflow element may be like this

using System;

using CefSharp;
using CefSharp.OffScreen;

using CrawlerLib.Engine.Workflow;
using CrawlerLib.Engine.Workflow.Http;

    public class ChromiumWebBrowserRequest : ProcessableWorkflowChildBase
    {
        private bool disposedValue;
        private ChromiumWebBrowser _browser;

        public ChromiumWebBrowserRequest(HttpRequestConfig requestconfig)
        {
            Cef.Initialize(new CefSettings());
        }

        protected override void Abort()
        {
             // TODO
        }

        protected override void Process()
        {
             // TODO
        }

        protected override ProcessingInfoBase GetProcessingInfo()
        {
             // TODO
            return null;
        }

        protected override async void StartWork()
        {
             // TODO
        }

        protected virtual void Dispose(bool disposing) 
        {
            if (!this.disposedValue) {
                if (disposing) {
                    _browser.Dispose();
                    Cef.Shutdown();
                }
            }
            this.disposedValue = true;
        }
    }

Ok, I will check how to integrate CEF and integrate it if possible.
Regards Tom

After some research, I decide to use CefGlue instead of CefSharp for headless operations, because it supports all that low level stuff we need here.

Nevertheless this is quite hard to implement, because the Crawler-Lib Engine has to deal with different configurations and platforms (32Bit / 64Bit). In fact this is only solvable with an AppDomain. It will take a moment to implement this in a flexible way.

    

I am at your disposal to carry out tests this development

nfl vikings jerseys, lunette ray ban pas cher, abercrombie fitch, hollister clothing store, adidas shoes, coach factory, juicy couture clothings, michael kors, oakley sunglasses cheap, new balance outlet, nfl lions jerseys, ralph lauren, rolex watches, mcm handbags, nfl broncos jerseys, kate spade outlet online, ralph lauren, nfl bears jerseys, barbour jackets, tory burch sale, burberry outlet online, replica handbags, ray bans, longchamp handbags, ray bans, mlb jerseys, burberry outlet online, replica watches, nike, air jordans, givenchy outlet online, ugg, montre femme, guess, michael kors, nhl jerseys, hogan, uggs on sale, washington wizards jerseys, dsquared2, babyliss, nfl browns jerseys, huarache, ray ban, burberry online shop, cheap michael kors, dre beats, michael kors, nike, mlb jerseys, celine bags, adidas schuhe, asics gel, longchamp, new balance, true religion jeans women, ugg australia, jimmy choo, memphis grizzlies jerseys, barbour jacket outlet, cheap oakley sunglasses, replica watches, ralph lauren outlet, uggs boots, coach factory, ray ban outlet, burberry outlet, [url=http://www.pandora.