Abotx

AbotX is a powerful C# web crawler that makes advanced crawling features simple to use. Parallel Crawler Engine A single site can crawl quickly. If you need to crawl 10,000 websites, you will need the ParallelCrawlerEngine. It permits several websites concurrently to crawl to optimize throughput.Easy Override Easy Override lets you readily plugin ...