Parallel Web Crawler (PCrawler)

     PCrawler is Parallel Web Crawler using Task Parallel Library (TPL) . This project created for demonstrate a new Parallel programming style using .net and TPL api. Every one you can download this project and reengineering.
  The Task Parallel Library (TPL) is a set of public types and APIs in the System.Threading and System.Threading.Tasks namespaces in the .NET Framework 4. The purpose of the TPL is to make developers more productive by simplifying the process of adding parallelism and concurrency to applications. The TPL scales the degree of concurrency dynamically to most efficiently use all the processors that are available. In addition, the TPL handles the partitioning of the work, the scheduling of threads on the ThreadPool, cancellation support, state management, and other low-level details. By using TPL, you can maximize the performance of your code while focusing on the work that your program is designed to accomplish. 


  • .net 4.5 or higher
  • MS SQL Server 2012 or higher
  • Multicore cpu for testing
  • Internet


Author : Bill M.Geronatsios

Last edited Oct 27, 2013 at 1:13 PM by Geronatsios, version 14