Crawler Master X
Unique and highly powerful customized crawling system for creating large Google-indexed sites with over 1 million content pages and over 10,000 unique visitors from Google a day. Includes open-source crawling framework, 10+ custom crawlers for different p
by Regios Inc
The developer's website is no longer available.