Visual Web Spider 7.0

Visual Web Spider is a fully automated, multithreaded web crawler that allows you to index and collect specific web pages on the internet.

Visual Web Spider enables you to browse the Web in an automated manner, indexing pages that contain specific keywords and phrases and exporting the indexed data to a database on your local computer in the format of your choice.

Main Features:
- A Personal, Customizable Web crawler. Crawling rules. Multithreaded technology (up to 50 threads). Support for the robots exclusion protocol/standard (Robots.txt file and Robots META tags);
- Index the contents of any HTML tag. Indexing rules;
- Export the indexed data into Microsoft Access database, TEXT file, Excel file (CSV), HTML file, MySQL script file;
- Start crawling from a list of the URLs specified by user;
- Start crawling using keywords and phrases;
- Store web pages and media files on your local disk;
- Auto-resolve URL of redirected links;
- Detect broken links;
- Filter the indexed data;
- Command line options;
- Generate and export map of the visited links;
- Very simple to use, quick learning curve and right to the point.