www.fileedge.com
Search Software
Reviews | Awards | Top 100 | New & Updated

Crawlers

Programs 1-10 of 10 Pages: 1
Reduce the need for user clients to recache your web pages and saving bandwidth
Create Snazzy Google Sitemaps in Seconds
KeyWord generator is free powerfull tool to generate keywords and save them
ETagFix 1.00
ETagFix is an ISAPI plugin which integrates directly into IIS and other web servers to alter the etag that IIS produces so that web crawlers will not check your web site so often.
10 / 10
CoffeeCup Google SiteMapper 4.5
By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly.
6 / 10
KeyWord Generator lite 1.0.0
KeyWord generator is free powerfull tool to generate keywords and save them. Using KeyWord generator lite you can generate more than 100 keywords and use them in your meta tags, titles or content of your web page.
Review by Roy: Great soft... And free :) I like it very much. It generates keyWords very fast :) (5/5 - 3-Dec-2005)
5 / 10
Fake Referrals 2.1.0
Why do you need Fake Referrals? Have you ever seen sites with 'last 10 referrers' area? Just go to Yahoo! and input this query string 'link:http://cialis-online-buy.surf.to'. Just withit any of those results. You will see referrer window there.
5 / 10
Robot-Manager 3.1
Manage and track visits by robots, spiders and crawlers to your website. Identify which spiders visited, when they visited, and what pages they indexed. Direct spiders to your most important pages, and exclude them from non-public pages. Easy to use
4 / 10
StatsNow 2.2
StatsNow is the ultimate live statistics program giving you a real time view of your visitors currently on your Web site(s), what pages they have visited, who referred them and a whole lot more!
3 / 10
Robots.txt 2.0
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the Robots.txt files, required to instruct search engine spiders, which parts of a Web site are not to be indexed
2 / 10
InnerPeace Webmaster ToolKit - Assorted Utilities 2.10.04
The InnerPeace WebMaster Toolkit is a collection of tools assembeled and made by the Webmasters of InnerPeace. Some of these essensial tools are not available anywhere else. Easy to use. Runs on any O/S: Windows, Mac, Unix, etc. License: GNU GPL.
2 / 10
EScrambler - Webmaster Antispam Utility 2.10.04
Email address code scrambler. Fight spam. Hide email addresses from spam robots. Your visitors can read and click on your email addresses the same way they do now. Robots will not find them. Stay off spam lists. Search engine friendly. Easy to use.
2 / 10
Web Scraper Plus+: Web Spider Edition 5.0.0
Build a custom web spider / web crawler using web data extraction / screen scraping technology. Use the web extract for web data mining of contact lists, product catalogs, government databases, real estate listings, or build a custom email extractor.
2 / 10
Programs 1-10 of 10 Pages: 1