Submit Program | Contact us
downloads programs from a to z
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create th
Search:
 » Home » Development » Web » Robots.txt 2.0
Company: NetPromoter
License: Shareware
Version: 2.0
System: Win 98/ME/NT/2000/XP
Size: 2870KB
Date Released: September 19, 2005
Price: $99.90
Screenshot: Click here to see Screenshot
Downloads: 1211
Homepage: http://pagepromoter.com
Date added: Sep 23, 2005
Click here to Download
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.

The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.

By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

NEWS

So far, nothing for that!

RECOMMENDED DOWNLOADS IN THIS CATEGORY

 » Home  » Development » Web (10) Select page: [1]
 » Atrise HTMLock Commercial License latest
HTMLock allows you to create password protected HTML pages and hide HTML source of your pages. With this tool you can encrypt HTML pages and place them on your web site, CD, DVD, or hard drive. You can password protect HTML and text files. Key features: a ...
Atrise.com | 0 | Win 95/NT/2000/XP/98/ME | $24.95 | Downloads: 1212
Date added: Sep 23, 2005 |  » Details
 » Atrise Everyfind Database Update License
Everyfind allows you to design a website search engine script for your web site, CD, DVD or any portable documentation. This website search software does not require server side execution access and can run virtually anywhere. Key features: wildcard and b ...
Atrise.com | 0 | Win 95/NT/2000/XP/98/ME | $24.95 | Downloads: 1238
Date added: Sep 23, 2005 |  » Details
 » mnoGoSearch Pro for Windows 3.1.15
Search engine designed to provide search on Intranet or public Web sites so customers and visitors can quickly find and access virtually any information on a site or multiple sites. With mnoGoSearch it is possible to build and maintain various subject-ori ...
Mnogosearch.org | 0 | Win 95/NT/2000/XP/98/ME | $699 | Downloads: 1247
Date added: Sep 23, 2005 |  » Details
 » HTML Guardian Professional Edition 6
Encrypt ASP code, protect images on your website, encrypt Javascript and VBsript, encrypt HTML code Protware`s HTML Guardian is a total website protection solution. It will encrypt asp, protect html and javascript / vbscript source and make impossible ...
Protware.com | 0 | Win 95/NT/2000/XP/98/ME | $40 | Downloads: 1304
Date added: Sep 23, 2005 |  » Details
 » ApacheTray 1.7
ApacheTray adds convenience to your everyday job with Apache HTTP Server. Now you can start, stop and restart Apache for Win32 with one click. And this is not all. Also you can run other programs at Apache start, stop and restart. Main features Icon in ...
Apachetray.com | 0 | Win 95/NT/2000/XP/98/ME | $14.95 | Downloads: 1248
Date added: Sep 23, 2005 |  » Details
 » CF Forum - Single Domain - Encrypted Source 2.1
This is a fully customizable bulletin board / discussion forum application. The administrator can change images,colors,fonts,and many other variables. Administrators have total control to edit/delete/move threads. Too many features to list. Create unlimit ...
Cfcode.com | 0 | Win 95Unix / Linux /NT/2000/98 | $100 | Downloads: 2318
Date added: Sep 23, 2005 |  » Details
 » Atrise Everyfind Content Provider License latest
Everyfind allows you to design a website search engine script for your web site, CD, DVD or any portable documentation. This website search software does not require server side execution access and can run virtually anywhere. Key features: wildcard and b ...
Atrise.com | 0 | Win 95/NT/2000/XP/98/ME | $419.95 | Downloads: 1229
Date added: Sep 23, 2005 |  » Details
 » Arclab MailMe! Pro 3.0
Arclab MailMe! Pro is a CGI (Common Gateway Interface) executable designed to automatically process information from web page forms and send the results of a submitted form as an email message. MailMe! Pro can be integrated with existing web pages and cat ...
Arclab.com | 0 | Win 95/2000/98/ME | E85.34 | Downloads: 1248
Date added: Sep 23, 2005 |  » Details
 » FasterPage Solo (non commercial use) 1.2
FasterPage Solo compresses any HTML file to around half it`s original size, doubling your web site speed and halving bandwidth charges. The compressed file simply uncompresses itself in the user`s browser resulting in exactly the same HTML tags, formattin ...
Fasterpage.com | 0 | Win 95MS DOS /98/ME | $49 | Downloads: 1349
Date added: Sep 23, 2005 |  » Details
 » FasterPage Solo (commercial use) 1.2
FasterPage Solo compresses any HTML file to around half it`s original size, doubling your web site speed and halving bandwidth charges. The compressed file simply uncompresses itself in the user`s browser resulting in exactly the same HTML tags, formattin ...
Fasterpage.com | 0 | Win 95MS DOS /98/ME | $99 | Downloads: 1243
Date added: Sep 23, 2005 |  » Details
 » Stepsfollow-installer 4.1
Stepsfollow (free php-script) is an graphical statistics script. It shows how your visitors surf through your website. It reports: browser type, OS, host, ip-number, visitors (per hour, day, month, summary), the most entered and exit-pages, the most visit ...
Screenheads.de | 0 | Win 95/NT/2000/XP/98/ME | $15 | Downloads: 1244
Date added: Sep 23, 2005 |  » Details
 » ScriptWorx 5.0 Standard 5.0
ScriptWorx provides a business-software style interface for a powerful HTML editor, for creating dynamic pages using JavaScript and Dynamic HTML. With plenty of templates, help topics and even a web server, ScriptWorx 5 is ideal for the SOHO web developer ...
Softlite.net | 0 | Win 95/NT/2000/XP/98/ME | $35 | Downloads: 1236
Date added: Sep 23, 2005 |  » Details
 » Teaching Templates 2-User License 2.1.0
Teaching Templates - a set of authoring tools for creating interactive exercises,test and quizzes.The exercises can be put on a Web page, or run as standalone programs at home or in the classroom. ...
Tac-soft.com | 0 | Win 95/NT/2000/XP/98/ME | $39.95 | Downloads: 1214
Date added: Sep 23, 2005 |  » Details
 » Teaching Templates 3-User License 2.1.0
Teaching Templates - a set of authoring tools for creating interactive exercises,test and quizzes.The exercises can be put on a Web page, or run as standalone programs at home or in the classroom. ...
Tac-soft.com | 0 | Win 95/NT/2000/XP/98/ME | $49.95 | Downloads: 1175
Date added: Sep 23, 2005 |  » Details
 » Teaching Templates Site License 2.1.0
Teaching Templates - a set of authoring tools for creating interactive exercises,test and quizzes.The exercises can be put on a Web page, or run as standalone programs at home or in the classroom. ...
Tac-soft.com | 0 | Win 95/NT/2000/XP/98/ME | $89.95 | Downloads: 1124
Date added: Sep 23, 2005 |  » Details
 » HP-G Membership unlimited 2.0
That`s the HP-G Online Membership : · unlimited lifetime access to thousands of   webgraphics, interfaces, flash-animations, templates,   sounds, tutorials and much more.. · Licence-free use of our content for privat ...
Homepage-grafiken.de | 0 | Platform independent | E50 | Downloads: 1182
Date added: Sep 23, 2005 |  » Details
 » Die HP-G BIG PACK V-5 CD ROM 5.0
The BIG PACK 5 ( WIN & MAC compatible )CD ROM contains huge resources for all your webdesign needs If you pursue this CD you get our lifetime online-membership for free ! As an online-member you will have access to all new features and updates we ...
Homepage-grafiken.de | 0 | Win 95Macintosh /NT/2000/XP/98 | E68 | Downloads: 1300
Date added: Sep 23, 2005 |  » Details
 » IISTracer monitoring tool - Datacenter/ISP license 2.5
      Lets you work with uploads and forms (application/x-www-form-urlencoded and multipart/form-data) with maximum of 2GB size in ASP. Contains one-click multiple files/folders download with on-the-fly compression (Using ...
Pstruh.cz | 0 | Win 95/NT/2000/XP/98/ME | $790 | Downloads: 1199
Date added: Sep 23, 2005 |  » Details
 » Web Protector 2.0 Multi-User Licenses 2.0
Web Protector protects your Web pages from unauthorized cloning or Internet theft. Protection includes HTML code, JavaScript, VBscript, text, links, and graphics. It encrypts your Web pages with up to six encryption schemes and renders the source code unr ...
Protecthtml.com | 0 | Win 95/NT/2000/98/ME | $39.95 | Downloads: 1244
Date added: Sep 23, 2005 |  » Details
 » ZOOMImage Enterprise Edition 4.0
ZOOMImage is a Server-technology, which allows you to show detailed and high-resolution images on the intranet or internet fast and without the need for plug-In`s. This makes ZOOMImage an ideal tool to visualize image based information and products in ...
Mind-link.com | 0 | Win NT/2000 | E6499 | Downloads: 1258
Date added: Sep 23, 2005 |  » Details
go to top Select page: [1]
What Font is | fonts | free fonts | download fonts | free fonts download | web fonts |