Robot.txt generator - Post ID 23970

User 184085 Photo


Ambassador
1,707 posts

is there a good robot.txt generator out there or a way of doing this in CC ??
Volunteering to help :)
http://www.tbaygeek.ca
My HTML play area
http://www.tbaygeek.ca/test/
User 51909 Photo


Registered User
3,694 posts

David

I am not sure that this is something that CC can do, however, I would be happy to be proved wrong. However, this site has an online generator that can be freely used

http://www.1-hit.com/all-in-one/tool-ro … erator.htm

Another
http://www.webtoolcentral.com/webmaster … generator/


It realy depends on what function you wanted your robot.txt to perform as to what you should be looking at. Is it to try and stop nasty people expoliting your site, or perhaps as a promotion tool. You may wish to look at this site as a source for further info http://webseodesign.com/resources/robots-txt-files.htm

I hope that some of this helps.

Mark
Mark Loves CoffeeCup
User 42578 Photo


Ambassador
1,176 posts

Here is one for purchase that does quite a bit

http://www.rietta.com/robogen/

Mike...
..........................................
http://www.wpdfd.com
User 51909 Photo


Registered User
3,694 posts

There you go Mike, you have just shown everybody how cheap I am!
Mark Loves CoffeeCup

Have something to add? We’d love to hear it!
You must have an account to participate. Please Sign In Here, then join the conversation.