http://www.tbaygeek.org
david wilson
Ambassador
1,463 posts
Online Now
is there a good robot.txt generator out there or a way of doing this in CC ??
Volunteering to help
http://www.tbaygeek.org
http://www.tbaygeek.org
Mark Searson
Senior Advisor
3,694 posts
David
I am not sure that this is something that CC can do, however, I would be happy to be proved wrong. However, this site has an online generator that can be freely used
http://www.1-hit.com/all-in-one/tool-ro … erator.htm
Another
http://www.webtoolcentral.com/webmaster … generator/
It realy depends on what function you wanted your robot.txt to perform as to what you should be looking at. Is it to try and stop nasty people expoliting your site, or perhaps as a promotion tool. You may wish to look at this site as a source for further info http://webseodesign.com/resources/robots-txt-files.htm
I hope that some of this helps.
Mark Mark Loves CoffeeCup
I am not sure that this is something that CC can do, however, I would be happy to be proved wrong. However, this site has an online generator that can be freely used
http://www.1-hit.com/all-in-one/tool-ro … erator.htm
Another
http://www.webtoolcentral.com/webmaster … generator/
It realy depends on what function you wanted your robot.txt to perform as to what you should be looking at. Is it to try and stop nasty people expoliting your site, or perhaps as a promotion tool. You may wish to look at this site as a source for further info http://webseodesign.com/resources/robots-txt-files.htm
I hope that some of this helps.
Mark Mark Loves CoffeeCup
Mike
Senior Advisor
1,172 posts
Here is one for purchase that does quite a bit
http://www.rietta.com/robogen/
Mike... ..........................................
http://www.photoshopuser.com/register.h … ode=friend
http://www.designconsultingltd.com
http://www.wpdfd.com
http://www.rietta.com/robogen/
Mike... ..........................................
http://www.photoshopuser.com/register.h … ode=friend
http://www.designconsultingltd.com
http://www.wpdfd.com
Mark Searson
Senior Advisor
3,694 posts
There you go Mike, you have just shown everybody how cheap I am!
Mark Loves CoffeeCup
Have something to add? We’d love to hear it!
You must have an account to participate. Please Sign In Here, then join the conversation.
