I haven't been able to find an answer to this particular situation.
I have a root domain 123.com
Addon domain is abc.com (abc.123.com)
I need to have a robots.txt file that will only allow permission to index the addon domain (abc.com)
The main domain (123.com) is used for personal files and server scripts. I do have a Scriptalicious wordPress install on the root 123.com.
I've created a new site in a subfolder of abc.com/new site.
I want to give permission to the search engine bots to search this 'abc' folder and any others that I create on this abc.com/additional sites site.
Where would I place the 'robots.txt' file..... Under the root 123.com or under the addon site abc.com?
Again. I don't want the subfolders of the root domain with the exception of the WordPress install to be searched or indexed. Everything in all the addon domains are fair game for the search engines.
And, could somebody give me an example of what the contents of the robots.txt should be, other than 'Allow'?
Thanks,
Mark
