http://www.kriesi.at/support/topic/exclusion-of-robots-search-engines-til-site-is-finished Support Forum - Topic: Exclusion of robots / search engines til site is finished en-US Fri, 24 May 2013 15:12:26 +0000 http://bbpress.org/?v=1.0.2 q http://www.kriesi.at/support/search.php http://www.kriesi.at/support/topic/exclusion-of-robots-search-engines-til-site-is-finished#post-28750 Thu, 06 Oct 2011 00:27:47 +0000 Chris Beard 28750@http://www.kriesi.at/support/ <p>Hey,<br /> I believe <a href="http://www.askapache.com/seo/wordpress-robotstxt-seo.html">this</a> can help you. It's not advised to deny robots/crawlers since they generate traffic, lots of it. I believe Wordpress has a built in script so drafts can't be seen. To my knowledge Newscast doesn't offer these kind of functions. </p> http://www.kriesi.at/support/topic/exclusion-of-robots-search-engines-til-site-is-finished#post-28691 Wed, 05 Oct 2011 16:14:57 +0000 daveyfifi 28691@http://www.kriesi.at/support/ <p>Can you please point me to any references on how to exclude robots and search engines from indexing an unfinished, draft site? Would it be strictly through robots.txt? Is there anything in the Newscast package that can be used?</p> <p>Also, is it useful to disallow a crawl of any of the Wordpress / Newscast directories, and is there anything prepackaged for that in the Newscast download package? </p> <p>Thank you, great template. </p>