Reply To: Google is indexing a development site

Forum White Hat SEO Google is indexing a development site Reply To: Google is indexing a development site

#9660
taylorkspencer

Remove the `disallow` rules from your `robots.txt` file, and make sure every page has `noindex` meta tags on it.

Excluding it from crawling with `robots.txt` is something that seems like a good idea, but if it’s already entered Google’s or Bing’s index, as it seems to be the case, it’ll actually ensure that it’ll never leave their index by blocking their crawlers from discovering that the pages have `noindex` tags.

Scroll to Top