-
robots.txt: disallow sub directory which is a sub domain directory
Posted by on August 16, 2020 at 2:10 amI have a directory in my web directory (/webdir/suba) points to a sub domain suba.example.com
If I disallow this directory in robots.txt will bots also ignore the sub domain?
-
1 Reply
-
Robots.txt is meant to be placed in the root folder for domain to control access to folders and sub folders. Additionally, sub domains are treated as separate sites and require their own robots file.
So if you want to disallow said sub domain, create a robots file in the root directory for that sub domain and disallow the root.
User-agent: *
Disallow: /
Log in to reply.