-
How Can I separate Sub Domain crawl from Main Domain?
I’ve been beating my head against a rock regarding this issue. Any help would be greatly appreciated.
When I crawl my client’s website, I get both the main domain pages and sub-domain pages as a result. However, competitor websites using the same idx services show only main domain pages. I cannot edit the robots.txt file for subpages.
Question is when I perform a site: search with google, I get more than 18000 results, both main domain and subdomain, while only having 45 pages on the main website. Other websites using the same idx service only show the main domain for the same search and get less than 700 results with google. Conclusion, we’re ranking for 0 keywords and I’m not sure where to turn.