SEO Reminder!

Forum White Hat SEO SEO Reminder!

  • This topic has 6 replies, 1 voice, and was last updated 1 month ago by I_will_be_wealthy.
Viewing 7 posts - 1 through 7 (of 7 total)
  • Author
    Posts
  • #8485
    seohelper
    Keymaster

    Robots.txt is a crawl management file and it doesn’t control indexing.

    #8489
    maltelandwehr

    Unfortunately many SEOs don’t get this.

    #8486
    aedum1111

    Can you explain what you mean by this further?

    #8487
    mesutsenertr

    It is sufficient to have the sitemap path on the robots.txt side.

    #8490
    Edward_Morbius

    robots.txt controls nothing.

    It’s like leaving a sugar cookie and a chocolate chip cookie on a park bench with a sign that says “Please eat the sugar cookie”.

    Some people will only eat the sugar cookie, some will eat the chocolate chip, some will eat both, some will eat none.

    Same thing with search engines. You can express your desire, but they are free to ignore you and do what they feel like.

    Also crawling is different than indexing. Just because something is crawled doesn’t mean it will make it into the search results.

    #8488
    brightworkdotuk

    .htaccess

    #8491
    I_will_be_wealthy

    guess how google indentifies pbns? Look at robots.txt files and look for noindex to backlink tools.

Viewing 7 posts - 1 through 7 (of 7 total)
  • You must be logged in to reply to this topic.
Scroll to Top