-
Do we need to disallow Javascript and CSS files in robot file?? Reason for your answer please??
Do we need to disallow Javascript and CSS files in robot file?? Reason for your answer please??
-
1 Reply
-
No, so Google can see them
-
No because it prevents the search engine bot from properly understanding what it’s optimized for mobile
-
I am working on a site with over 100m URLs – there really isn’t any reason to block CSS/JS files from being crawled by Googlebot (or any search bot really). They are necessary for the rendering part of the crawling process and if you block those resources, the bots will have trouble with rendering your site.
Looking at my crawl stats – these files make up less than 3% of my overall crawling
Log in to reply.