[QUOTE = "clayman1994, post: 322170, member: 33403"]
As far as I know, Google does not see the robots.txt file, ignores it. And you need to close the pages using the nofollow, noindex meta tags. I did it on DLE, on XenForo I don’t know how to implement this
[/ QUOTE]
Why does Google Webmaster asks for it, when you remove this file?
As far as I know, Google does not see the robots.txt file, ignores it. And you need to close the pages using the nofollow, noindex meta tags. I did it on DLE, on XenForo I don’t know how to implement this
[/ QUOTE]
Why does Google Webmaster asks for it, when you remove this file?
