LastPass edits robots.txt to make support articles difficult to find
bleepingcomputer.comFrom the article:
All of today's support bulletins are not easy to find, with none of them listed in search engines, as the company added <meta name="robots" content="noindex"> HTML tags to the document to prevent them from being indexed by search engines.The submission title includes "LastPass edits robots.txt" but https://support.lastpass.com/robots.txt doesn't seem to exclude those URLs and the article doesn't mention robots.txt
1) Presuming they're using a CMS perhaps it's an accident?
2) To clarify a bit, afaik, robots.txt is a request / suggestion, a nice to have if you will. It doesn't prevent indexing.