.Google limits robots.txt support to four industries, clarifying its own stance on in need of support ordinances.Google.com just supports four specific robots.txt fields.Unsupported ordinances in robots.txt are going to be actually ignored.Look at auditing your robots.txt files because of this upgrade.