.Google restricts robots.txt help to four industries, clarifying its own position on unsupported ordinances.Google.com simply sustains 4 specific robots.txt fields.In need of support regulations in robots.txt will definitely be actually ignored.Look at auditing your robots.txt files in light of this upgrade.