.Google.com restricts robots.txt support to 4 areas, clarifying its viewpoint on unsupported ordinances.Google just assists 4 particular robots.txt areas.Unsupported directives in robots.txt are going to be ignored.Think about bookkeeping your robots.txt documents because of this upgrade.