Google posts draft to formalize Robots Exclusion Protocol Specification

Google open sources its robots.txt parser as part of this announcement.

Please visit Search Engine Land for the full article.

from Search Engine Land: News & Info About SEO, PPC, SEM, Search Engines & Search Marketing
July 01, 2019 at 02:52PM