Google has proposed an official internet standard for the rules included in robots.txt files.
The post Google Wants to Establish an Official Standard for Using Robots.txt via @MattGSouthern appeared first on Search Engine Journal.
from Search Engine Journal https://ift.tt/2NF8MWv
via July 01, 2019 at 10:00PM https://ift.tt/eA8V8J
No comments:
Post a Comment