The Greatest Guide To dana
the worth from the identify attribute (robots) specifies which the rule relates to all crawlers. both of those the identify and the articles characteristics are circumstance-insensitive. To address a certain crawler, swap the robots value of the identify attribute Along with the person agent token of your crawler that you will be addressing. Google