What AddThis.com crawling robot does exactly?
I have lots of traffic on my site from "AddThis.com robot tech.support@clearspring.com" and need to know, what is gathered, why it is needed and is there any benefits for me to allow this robot?
I am inclined to disable it, if nothing good comes for me from its crawling.
1 Community Answers
That robot only requests a page when someone shares a URL without a title along with it. We request the page and look for the <title> tag.
This question is closed to new answers.