Robot all-shoes
Downloading data by allshoes robot is similar to other typical browsers. Standard websites allow access to all robots. In case you do not wish your website to be in our collection you can deny access in robot.txt file, by adding the following:User-agent: all-shoes Disallow: