sharethis.com
robots.txt
Robots Exclusion Standard data for sharethis.com
Resource Scan
Scan Details
Site Domain | sharethis.com |
Base Domain | sharethis.com |
Scan Status | Ok |
Last Scan | 2024-05-01T20:54:38+00:00 |
Next Scan | 2024-05-15T20:54:38+00:00 |
Last Scan
Scanned | 2024-05-01T20:54:38+00:00 |
URL | https://sharethis.com/robots.txt |
Domain IPs | 108.157.254.124, 108.157.254.129, 108.157.254.25, 108.157.254.56 |
Response IP | 108.157.254.124 |
Found | Yes |
Hash | 03a35e809ab23ea31694d61a65086a9cbe148e8aa96a97d9692a78071317c56d |
SimHash | 6900c87261d1 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/ |
Allow | /wp-includes/ |
Disallow | /0/page/4/ |
Disallow | /0/page/9/ |
Disallow | /0/page/11/ |