images.fanpop.com
robots.txt
Robots Exclusion Standard data for images.fanpop.com
Resource Scan
Scan Details
Site Domain | images.fanpop.com |
Base Domain | fanpop.com |
Scan Status | Ok |
Last Scan | 2024-04-26T15:58:55+00:00 |
Next Scan | 2024-05-26T15:58:55+00:00 |
Last Scan
Scanned | 2024-04-26T15:58:55+00:00 |
URL | https://images.fanpop.com/robots.txt |
Redirect | http://www.fanpop.com/robots.txt |
Redirect Domain | www.fanpop.com |
Redirect Base | fanpop.com |
Domain IPs | 104.26.10.178, 104.26.11.178, 172.67.73.155 |
Redirect IPs | 104.26.10.178, 104.26.11.178, 172.67.73.155 |
Response IP | 172.67.73.155 |
Found | Yes |
Hash | 975b7575fa6002ccb12445d40e2456c718883e2c1a385ff31711375353cdf0c8 |
SimHash | 8d54d3540116 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/ |
Disallow | /superquiz/ |
Disallow | /a/ |
Disallow | /site/go |
Disallow | /user/ |
Disallow | /clubs/*/links/*/go$ |
Disallow | /external |
Disallow | /*/ajax* |
Disallow | /*/check* |
Disallow | /fans/*/wall/ |
Disallow | /fans/*/clubs |
Disallow | /fans/*/fanlist |
Disallow | /fans/*/content/ |
Disallow | /fans/*/answers/ |
Disallow | /fans/*/picks/ |
Disallow | /fans/*/quizzes/ |