rarepixels.com
robots.txt
Robots Exclusion Standard data for rarepixels.com
Resource Scan
Scan Details
Site Domain | rarepixels.com |
Base Domain | rarepixels.com |
Scan Status | Ok |
Last Scan | 2024-10-08T17:18:07+00:00 |
Next Scan | 2024-10-15T17:18:07+00:00 |
Last Scan
Scanned | 2024-10-08T17:18:07+00:00 |
URL | https://rarepixels.com/robots.txt |
Domain IPs | 173.247.240.81 |
Response IP | 173.247.240.81 |
Found | Yes |
Hash | 973d942539374c71b7b3fb9d1226629e18541c2725936c8481cd1e279699fc9c |
SimHash | b1005b6427d1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /css/ |
Disallow | /fonts/ |
Disallow | /images/ |
Disallow | /includes/ |
Disallow | /js/ |
Disallow | /apps/ |