celebs.cheezburger.com
robots.txt
Robots Exclusion Standard data for celebs.cheezburger.com
Resource Scan
Scan Details
Site Domain | celebs.cheezburger.com |
Base Domain | cheezburger.com |
Scan Status | Ok |
Last Scan | 2024-04-25T13:18:27+00:00 |
Next Scan | 2024-05-25T13:18:27+00:00 |
Last Scan
Scanned | 2024-04-25T13:18:27+00:00 |
URL | https://celebs.cheezburger.com/robots.txt |
Domain IPs | 13.35.18.109, 13.35.18.113, 13.35.18.40, 13.35.18.84, 2600:9000:20c7:2a00:8:a728:7740:93a1, 2600:9000:20c7:4e00:8:a728:7740:93a1, 2600:9000:20c7:5600:8:a728:7740:93a1, 2600:9000:20c7:6600:8:a728:7740:93a1, 2600:9000:20c7:7200:8:a728:7740:93a1, 2600:9000:20c7:b200:8:a728:7740:93a1, 2600:9000:20c7:b600:8:a728:7740:93a1, 2600:9000:20c7:ec00:8:a728:7740:93a1 |
Response IP | 13.35.18.84 |
Found | Yes |
Hash | e91a2f5b466463941f0d42eee96530228cb135b7f1176faafa6ef19e4145e071 |
SimHash | 29286a1eca9a |
Groups
*
Rule | Path |
---|---|
Disallow | /error/ |
Disallow | /Error/ |
Disallow | /api/ |
Disallow | /Api/ |
Disallow | /shared/ |
Disallow | /*/shared/ |
Disallow | /Shared/ |
Disallow | /*/Shared/ |
Disallow | /home/ |
Disallow | /*/home/ |
Disallow | /Home/ |
Disallow | /*/Home/ |
Disallow | /promoted |
Disallow | /Promoted |
Disallow | /metrics/ |
Disallow | /Metrics/ |
Disallow | /template/ |
Disallow | /Template/ |
Other Records
Field | Value |
---|---|
sitemap | https://celebs.cheezburger.com/sitemap.xml |
Comments