cheezburger.com
robots.txt
Robots Exclusion Standard data for cheezburger.com
Resource Scan
Scan Details
Site Domain | cheezburger.com |
Base Domain | cheezburger.com |
Scan Status | Ok |
Last Scan | 2024-09-21T07:41:57+00:00 |
Next Scan | 2024-09-28T07:41:57+00:00 |
Last Scan
Scanned | 2024-09-21T07:41:57+00:00 |
URL | https://cheezburger.com/robots.txt |
Domain IPs | 13.227.254.106, 13.227.254.117, 13.227.254.123, 13.227.254.97, 2600:9000:200a:2800:8:a728:7740:93a1, 2600:9000:200a:3600:8:a728:7740:93a1, 2600:9000:200a:5800:8:a728:7740:93a1, 2600:9000:200a:7a00:8:a728:7740:93a1, 2600:9000:200a:7c00:8:a728:7740:93a1, 2600:9000:200a:d200:8:a728:7740:93a1, 2600:9000:200a:d400:8:a728:7740:93a1, 2600:9000:200a:d600:8:a728:7740:93a1 |
Response IP | 13.227.254.123 |
Found | Yes |
Hash | 7d08c0bf9874166a39dff5394156351b8e93f4e2091206d621fa78118a77a28f |
SimHash | 6905631dcc9b |
Groups
*
Rule | Path |
---|---|
Disallow | /error/ |
Disallow | /Error/ |
Disallow | /api/ |
Disallow | /Api/ |
Disallow | /shared/ |
Disallow | /*/shared/ |
Disallow | /Shared/ |
Disallow | /*/Shared/ |
Disallow | /home/ |
Disallow | /*/home/ |
Disallow | /Home/ |
Disallow | /*/Home/ |
Disallow | /promoted |
Disallow | /Promoted |
Disallow | /metrics/ |
Disallow | /Metrics/ |
Disallow | /template/ |
Disallow | /Template/ |
Other Records
Field | Value |
---|---|
sitemap | https://cheezburger.com/sitemap-1.xml |
sitemap | https://cheezburger.com/sitemap-7.xml |
sitemap | https://cheezburger.com/sitemap-75.xml |
sitemap | https://cheezburger.com/sitemap-90.xml |
sitemap | https://cheezburger.com/sitemap-1250.xml |
sitemap | https://cheezburger.com/sitemap-79103.xml |
Comments