thedailywhat.cheezburger.com
robots.txt
Robots Exclusion Standard data for thedailywhat.cheezburger.com
Resource Scan
Scan Details
| Site Domain | thedailywhat.cheezburger.com |
| Base Domain | cheezburger.com |
| Scan Status | Ok |
| Last Scan | 2024-06-07T08:43:10+00:00 |
| Next Scan | 2024-07-07T08:43:10+00:00 |
Last Scan
| Scanned | 2024-06-07T08:43:10+00:00 |
| URL | https://thedailywhat.cheezburger.com/robots.txt |
| Domain IPs | 13.227.254.106, 13.227.254.117, 13.227.254.123, 13.227.254.97, 2600:9000:200a:1a00:8:a728:7740:93a1, 2600:9000:200a:200:8:a728:7740:93a1, 2600:9000:200a:3800:8:a728:7740:93a1, 2600:9000:200a:6e00:8:a728:7740:93a1, 2600:9000:200a:7400:8:a728:7740:93a1, 2600:9000:200a:8800:8:a728:7740:93a1, 2600:9000:200a:a000:8:a728:7740:93a1, 2600:9000:200a:ac00:8:a728:7740:93a1 |
| Response IP | 13.227.254.106 |
| Found | Yes |
| Hash | 05f279b590e33cf8edcef54b54404897bdf978e6b2b47764b3f180ca101f55e5 |
| SimHash | 6820689ace9b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /error/ |
| Disallow | /Error/ |
| Disallow | /api/ |
| Disallow | /Api/ |
| Disallow | /shared/ |
| Disallow | /*/shared/ |
| Disallow | /Shared/ |
| Disallow | /*/Shared/ |
| Disallow | /home/ |
| Disallow | /*/home/ |
| Disallow | /Home/ |
| Disallow | /*/Home/ |
| Disallow | /promoted |
| Disallow | /Promoted |
| Disallow | /metrics/ |
| Disallow | /Metrics/ |
| Disallow | /template/ |
| Disallow | /Template/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thedailywhat.cheezburger.com/sitemap.xml |
Comments