roflrazzi.cheezburger.com
robots.txt

Robots Exclusion Standard data for roflrazzi.cheezburger.com

Resource Scan

Scan Details

Site Domain roflrazzi.cheezburger.com
Base Domain cheezburger.com
Scan Status Ok
Last Scan2024-04-19T08:45:42+00:00
Next Scan 2024-05-19T08:45:42+00:00

Last Scan

Scanned2024-04-19T08:45:42+00:00
URL https://roflrazzi.cheezburger.com/robots.txt
Redirect https://thedailywhat.cheezburger.com/robots.txt
Redirect Domain thedailywhat.cheezburger.com
Redirect Base cheezburger.com
Domain IPs 13.35.18.109, 13.35.18.113, 13.35.18.40, 13.35.18.84, 2600:9000:20c7:2e00:8:a728:7740:93a1, 2600:9000:20c7:400:8:a728:7740:93a1, 2600:9000:20c7:600:8:a728:7740:93a1, 2600:9000:20c7:6400:8:a728:7740:93a1, 2600:9000:20c7:6800:8:a728:7740:93a1, 2600:9000:20c7:7600:8:a728:7740:93a1, 2600:9000:20c7:9600:8:a728:7740:93a1, 2600:9000:20c7:ca00:8:a728:7740:93a1
Redirect IPs 13.35.18.109, 13.35.18.113, 13.35.18.40, 13.35.18.84, 2600:9000:20c7:1000:8:a728:7740:93a1, 2600:9000:20c7:1c00:8:a728:7740:93a1, 2600:9000:20c7:3e00:8:a728:7740:93a1, 2600:9000:20c7:4200:8:a728:7740:93a1, 2600:9000:20c7:b800:8:a728:7740:93a1, 2600:9000:20c7:c00:8:a728:7740:93a1, 2600:9000:20c7:c800:8:a728:7740:93a1, 2600:9000:20c7:cc00:8:a728:7740:93a1
Response IP 13.35.18.113
Found Yes
Hash 05f279b590e33cf8edcef54b54404897bdf978e6b2b47764b3f180ca101f55e5
SimHash 6820689ace9b

Groups

*

Rule Path
Disallow /error/
Disallow /Error/
Disallow /api/
Disallow /Api/
Disallow /shared/
Disallow /*/shared/
Disallow /Shared/
Disallow /*/Shared/
Disallow /home/
Disallow /*/home/
Disallow /Home/
Disallow /*/Home/
Disallow /promoted
Disallow /Promoted
Disallow /metrics/
Disallow /Metrics/
Disallow /template/
Disallow /Template/

Other Records

Field Value
sitemap https://thedailywhat.cheezburger.com/sitemap.xml

Comments

  • Moist