whatsup.ren
robots.txt

Robots Exclusion Standard data for whatsup.ren

Resource Scan

Scan Details

Site Domain whatsup.ren
Base Domain whatsup.ren
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-30T06:00:18+00:00
Next Scan 2025-06-28T06:00:18+00:00

Last Successful Scan

Scanned2024-06-04T04:41:18+00:00
URL https://whatsup.ren/robots.txt
Redirect https://www.whatsup.ren/robots.txt
Redirect Domain www.whatsup.ren
Redirect Base whatsup.ren
Domain IPs 104.21.25.20, 172.67.222.5, 2606:4700:3034::6815:1914, 2606:4700:3035::ac43:de05
Redirect IPs 104.21.25.20, 172.67.222.5, 2606:4700:3034::6815:1914, 2606:4700:3035::ac43:de05
Response IP 104.21.25.20
Found Yes
Hash acda65d0cb693a6e23b0ec301b8c92b03e3fcb1d9d6f2a077d587817e3f0cc9d
SimHash 6845d01057d1

Groups

*

Rule Path
Disallow /
Disallow /user-*
Disallow /serach-*
Disallow /go.php*

googlebot

Rule Path
Allow /
Disallow /tag-*

mediapartners-google

Rule Path
Allow /
Disallow /tag-*

adsbot-google

Rule Path
Allow /
Disallow /tag-*

bingbot

Rule Path
Allow /
Disallow /tag-*

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Allow /
Disallow /tag-*

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Allow /
Disallow /tag-*

twitterbot

Rule Path
Allow /
Disallow /tag-*