ryu4demas.com
robots.txt

Robots Exclusion Standard data for ryu4demas.com

Resource Scan

Scan Details

Site Domain ryu4demas.com
Base Domain ryu4demas.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-11-13T02:46:12+00:00
Next Scan 2024-11-27T02:46:12+00:00

Last Successful Scan

Scanned2024-10-05T23:55:51+00:00
URL https://ryu4demas.com/robots.txt
Redirect https://ryu4dsegar.com/robots.txt
Redirect Domain ryu4dsegar.com
Redirect Base ryu4dsegar.com
Domain IPs 104.21.75.170, 172.67.179.67, 2606:4700:3031::ac43:b343, 2606:4700:3032::6815:4baa
Redirect IPs 104.21.57.113, 172.67.163.110, 2606:4700:3033::ac43:a36e, 2606:4700:3034::6815:3971
Response IP 104.21.57.113
Found Yes
Hash 4dbfdba004efb5d34a57d098f9549ae3af86e63d094be9867624ae4af697ec1a
SimHash 6149d30355d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://ryu4dsegar.com/sitemap.xml

Warnings

  • 1 invalid line.