ryu4dsite.com
robots.txt

Robots Exclusion Standard data for ryu4dsite.com

Resource Scan

Scan Details

Site Domain ryu4dsite.com
Base Domain ryu4dsite.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-11-05T05:11:57+00:00
Next Scan 2026-02-03T05:11:57+00:00

Last Successful Scan

Scanned2024-12-17T00:10:26+00:00
URL https://ryu4dsite.com/robots.txt
Redirect https://ryu4dsup.com/robots.txt
Redirect Domain ryu4dsup.com
Redirect Base ryu4dsup.com
Domain IPs 104.21.61.4, 172.67.204.81, 2606:4700:3030::ac43:cc51, 2606:4700:3034::6815:3d04
Redirect IPs 104.21.50.14, 172.67.199.4, 2606:4700:3033::6815:320e, 2606:4700:3034::ac43:c704
Response IP 104.21.50.14
Found Yes
Hash 904fdd30937262debaed19a1dd1fea66b646997c75b71e7adf9c940341e8dd30
SimHash 6149c38357d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://ryu4dsup.com/sitemap.xml/

Warnings

  • 1 invalid line.