ryu4d.co.uk
robots.txt

Robots Exclusion Standard data for ryu4d.co.uk

Resource Scan

Scan Details

Site Domain ryu4d.co.uk
Base Domain ryu4d.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-07T04:39:24+00:00
Next Scan 2026-01-05T04:39:24+00:00

Last Successful Scan

Scanned2023-11-24T19:42:05+00:00
URL https://ryu4d.co.uk/robots.txt
Redirect https://ryu4d.de/robots.txt
Redirect Domain ryu4d.de
Redirect Base ryu4d.de
Domain IPs 104.21.94.72, 172.67.220.143, 2606:4700:3030::6815:5e48, 2606:4700:3035::ac43:dc8f
Redirect IPs 104.21.75.167, 172.67.179.64, 2606:4700:3031::ac43:b340, 2606:4700:3033::6815:4ba7
Response IP 104.21.75.167
Found Yes
Hash c6bbc1fba55fcb222e703a30af9cbc3f29702c5e5d17c99ea322785ba9450180
SimHash 6149d30355d7

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://ryu4d.de

Warnings

  • 1 invalid line.