rug.farm
robots.txt

Robots Exclusion Standard data for rug.farm

Resource Scan

Scan Details

Site Domain rug.farm
Base Domain rug.farm
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-18T14:01:55+00:00
Next Scan 2024-11-19T14:01:55+00:00

Last Successful Scan

Scanned2024-10-19T14:01:36+00:00
URL https://www.rug.farm/robots.txt
Domain IPs 108.156.133.49, 108.156.133.51, 108.156.133.58, 108.156.133.77, 2600:9000:2755:2200:b:fdf:e9c0:93a1, 2600:9000:2755:3c00:b:fdf:e9c0:93a1, 2600:9000:2755:400:b:fdf:e9c0:93a1, 2600:9000:2755:4200:b:fdf:e9c0:93a1, 2600:9000:2755:4e00:b:fdf:e9c0:93a1, 2600:9000:2755:6000:b:fdf:e9c0:93a1, 2600:9000:2755:a000:b:fdf:e9c0:93a1, 2600:9000:2755:d600:b:fdf:e9c0:93a1
Response IP 108.156.133.58
Found Yes
Hash 3ff0048f3edebfe57ead4ccbb645660094be33f7df63b6f4ee65f631f91c5d35
SimHash e448a4826593

Groups

*

No rules defined. All paths allowed.

Comments

  • https://www.robotstxt.org/robotstxt.html