fsarchiver.org
robots.txt

Robots Exclusion Standard data for fsarchiver.org

Resource Scan

Scan Details

Site Domain fsarchiver.org
Base Domain fsarchiver.org
Scan Status Ok
Last Scan2024-06-01T14:54:20+00:00
Next Scan 2024-07-01T14:54:20+00:00

Last Scan

Scanned2024-06-01T14:54:20+00:00
URL https://www.fsarchiver.org/robots.txt
Domain IPs 104.21.3.211, 172.67.131.52, 2606:4700:3032::ac43:8334, 2606:4700:3036::6815:3d3
Response IP 172.67.131.52
Found Yes
Hash c7e3a4ea3ed82c1a123f10956282c13c8c2893b73fac42f97871b690d963dd42
SimHash 2938dcc0c3b2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60