gafortiby.com
robots.txt

Robots Exclusion Standard data for gafortiby.com

Resource Scan

Scan Details

Site Domain gafortiby.com
Base Domain gafortiby.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-07T07:26:14+00:00
Next Scan 2025-08-06T07:26:14+00:00

Last Successful Scan

Scanned2025-06-08T07:24:34+00:00
URL https://gafortiby.com/robots.txt
Domain IPs 185.146.167.198
Response IP 185.146.167.198
Found Yes
Hash 8773b6931cd77b9383fcf74274a0cdda6d6603b5444db72b993a3de9b332f7ec
SimHash 45a0cf52efd0

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

Comments

  • Wildcard robots.txt agent (ask all bots to crawl slowly but still index everything).