gonomad.com
robots.txt

Robots Exclusion Standard data for gonomad.com

Resource Scan

Scan Details

Site Domain gonomad.com
Base Domain gonomad.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-06T09:11:04+00:00
Next Scan 2024-10-06T09:11:04+00:00

Last Successful Scan

Scanned2024-08-08T09:10:06+00:00
URL https://www.gonomad.com/robots.txt
Domain IPs 23.111.179.26
Response IP 23.111.179.26
Found Yes
Hash 61c3501f3ecf93a7762bd1d94976eb8a1fc160f8c3f4fb2cb37d552541fbc274
SimHash 3d684ce1c2ea

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /cgi-bin/
Disallow /private/
Disallow /tmp/
Disallow /wp-content/cache/

*

Rule Path
Disallow /?blackhole

facebookexternalhit/1.1

Rule Path
Disallow /cgi-bin/
Disallow /private/
Disallow /tmp/
Disallow /wp-content/cache/
Disallow /?blackhole