gonomad.com
robots.txt
Robots Exclusion Standard data for gonomad.com
Resource Scan
Scan Details
Site Domain | gonomad.com |
Base Domain | gonomad.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-06T09:11:18+00:00 |
Next Scan | 2024-12-05T09:11:18+00:00 |
Last Successful Scan
Scanned | 2024-08-08T09:10:06+00:00 |
URL | https://www.gonomad.com/robots.txt |
Domain IPs | 23.111.179.26 |
Response IP | 23.111.179.26 |
Found | Yes |
Hash | 61c3501f3ecf93a7762bd1d94976eb8a1fc160f8c3f4fb2cb37d552541fbc274 |
SimHash | 3d684ce1c2ea |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /private/ |
Disallow | /tmp/ |
Disallow | /wp-content/cache/ |
*
Rule | Path |
---|---|
Disallow | /?blackhole |