gretsch-talk.com
robots.txt
Robots Exclusion Standard data for gretsch-talk.com
Resource Scan
Scan Details
Site Domain | gretsch-talk.com |
Base Domain | gretsch-talk.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-18T12:45:23+00:00 |
Next Scan | 2024-12-17T12:45:23+00:00 |
Last Successful Scan
Scanned | 2023-08-25T05:14:21+00:00 |
URL | https://gretsch-talk.com/robots.txt |
Domain IPs | 104.21.29.107, 172.67.171.116, 2606:4700:3033::6815:1d6b, 2606:4700:3035::ac43:ab74 |
Response IP | 172.67.171.116 |
Found | Yes |
Hash | f946c8a7ac926f88ca5d0ddf1e20d3404d1e8eaa13f6d945251d5d3761faa083 |
SimHash | 28704970651b |
Groups
*
Rule | Path |
---|---|
Disallow | /tmp/ |
Disallow | /test/ |
Disallow | /ssh/ |
Disallow | /xcache/ |
Disallow | /plesk-stat/ |
Disallow | /picture_library/ |
Disallow | /phpmyadmin/* |
Disallow | /dev/ |
Disallow | /chat/ |
Disallow | /calendar/ |
Disallow | /ads-direct/* |
Disallow | /fundraiser/* |
Disallow | /namm08/* |
Disallow | /forum/archive/*/ |
Disallow | /Hide_vB_Forum/*/ |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |