staybenebu.com
robots.txt
Robots Exclusion Standard data for staybenebu.com
Resource Scan
Scan Details
Site Domain | staybenebu.com |
Base Domain | staybenebu.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-06-02T00:00:00+00:00 |
Next Scan | 2024-08-31T00:00:00+00:00 |
Last Successful Scan
Scanned | 2024-01-11T17:35:16+00:00 |
URL | https://staybenebu.com/robots.txt |
Redirect | https://www.staybenebu.com/robots.txt |
Redirect Domain | www.staybenebu.com |
Redirect Base | staybenebu.com |
Domain IPs | 104.18.34.68, 172.64.153.188, 2606:4700:4400::6812:2244, 2606:4700:4400::ac40:99bc |
Redirect IPs | 104.18.34.68, 172.64.153.188, 2606:4700:4400::6812:2244, 2606:4700:4400::ac40:99bc |
Response IP | 172.64.153.188 |
Found | Yes |
Hash | 8e14330a2fa05c26b837c21d2f44f3a5b0c3c8e761f106bce82f5f56a15d9440 |
SimHash | ed0c1d444dc0 |
Groups
*
Rule | Path |
---|---|
Disallow | /owners |
Disallow | /links.asp |
Disallow | /linktous.asp |
Disallow | /cdn-cgi/l/email-protection |
Other Records
Field | Value |
---|---|
sitemap | https://www..net/sitemap.xml |
Comments