bolig-guide.dk
robots.txt
Robots Exclusion Standard data for bolig-guide.dk
Resource Scan
Scan Details
Site Domain | bolig-guide.dk |
Base Domain | bolig-guide.dk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't establish SSL connection. |
Last Scan | 2024-05-31T00:39:18+00:00 |
Next Scan | 2024-06-30T00:39:18+00:00 |
Last Successful Scan
Scanned | 2024-05-02T00:37:47+00:00 |
URL | https://bolig-guide.dk/robots.txt |
Redirect | https://www.bolig-guide.dk/robots.txt |
Redirect Domain | www.bolig-guide.dk |
Redirect Base | bolig-guide.dk |
Domain IPs | 80.69.225.102 |
Redirect IPs | 80.69.225.102 |
Response IP | 80.69.225.102 |
Found | Yes |
Hash | b02eb47620257cfcc544c4bf8a412a69e99b9fcf6326e8af29082b55468f0368 |
SimHash | 61111146efd3 |
Groups
*
Rule | Path |
---|---|
Disallow | /int3/ |
Disallow | /int2/ |
Disallow | /int1/ |
Disallow | /robinhus-filer/ |
Disallow | /slet/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.bolig-guide.dk/sitemap.xml |