daft.ie
robots.txt
Robots Exclusion Standard data for daft.ie
Resource Scan
Scan Details
Site Domain | daft.ie |
Base Domain | daft.ie |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-30T12:33:16+00:00 |
Next Scan | 2025-01-28T12:33:16+00:00 |
Last Successful Scan
Scanned | 2023-10-07T12:31:07+00:00 |
URL | https://daft.ie/robots.txt |
Redirect | https://www.daft.ie/robots.txt |
Redirect Domain | www.daft.ie |
Redirect Base | daft.ie |
Domain IPs | 104.20.15.150, 104.20.16.150, 172.67.32.196 |
Redirect IPs | 104.20.15.150, 104.20.16.150, 172.67.32.196 |
Response IP | 104.20.15.150 |
Found | Yes |
Hash | 516346ee51ddac4c4b24110094abf559c98bef2e29689d751f9467c6be566860 |
SimHash | 8b269ffa4a48 |
Groups
*
Rule | Path |
---|---|
Disallow | /largemap.daft |
Disallow | *print%3D* |
Disallow | *fr%3Donline* |
Disallow | *mydaft.daft* |
Disallow | *add_to* |
Disallow | *from_search* |
Disallow | *debug%3D1* |
Disallow | *waptest* |
Disallow | *activate* |
Disallow | |
Disallow | *no_header%3D1* |
Disallow | *locate_* |
Disallow | /holiday-homes/map/getSpatialProperties* |
Disallow | /%5B |
Disallow | /%5D |
Disallow | /offset%3D |
Disallow | /photo_search%3D |
Disallow | /undefined |
Disallow | /sort_by%3D |
Disallow | /searchsale.daft |
Disallow | /leaseLength_to%3D |
Disallow | /mediaTypes%3D |
Disallow | /api |
Allow | /api/sitemap* |
Allow | /guides |