caraffinity.net
robots.txt
Robots Exclusion Standard data for caraffinity.net
Resource Scan
Scan Details
Site Domain | caraffinity.net |
Base Domain | caraffinity.net |
Scan Status | Ok |
Last Scan | 2025-09-07T03:33:53+00:00 |
Next Scan | 2025-09-14T03:33:53+00:00 |
Last Scan
Scanned | 2025-09-07T03:33:53+00:00 |
URL | http://caraffinity.net/robots.txt |
Redirect | https://www.caraffinity.it/robots.txt |
Redirect Domain | www.caraffinity.it |
Redirect Base | caraffinity.it |
Domain IPs | 185.112.84.157 |
Redirect IPs | 185.112.84.144, 185.112.84.159 |
Response IP | 185.112.84.159 |
Found | Yes |
Hash | 7eb78d350bdc1a6be6e680e0712f8f68919c90547983e4439686ac794e79640a |
SimHash | 614dcd800b93 |
Groups
*
Rule | Path |
---|---|
Disallow | /landing/ |
Disallow | /people/send-message-car-not-logged/ |
Disallow | /car/pictures/ |
Disallow | /annunci-auto-usate/*.phtml$ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.caraffinity.it/sitemap.xml |