abitare.it
robots.txt

Robots Exclusion Standard data for abitare.it

Resource Scan

Scan Details

Site Domain abitare.it
Base Domain abitare.it
Scan Status Ok
Last Scan2025-01-01T15:01:11+00:00
Next Scan 2025-01-08T15:01:11+00:00

Last Scan

Scanned2025-01-01T15:01:11+00:00
URL https://abitare.it/robots.txt
Redirect https://www.abitare.it/robots.txt
Redirect Domain www.abitare.it
Redirect Base abitare.it
Domain IPs 185.53.36.177
Redirect IPs 13.226.2.104, 13.226.2.14, 13.226.2.69, 13.226.2.74, 2600:9000:20fe:200:16:1723:1c0:93a1, 2600:9000:20fe:3c00:16:1723:1c0:93a1, 2600:9000:20fe:4400:16:1723:1c0:93a1, 2600:9000:20fe:6400:16:1723:1c0:93a1, 2600:9000:20fe:6600:16:1723:1c0:93a1, 2600:9000:20fe:7e00:16:1723:1c0:93a1, 2600:9000:20fe:9a00:16:1723:1c0:93a1, 2600:9000:20fe:c800:16:1723:1c0:93a1
Response IP 52.85.49.108
Found Yes
Hash dd9024f2e71cc104d63119739bd63da206ce14df8bfda722133a63d6ca4451a0
SimHash 4b2c4870c3b3

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*/feed/
Disallow /*app_v2%3D

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.abitare.it/it/sitemap.xml
sitemap https://www.abitare.it/it/sitemap-news.xml