abitare.it
robots.txt

Robots Exclusion Standard data for abitare.it

Resource Scan

Scan Details

Site Domain abitare.it
Base Domain abitare.it
Scan Status Ok
Last Scan2025-05-07T16:50:31+00:00
Next Scan 2025-05-14T16:50:31+00:00

Last Scan

Scanned2025-05-07T16:50:31+00:00
URL https://abitare.it/robots.txt
Redirect https://www.abitare.it/robots.txt
Redirect Domain www.abitare.it
Redirect Base abitare.it
Domain IPs 185.53.36.177
Redirect IPs 13.226.2.104, 13.226.2.14, 13.226.2.69, 13.226.2.74, 2600:9000:20fe:2800:16:1723:1c0:93a1, 2600:9000:20fe:4800:16:1723:1c0:93a1, 2600:9000:20fe:5600:16:1723:1c0:93a1, 2600:9000:20fe:6800:16:1723:1c0:93a1, 2600:9000:20fe:8200:16:1723:1c0:93a1, 2600:9000:20fe:8800:16:1723:1c0:93a1, 2600:9000:20fe:9c00:16:1723:1c0:93a1, 2600:9000:20fe:c600:16:1723:1c0:93a1
Response IP 52.85.49.16
Found Yes
Hash 971e1c83e2aa740208bfa2d5631e07cd2e0dc7689b4b336c42e49954f733cb49
SimHash 422fc820c3b3

Groups

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*/feed/
Disallow /*app_v2%3D
Disallow /en/page/
Disallow /it/page/
Disallow /*cat%3Dqhtzxkeshchdyivz
Disallow /*/attachment/*
Disallow /*/embed/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.abitare.it/it/sitemap.xml
sitemap https://www.abitare.it/it/sitemap-news.xml