consigli.it
robots.txt

Robots Exclusion Standard data for consigli.it

Resource Scan

Scan Details

Site Domain consigli.it
Base Domain consigli.it
Scan Status Ok
Last Scan2024-06-22T19:55:44+00:00
Next Scan 2024-06-29T19:55:44+00:00

Last Scan

Scanned2024-06-22T19:55:44+00:00
URL https://consigli.it/robots.txt
Redirect https://www.consigli.it/robots.txt
Redirect Domain www.consigli.it
Redirect Base consigli.it
Domain IPs 52.30.105.170
Redirect IPs 52.30.105.170
Response IP 52.30.105.170
Found Yes
Hash 4e9294345b66bd65937c9bbb3b8bda902df20a5b0f2c5e59e741121472bfe03f
SimHash 49105a20ab13

Groups

*

Rule Path
Allow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.consigli.it/sitemap.xml