video.iltirreno.gelocal.it
robots.txt

Robots Exclusion Standard data for video.iltirreno.gelocal.it

Resource Scan

Scan Details

Site Domain video.iltirreno.gelocal.it
Base Domain gelocal.it
Scan Status Ok
Last Scan2024-09-23T00:41:35+00:00
Next Scan 2024-10-23T00:41:35+00:00

Last Scan

Scanned2024-09-23T00:41:35+00:00
URL https://video.iltirreno.gelocal.it/robots.txt
Domain IPs 52.222.144.55, 52.222.144.94, 52.222.144.98, 52.222.144.99
Response IP 52.85.49.36
Found Yes
Hash c68883d139cd55dcb1e411f0226196f06d98118ac0c60817d1945600d4d7a28e
SimHash 10384b602133

Groups

*

Rule Path
Disallow /static/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /