amp-video.repubblica.it
robots.txt

Robots Exclusion Standard data for amp-video.repubblica.it

Resource Scan

Scan Details

Site Domain amp-video.repubblica.it
Base Domain repubblica.it
Scan Status Ok
Last Scan2024-09-15T09:40:23+00:00
Next Scan 2024-09-22T09:40:23+00:00

Last Scan

Scanned2024-09-15T09:40:23+00:00
URL https://amp-video.repubblica.it/robots.txt
Domain IPs 18.161.111.114, 18.161.111.13, 18.161.111.19, 18.161.111.7
Response IP 65.9.112.51
Found Yes
Hash be51864cda26087b5d16d67dc700a7c24b2e62e1e0d85a742a19d0659fc345bc
SimHash 105449640133

Groups

*

Rule Path
Disallow /amp/edizione/palermo/i-70-anni-di-morandi-da-palermo-un-videotributo-in-musica/186274/185171
Disallow /amp/edizione/milano/indagato-michele-morenghi-sei-immobili-sequetrati-alla-societa-che-apparteneva-al-cliente-morto/406814/407525

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /