speziacalcionews.it
robots.txt

Robots Exclusion Standard data for speziacalcionews.it

Resource Scan

Scan Details

Site Domain speziacalcionews.it
Base Domain speziacalcionews.it
Scan Status Ok
Last Scan2024-05-12T13:25:31+00:00
Next Scan 2024-05-19T13:25:31+00:00

Last Scan

Scanned2024-05-12T13:25:31+00:00
URL https://speziacalcionews.it/robots.txt
Domain IPs 104.26.12.49, 104.26.13.49, 172.67.71.104, 2606:4700:20::681a:c31, 2606:4700:20::681a:d31, 2606:4700:20::ac43:4768
Response IP 104.26.12.49
Found Yes
Hash f4737c4141aa7a67eb02c39d5b070b1af5432da37a678e44daeadaa13246af15
SimHash 4d55c3d65650

Groups

*

Rule Path
Allow /
Disallow /cgi-bin
Disallow /quotidiano/wp-admin
Disallow /quotidiano/wp-includes
Disallow /quotidiano/wp-content
Disallow /diretta
Disallow /quotidiano/xmlrpc.php

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /