codiceedizioni.it
robots.txt

Robots Exclusion Standard data for codiceedizioni.it

Resource Scan

Scan Details

Site Domain codiceedizioni.it
Base Domain codiceedizioni.it
Scan Status Ok
Last Scan2024-06-16T02:36:32+00:00
Next Scan 2024-07-16T02:36:32+00:00

Last Scan

Scanned2024-06-16T02:36:32+00:00
URL https://codiceedizioni.it/robots.txt
Redirect https://www.codiceedizioni.it/robots.txt
Redirect Domain www.codiceedizioni.it
Redirect Base codiceedizioni.it
Domain IPs 185.201.65.29
Redirect IPs 185.201.65.29
Response IP 185.201.65.29
Found Yes
Hash 0c452d9506608d1ab6e42d6595a15a9092f62649c443f33f0bb0bc6ee4f831aa
SimHash a1105881f591

Groups

*

Rule Path
Disallow
Disallow /blackhole/*
Disallow /cgi-bin/
Disallow /bin/
Disallow application/*
Disallow public/*

mediapartners-google*

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

scrubby

Rule Path
Disallow

robozilla

Rule Path
Disallow

becomebot

Rule Path
Disallow

nutch

Rule Path
Disallow

virgiliobot

Rule Path
Disallow

Comments

  • robots.txt