prodottitipicitoscani.it
robots.txt

Robots Exclusion Standard data for prodottitipicitoscani.it

Resource Scan

Scan Details

Site Domain prodottitipicitoscani.it
Base Domain prodottitipicitoscani.it
Scan Status Ok
Last Scan2024-11-12T22:51:08+00:00
Next Scan 2024-11-19T22:51:08+00:00

Last Scan

Scanned2024-11-12T22:51:08+00:00
URL https://prodottitipicitoscani.it/robots.txt
Redirect https://www.prodottitipicitoscani.it/robots.txt
Redirect Domain www.prodottitipicitoscani.it
Redirect Base prodottitipicitoscani.it
Domain IPs 18.196.232.166
Redirect IPs 18.196.232.166
Response IP 18.196.232.166
Found Yes
Hash 34803e2f3f3cdbb951768100090a3164a6b0d50f37da3bcfdb13183575fe9a0b
SimHash 4454c17a7190

Groups

*

Rule Path
Allow /

mediatoolkitbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

jaunt

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

woorankreview

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

gptbot

Rule Path
Disallow /