turismoverona.eu
robots.txt

Robots Exclusion Standard data for turismoverona.eu

Resource Scan

Scan Details

Site Domain turismoverona.eu
Base Domain turismoverona.eu
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-05T12:17:32+00:00
Next Scan 2025-10-03T12:17:32+00:00

Last Successful Scan

Scanned2023-05-25T09:43:30+00:00
URL http://turismoverona.eu/robots.txt
Redirect http://www.turismoverona.eu/robots.txt
Redirect Domain www.turismoverona.eu
Redirect Base turismoverona.eu
Domain IPs 62.149.128.151, 62.149.128.154, 62.149.128.157, 62.149.128.160, 62.149.128.163, 62.149.128.166
Redirect IPs 213.171.100.120
Response IP 213.171.100.120
Found Yes
Hash f4b033dadad4e4cff263c6de5598f3ade51596fa72332807866b670b662ff99c
SimHash 3354f07367bf

Groups

googlebot
google
googlebot-mobile
bingbot
bing

Rule Path
Disallow /temp/
Disallow /cache/
Disallow /versioningmedia/
Disallow /stagingmedia/
Disallow /public_security/
Disallow /include/
Disallow /images/
Disallow /nqcontent/
Disallow /admin/
Disallow /quickedit/
Disallow /media/
Disallow /bannertrack/
Disallow /utils/
Disallow /templates/
Disallow /poll/

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

hypercrawl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /

powermapper

Rule Path
Allow /

Comments

  • Non voglio che i motori di ricerca indicizzino queste directory
  • blocco di tutti i crawler a parte google e bing in testa al file
  • alcuni non leggono l'asterisco