volkswagen-veicolicommerciali.it
robots.txt

Robots Exclusion Standard data for volkswagen-veicolicommerciali.it

Resource Scan

Scan Details

Site Domain volkswagen-veicolicommerciali.it
Base Domain volkswagen-veicolicommerciali.it
Scan Status Ok
Last Scan2025-03-23T17:08:54+00:00
Next Scan 2025-04-22T17:08:54+00:00

Last Scan

Scanned2025-03-23T17:08:54+00:00
URL https://volkswagen-veicolicommerciali.it/robots.txt
Redirect https://www.volkswagen-veicolicommerciali.it:443/robots.txt
Redirect Domain www.volkswagen-veicolicommerciali.it
Redirect Base volkswagen-veicolicommerciali.it
Domain IPs 75.2.74.46
Redirect IPs 184.87.193.90, 184.87.193.95, 2600:1413:b000:13::b857:c18d, 2600:1413:b000:13::b857:c19d
Response IP 42.99.140.138
Found Yes
Hash 4218348b29ead54da9cc1463b074a9d300e525aac7f6ecea945862e2bafe707f
SimHash 616093d5c5f7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

Other Records

Field Value
sitemap https://www.volkswagen-veicolicommerciali.it/it.sitemap.xml

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap