Log In Sign Up

volkswagen-transportbilar.se
robots.txt

Robots Exclusion Standard data for volkswagen-transportbilar.se

Resource Scan

Scan Details

Site Domain volkswagen-transportbilar.se
Base Domain volkswagen-transportbilar.se
Scan Status Ok
Last Scan2025-03-22T14:36:59+00:00
Next Scan 2025-04-21T14:36:59+00:00

Last Scan

Scanned2025-03-22T14:36:59+00:00
URL https://volkswagen-transportbilar.se/robots.txt
Redirect https://www.volkswagen-transportbilar.se:443/robots.txt
Redirect Domain www.volkswagen-transportbilar.se
Redirect Base volkswagen-transportbilar.se
Domain IPs 75.2.48.58
Redirect IPs 184.87.193.146, 184.87.193.153, 2600:1413:b000:13::b857:c192, 2600:1413:b000:13::b857:c199
Response IP 23.209.46.81
Found Yes
Hash a2c826ee1020a070df363bad2e8386ae0ff1527bf56cfafd2ae63b7d860f240d
SimHash 292883c4c795

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen-transportbilar.se/sv.sitemap.xml
Back to top

Comments

  • Robots CV SE
  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top