Log In Sign Up

volkswagen-jordan.com
robots.txt

Robots Exclusion Standard data for volkswagen-jordan.com

Resource Scan

Scan Details

Site Domain volkswagen-jordan.com
Base Domain volkswagen-jordan.com
Scan Status Ok
Last Scan2024-09-15T01:53:28+00:00
Next Scan 2024-10-15T01:53:28+00:00

Last Scan

Scanned2024-09-15T01:53:28+00:00
URL https://www.volkswagen-jordan.com/robots.txt
Domain IPs 13.33.30.101, 13.33.30.3, 13.33.30.41, 13.33.30.42, 2600:9000:229f:3600:3:3e12:a00:93a1, 2600:9000:229f:4800:3:3e12:a00:93a1, 2600:9000:229f:6400:3:3e12:a00:93a1, 2600:9000:229f:7000:3:3e12:a00:93a1, 2600:9000:229f:8400:3:3e12:a00:93a1, 2600:9000:229f:9400:3:3e12:a00:93a1, 2600:9000:229f:9a00:3:3e12:a00:93a1, 2600:9000:229f:fc00:3:3e12:a00:93a1
Response IP 13.33.30.3
Found Yes
Hash 46bd2ed8789bd096ea7d0de07215395bac8c04f0b5303bd5eb1d9e5e26bf6a0f
SimHash 69209bc5c5b5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen-jordan.com/en.sitemap.xml
sitemap https://www.volkswagen-jordan.com/ar.sitemap.xml
Back to top

Comments

  • ROBOTS TXT
  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top