Log In Sign Up

binekarac.vw.com.tr
robots.txt

Robots Exclusion Standard data for binekarac.vw.com.tr

Resource Scan

Scan Details

Site Domain binekarac.vw.com.tr
Base Domain vw.com.tr
Scan Status Ok
Last Scan2024-11-03T07:10:26+00:00
Next Scan 2024-12-03T07:10:26+00:00

Last Scan

Scanned2024-11-03T07:10:26+00:00
URL https://binekarac.vw.com.tr/robots.txt
Domain IPs 152.195.58.13
Response IP 152.195.58.13
Found Yes
Hash 159112727149417205adb7cbfbc58304f991d022b5451c69820c9d3bc699d831
SimHash 692292c4c797

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

gsa-crawler

Rule Path
Allow /app/

*

Rule Path
Allow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://binekarac.vw.com.tr/tr.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top