Log In Sign Up

bmwvin-decoder.com
robots.txt

Robots Exclusion Standard data for bmwvin-decoder.com

Resource Scan

Scan Details

Site Domain bmwvin-decoder.com
Base Domain bmwvin-decoder.com
Scan Status Ok
Last Scan2026-02-24T06:12:50+00:00
Next Scan 2026-03-03T06:12:50+00:00

Last Scan

Scanned2026-02-24T06:12:50+00:00
URL https://bmwvin-decoder.com/robots.txt
Domain IPs 72.60.203.128
Response IP 72.60.203.128
Found Yes
Hash 0585710ac9ed3b686d48f6495fb91207447d16f1c0576e0566d5e3215e73ca70
SimHash 40951f53e642

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /search?
Allow /sitemap.xml
Allow /sitemap-*.xml
Allow /feed.xml

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://bmwvin-decoder.com/sitemap.xml
sitemap https://bmwvin-decoder.com/sitemap-pages.xml
sitemap https://bmwvin-decoder.com/sitemap-models.xml
sitemap https://bmwvin-decoder.com/sitemap-sacodes.xml
sitemap https://bmwvin-decoder.com/sitemap-news.xml
Back to top

Comments

  • BMW VIN Decoder - Robots.txt
  • https://www.robotstxt.org/
  • Disallow admin and API endpoints
  • Disallow search results
  • Allow specific files
  • Crawl delay - removed for faster crawling (better for SEO)
  • Crawl-delay: 1
  • Sitemap locations with absolute URLs
  • Additional directives
  • Block bad bots
Back to top