parts.vw.com
robots.txt

Robots Exclusion Standard data for parts.vw.com

Resource Scan

Scan Details

Site Domain parts.vw.com
Base Domain vw.com
Scan Status Ok
Last Scan2025-04-02T09:08:23+00:00
Next Scan 2025-05-02T09:08:23+00:00

Last Scan

Scanned2025-04-02T09:08:23+00:00
URL https://parts.vw.com/robots.txt
Domain IPs 198.24.56.251
Response IP 198.24.56.251
Found Yes
Hash 5c83e63443f22fe34f3ca99a487df905b14f1b4b638c0fed94e5f885f815c634
SimHash 603414f69243

Groups

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /a/*
Disallow /browseaccessories.aspx/GetCategoriesAndProducts
Disallow /cart.aspx/LogCartWidgetPage
Disallow /cart.aspx/RemoveFromCart
Disallow /cart.aspx/ReturnCartContents
Disallow /cart.aspx/ReturnCartNumberItems
Disallow /cart.aspx/ReturnCartSummary
Disallow /findDealer.aspx
Disallow /MyProfile.aspx
Disallow /productDetails.aspx/ReturnContinueShoppingLink
Disallow /productDetails.aspx/SendProductEmail
Disallow /productSearch.aspx
Disallow /requestReturn.aspx
Disallow /showAssembly.aspx
Disallow /showAssembly.aspx/GetHotspots
Disallow /showAssembly.aspx/ReturnContinueShoppingLink
Disallow /wholesaleAdd.aspx/GetPartName
Disallow /wm.aspx