b-parts.com
robots.txt

Robots Exclusion Standard data for b-parts.com

Resource Scan

Scan Details

Site Domain b-parts.com
Base Domain b-parts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-03T08:49:44+00:00
Next Scan 2026-06-01T08:49:44+00:00

Last Successful Scan

Scanned2024-07-18T22:12:21+00:00
URL https://b-parts.com/robots.txt
Redirect https://www.b-parts.com:443/robots.txt/
Redirect Domain www.b-parts.com
Redirect Base b-parts.com
Domain IPs 3.165.82.115, 3.165.82.17, 3.165.82.72, 3.165.82.82
Redirect IPs 3.165.82.115, 3.165.82.17, 3.165.82.72, 3.165.82.82
Response IP 3.165.82.82
Found Yes
Hash a8dfb248b17ea407afc8120fbbaa48dadae6a23bcd9f9adc626fa38f1bc25ec8
SimHash 6e0a4a268983

Groups

*

Rule Path
Disallow /api/store/products/*/add_to_cart/
Disallow /api/store/price-request/
Disallow /api/store/products/*/shipping_price/
Disallow /api/store/customers/change_shipping_location/
Disallow /api/store/carts/*/change_shipping_destination/
Disallow /api/store/request-contact/
Disallow /api/store/images/
Disallow /api/store/part-requests/
Disallow /api/store/carts/*/
Disallow /api/store/carts/*/products_total/
Disallow /api/store/carts/*/remove_product/
Disallow /api/store/products/*/arbitrage/
Disallow /api/store/products/*/get_obs_trans/
Disallow /shop/*
Disallow /da/shop/*
Disallow /de/shop/*
Disallow /en/shop/*
Disallow /es/shop/*
Disallow /fr/shop/*
Disallow /it/shop/*
Disallow /pt/shop/*
Disallow /nb/shop/*
Disallow /nl/shop/*

mauibot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.b-parts.com/sitemap.xml

Warnings

  • `host` is not a known field.