bilslifts.com
robots.txt

Robots Exclusion Standard data for bilslifts.com

Resource Scan

Scan Details

Site Domain bilslifts.com
Base Domain bilslifts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-23T00:11:41+00:00
Next Scan 2024-11-21T00:11:41+00:00

Last Successful Scan

Scanned2023-04-08T19:48:39+00:00
URL https://bilslifts.com/robots.txt
Domain IPs 15.204.14.212
Response IP 15.204.14.212
Found Yes
Hash 157fecc95224b8548cf6e88a913f5d4c91cc44a8c6133ce6f629ebb8d84e660c
SimHash 238158438d13

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/

google bot

Rule Path
Allow /

google images

Rule Path
Allow /wp-content/uploads/

google media partners

Rule Path
Allow /

google adsbot

Rule Path
Allow /

google mobile

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

bing bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 240

semrushbot

Rule Path
Disallow /

msn bot

Rule Path
Allow /

msnbot media

Rule Path
Allow /wp-content/uploads/

apple bot

Rule Path
Allow /

yandex bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

yandex images

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 30

yahoo search (slurp bot)

Rule Path
Allow /

mauibot

Rule Path
Disallow /

baidu spider

Rule Path
Disallow /

baidu spider image

Rule Path
Allow /wp-content/uploads/

duckduckgo bot

Rule Path
Allow /

qwant

Rule Path
Allow /
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /*?orderby=price
Disallow /*?orderby=rating
Disallow /*?orderby=date
Disallow /*?orderby=price-desc
Disallow /*?orderby=popularity
Disallow /*?filter
Disallow /*add-to-cart%3D*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.bilsteinlifts.com/sitemap_index.xml

Comments

  • Loading Performance for Woocommerce