steepandcheap.com
robots.txt

Robots Exclusion Standard data for steepandcheap.com

Resource Scan

Scan Details

Site Domain steepandcheap.com
Base Domain steepandcheap.com
Scan Status Ok
Last Scan2024-09-22T20:44:00+00:00
Next Scan 2024-10-06T20:44:00+00:00

Last Scan

Scanned2024-09-22T20:44:00+00:00
URL https://steepandcheap.com/robots.txt
Redirect https://www.steepandcheap.com/robots.txt
Redirect Domain www.steepandcheap.com
Redirect Base steepandcheap.com
Domain IPs 125.252.218.157
Redirect IPs 125.252.218.157
Response IP 125.252.218.157
Found Yes
Hash a62ef62ba52713bd7fee91343d652a6ab90d4478c3fd1399ad0df00bd72cea33
SimHash bb3cc382d8e1

Groups

*

Rule Path
Disallow /demos/*
Disallow /foresee/*
Disallow /Store/account/account.jsp
Disallow /Store/cart/cart.jsp
Disallow /Store/checkout/checkout.jsp
Disallow /Store/checkout/receipt.jsp
Disallow /*/cart/add.html
Disallow /*/email_to_friend*
Disallow /*/order_history*
Disallow /*/user/*
Disallow /*/ilp.html
Disallow /*/serviceRequest.jsp*
Disallow /profile/none
Disallow /*nf%3D1
Disallow /cart
Disallow /checkout
Disallow /receipt
Disallow /klarnaProcessing
Disallow /account/*
Disallow /*.json
Disallow /api/*
Disallow /profile/*
Disallow /search*

caliperbot/1.0

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

covario-ids/1.0

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.steepandcheap.com/siteindex.xml

Warnings

  • 2 invalid lines.
  • `noindex` is not a known field.