kipling-usa.com
robots.txt

Robots Exclusion Standard data for kipling-usa.com

Resource Scan

Scan Details

Site Domain kipling-usa.com
Base Domain kipling-usa.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T00:23:11+00:00
Next Scan 2024-09-30T00:23:11+00:00

Last Successful Scan

Scanned2024-07-10T00:15:49+00:00
URL https://kipling-usa.com/robots.txt
Redirect https://www.kipling-usa.com/robots.txt
Redirect Domain www.kipling-usa.com
Redirect Base kipling-usa.com
Domain IPs 104.16.15.102
Redirect IPs 23.215.7.20, 23.215.7.24
Response IP 23.32.29.106
Found Yes
Hash de49aff38257576863efcd46b3d421c3f641e9270096bb77529cf69c2af42282
SimHash e34a9415b4e4

Groups

*

Rule Path
Disallow /*Cart-*
Disallow /*Account-*
Disallow /*Checkout-*
Disallow /*Login-*
Disallow /*Search-Show*
Disallow /*?cp=
Disallow /*?productId=
Disallow /*?parentPage=
Disallow /*?hasPagination=
Disallow /*?int_prevBucket=
Disallow /*?pageDisplay=
Disallow /*?showSizeSearch=
Disallow /*?doVSearch=
Disallow /*?page=
Disallow /*?pageBucket=
Disallow /*?pageNum=
Disallow /*?pageType=
Disallow /*?int_nextBucket=
Disallow /*?page_bucket=
Disallow /*?pageCount=
Disallow /*?totalProductsCount=
Disallow /*?clickid=
Disallow /*?MobileOptOut=
Disallow /*?csm=
Disallow /*?csa=
Disallow /*?csc=
Disallow /*?csu=
Disallow /*?jsessionid=
Disallow /*?crlt.pid=
Disallow /*?colorid=
Disallow /*?categoryId=
Disallow /*?prefn1=
Disallow /*?prefv1=
Disallow /*?eb=
Disallow /*?kw=
Disallow /*?StoreID=
Disallow /*?origkw=
Disallow /*?affiliateId=
Disallow /*?clickId=
Disallow /*?affiliateCustomId=
Disallow /*?prefn2=
Disallow /*?prefv2=
Disallow /*?view=
Disallow /*?srule=
Disallow /*?pmax=
Disallow /*?pmin=
Disallow /*?prefn3=
Disallow /*?prefv3=
Disallow /*?q=
Disallow /*?start=
Disallow /*?sz=
Disallow /*-1/
Disallow /*?filter_

pinterestbot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.kipling-usa.com/sitemap_index.xml

Comments

  • robots.txt for http://www.kipling.com/, can be overridden with business manager site settings
  • Disallow: /*?cid=
  • Disallow: /*?pid=
  • Disallow: /*?cgid=
  • Pinterestbot crawl rate