tkestore.com
robots.txt

Robots Exclusion Standard data for tkestore.com

Resource Scan

Scan Details

Site Domain tkestore.com
Base Domain tkestore.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-22T16:49:47+00:00
Next Scan 2025-06-20T16:49:47+00:00

Last Successful Scan

Scanned2024-05-20T16:48:00+00:00
URL https://tkestore.com/robots.txt
Domain IPs 104.21.78.207, 172.67.137.130, 2606:4700:3033::ac43:8982, 2606:4700:3037::6815:4ecf
Response IP 104.21.78.207
Found Yes
Hash 1aea7bece803115d483f15fe8e4f419a3fa274a87509820251b5645e0e9c79d9
SimHash 6f54de42fa3a

Groups

*

Rule Path
Disallow /login
Disallow /register
Disallow /cart
Disallow /collections/*sort*
Disallow /*/collections/*sort*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*

ahrefsbot

Rule Path
Disallow /login
Disallow /register
Disallow /cart
Disallow /collections/*sort*
Disallow /*/collections/*sort*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*

ahrefssiteaudit

Rule Path
Disallow /login
Disallow /register
Disallow /cart
Disallow /collections/*sort*
Disallow /*/collections/*sort*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*

adsbot-google

Rule Path
Disallow /login
Disallow /register
Disallow /cart

nutch

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Comments

  • https://www.robotstxt.org/robotstxt.html