bestseller-stores.com
robots.txt

Robots Exclusion Standard data for bestseller-stores.com

Resource Scan

Scan Details

Site Domain bestseller-stores.com
Base Domain bestseller-stores.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan4/7/2025, 11:42:16 AM
Next Scan 7/6/2025, 11:42:16 AM

Last Successful Scan

Scanned11/16/2024, 6:46:15 AM
URL https://bestseller-stores.com/robots.txt
Redirect https://www.bestseller-stores.com/robots.txt
Redirect Domain www.bestseller-stores.com
Redirect Base bestseller-stores.com
Domain IPs 34.213.124.12
Redirect IPs 34.213.124.12
Response IP 34.213.124.12
Found Yes
Hash ad14057124463da2eb55c534e5f62452b9cd3ffbb5002140ceb57b03e461544d
SimHash 804c5a607575

Groups

*

Rule Path
Allow /order/track
Disallow /order/
Disallow /account/
Disallow /manager/
Disallow /*/filter/
Disallow /*/product/
Disallow /*/color/
Disallow /*/department/
Disallow /*/style/
Disallow /contact/email

googlebot

Rule Path
Disallow /orders/receipt

teegraspbot

Rule Path
Disallow /

teeraidbot

Rule Path
Disallow /

facebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebot/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1