bestchoice4u.shop
robots.txt

Robots Exclusion Standard data for bestchoice4u.shop

Resource Scan

Scan Details

Site Domain bestchoice4u.shop
Base Domain bestchoice4u.shop
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-14T07:48:33+00:00
Next Scan 2025-04-15T07:48:33+00:00

Last Successful Scan

Scanned2024-11-24T05:56:57+00:00
URL https://bestchoice4u.shop/robots.txt
Redirect https://www.bestchoice4u.shop/robots.txt
Redirect Domain www.bestchoice4u.shop
Redirect Base bestchoice4u.shop
Domain IPs 34.213.124.12
Redirect IPs 34.213.124.12
Response IP 34.213.124.12
Found Yes
Hash ad14057124463da2eb55c534e5f62452b9cd3ffbb5002140ceb57b03e461544d
SimHash 804c5a607575

Groups

*

Rule Path
Allow /order/track
Disallow /order/
Disallow /account/
Disallow /manager/
Disallow /*/filter/
Disallow /*/product/
Disallow /*/color/
Disallow /*/department/
Disallow /*/style/
Disallow /contact/email

googlebot

Rule Path
Disallow /orders/receipt

teegraspbot

Rule Path
Disallow /

teeraidbot

Rule Path
Disallow /

facebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebot/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1