bestofnativeamerican.com
robots.txt

Robots Exclusion Standard data for bestofnativeamerican.com

Resource Scan

Scan Details

Site Domain bestofnativeamerican.com
Base Domain bestofnativeamerican.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-14T06:58:56+00:00
Next Scan 2025-04-15T06:58:56+00:00

Last Successful Scan

Scanned2024-11-24T06:36:10+00:00
URL https://bestofnativeamerican.com/robots.txt
Redirect https://www.bestofnativeamerican.com/robots.txt
Redirect Domain www.bestofnativeamerican.com
Redirect Base bestofnativeamerican.com
Domain IPs 34.213.124.12
Redirect IPs 34.213.124.12
Response IP 34.213.124.12
Found Yes
Hash 51660d78a7bf9eb3463f37aef208006467bc94ac3784a793f113641715a92902
SimHash a10d5a61f535

Groups

*

Rule Path
Allow /order/track
Disallow /order/
Disallow /account/
Disallow /manager/
Disallow /*/filter/
Disallow /*/product/
Disallow /*/color/
Disallow /*/department/
Disallow /*/style/
Disallow /contact/email

googlebot

Rule Path
Disallow /orders/receipt

teegraspbot

Rule Path
Disallow /

teeraidbot

Rule Path
Disallow /

facebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebot/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.bestofnativeamerican.com/sitemap-index.xml