thewarriormindset.com
robots.txt

Robots Exclusion Standard data for thewarriormindset.com

Resource Scan

Scan Details

Site Domain thewarriormindset.com
Base Domain thewarriormindset.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-03T20:26:01+00:00
Next Scan 2025-12-02T20:26:01+00:00

Last Successful Scan

Scanned2021-12-07T15:17:25+00:00
URL https://thewarriormindset.com/robots.txt
Redirect https://www.thewarriormindset.com/robots.txt
Redirect Domain www.thewarriormindset.com
Redirect Base thewarriormindset.com
Response IP 104.18.232.91
Found Yes
Hash 43e446b1f8088cc026b80faae3e038ee93d35f49f11e81a3a3f08700b375ee13
SimHash 490cda60c791

Groups

semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap /sitemap.xml