thebooksterblog.com
robots.txt

Robots Exclusion Standard data for thebooksterblog.com

Resource Scan

Scan Details

Site Domain thebooksterblog.com
Base Domain thebooksterblog.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-14T16:45:43+00:00
Next Scan 2025-12-13T16:45:43+00:00

Last Successful Scan

Scanned2022-11-07T06:45:52+00:00
URL https://thebooksterblog.com/robots.txt
Redirect https://www.thebooksterblog.com/robots.txt
Redirect Domain www.thebooksterblog.com
Redirect Base thebooksterblog.com
Response IP 151.101.3.7, 151.101.67.7, 151.101.131.7, 151.101.195.7
Found Yes
Hash 5f9a0f6e61b8607fbb1f6b1914cc4fe4bac507b8bda66071469dce87d0c907a8
SimHash e8187485ef92

Groups

*

Rule Path
Disallow /ghost/
Disallow /p/
Disallow /email/
Disallow /r/

Other Records

Field Value
sitemap https://www.thebooksterblog.com/sitemap.xml