alienstarbooks.com
robots.txt

Robots Exclusion Standard data for alienstarbooks.com

Resource Scan

Scan Details

Site Domain alienstarbooks.com
Base Domain alienstarbooks.com
Scan Status Ok
Last Scan2025-11-27T15:48:16+00:00
Next Scan 2025-12-04T15:48:16+00:00

Last Scan

Scanned2025-11-27T15:48:16+00:00
URL http://alienstarbooks.com/robots.txt
Redirect http://www.alienstarbooks.com/robots.txt
Redirect Domain www.alienstarbooks.com
Redirect Base alienstarbooks.com
Domain IPs 199.34.228.147
Redirect IPs 199.34.228.147
Response IP 199.34.228.147
Found Yes
Hash 4e39b6b45e3163c27e2be7b641c4e16724e30cb7a76d2d67d01a681423c89edd
SimHash 2354dc762793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.AlienStarBooks.com/sitemap.xml