astronautix.com
robots.txt

Robots Exclusion Standard data for astronautix.com

Resource Scan

Scan Details

Site Domain astronautix.com
Base Domain astronautix.com
Scan Status Ok
Last Scan2024-06-14T11:28:05+00:00
Next Scan 2024-06-21T11:28:05+00:00

Last Scan

Scanned2024-06-14T11:28:05+00:00
URL http://astronautix.com/robots.txt
Domain IPs 159.65.39.21
Response IP 159.65.39.21
Found Yes
Hash 70b66fc2f9fbb83f1fcbe1525ed89428acf9fac35e5fef181c7a85c67b6c17ea
SimHash 2551a2c357b0

Groups

mediapartners-google

Rule Path
Allow *

applenewsbot

Rule Path
Allow *

adsbot-google

Rule Path
Allow *

googlebot-mobile

Rule Path
Allow *

bingbot

Rule Path
Allow *

bing

Rule Path
Allow *

yahoo-slurp

Rule Path
Allow *

ia_archiver

Rule Path
Allow *

*

Rule Path
Allow *