astronomer.rocks
robots.txt

Robots Exclusion Standard data for astronomer.rocks

Resource Scan

Scan Details

Site Domain astronomer.rocks
Base Domain astronomer.rocks
Scan Status Ok
Last Scan2025-07-20T01:18:34+00:00
Next Scan 2025-07-27T01:18:34+00:00

Last Scan

Scanned2025-07-20T01:18:34+00:00
URL http://astronomer.rocks/robots.txt
Redirect http://www.e-science.co.kr/robots.txt
Redirect Domain www.e-science.co.kr
Redirect Base e-science.co.kr
Domain IPs 175.45.193.144
Redirect IPs 175.45.193.144
Response IP 175.45.193.144
Found Yes
Hash 7c509bfcf52fbae7c7d2c0f7ce64d09ead68e029e2f285c410483059595b8ec9
SimHash 611d7884c393

Groups

*

Rule Path
Disallow /admin/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.e-science.co.kr/sitemap.xml