starastrogpt.com
robots.txt

Robots Exclusion Standard data for starastrogpt.com

Resource Scan

Scan Details

Site Domain starastrogpt.com
Base Domain starastrogpt.com
Scan Status Ok
Last Scan2024-09-25T03:14:22+00:00
Next Scan 2024-10-02T03:14:22+00:00

Last Scan

Scanned2024-09-25T03:14:22+00:00
URL https://starastrogpt.com/robots.txt
Redirect https://www.starastrogpt.com/robots.txt
Redirect Domain www.starastrogpt.com
Redirect Base starastrogpt.com
Domain IPs 13.227.254.24, 13.227.254.53, 13.227.254.59, 13.227.254.97
Redirect IPs 13.35.186.28, 13.35.186.49, 13.35.186.72, 13.35.186.81, 2600:9000:200a:1200:1e:e746:d800:93a1, 2600:9000:200a:1c00:1e:e746:d800:93a1, 2600:9000:200a:5c00:1e:e746:d800:93a1, 2600:9000:200a:9200:1e:e746:d800:93a1, 2600:9000:200a:cc00:1e:e746:d800:93a1, 2600:9000:200a:d400:1e:e746:d800:93a1, 2600:9000:200a:f000:1e:e746:d800:93a1, 2600:9000:200a:fc00:1e:e746:d800:93a1
Response IP 13.227.254.59
Found Yes
Hash d5ad7c9a3c8c07948bcc7f649933bb63a56d86ea2a8f77e35daf3db82036966e
SimHash 4810cb826731

Groups

*

Rule Path
Allow /

Comments

  • Allow all crawlers

Warnings

  • 1 invalid line.