astrogpt.me
robots.txt

Robots Exclusion Standard data for astrogpt.me

Resource Scan

Scan Details

Site Domain astrogpt.me
Base Domain astrogpt.me
Scan Status Ok
Last Scan2025-09-22T06:12:39+00:00
Next Scan 2025-09-29T06:12:39+00:00

Last Scan

Scanned2025-09-22T06:12:39+00:00
URL https://astrogpt.me/robots.txt
Domain IPs 104.21.94.81, 172.67.221.69, 2606:4700:3031::ac43:dd45, 2606:4700:3035::6815:5e51
Response IP 172.67.221.69
Found Yes
Hash 0379ef7d538cccc6223da4eccd46166e89f2446676fece439945954c9dbcf4c6
SimHash f90d5d44cd91

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /feed/
Disallow /comments/feed/

Other Records

Field Value
sitemap https://astrogpt.me/sitemap_index.xml