astropro.com
robots.txt

Robots Exclusion Standard data for astropro.com

Resource Scan

Scan Details

Site Domain astropro.com
Base Domain astropro.com
Scan Status Ok
Last Scan2025-07-16T13:20:41+00:00
Next Scan 2025-08-15T13:20:41+00:00

Last Scan

Scanned2025-07-16T13:20:41+00:00
URL https://astropro.com/robots.txt
Domain IPs 66.175.58.9
Response IP 66.175.58.9
Found Yes
Hash 22de8c54004c814a9e11a197dde552569d5d03af36fea9decfd95012c7b56259
SimHash c816ea3583d1

Groups

*

Rule Path
Disallow /ads
Disallow /astrodat
Disallow /audio
Disallow /cards
Disallow /database
Disallow /features/conxions/cc*.html
Disallow /graphics
Disallow /homeIE4
Disallow /homeJS10
Disallow /homeJS11
Disallow /homeNOJS
Disallow /homeNS4
Disallow /horoscop/client
Disallow /links/linksMAIN.html
Disallow /links/linksTOPL.html
Disallow /links/linksTOPR.html
Disallow /reports/client
Disallow /search/net
Disallow /test
Disallow /utility
Disallow /homeIE45.html
Disallow /homeNS45.html
Disallow /indexL.html
Disallow /indexR.html
Disallow /robots.txt
Disallow /seti.html