astanet.com
robots.txt

Robots Exclusion Standard data for astanet.com

Resource Scan

Scan Details

Site Domain astanet.com
Base Domain astanet.com
Scan Status Ok
Last Scan2025-08-19T02:41:33+00:00
Next Scan 2025-09-18T02:41:33+00:00

Last Scan

Scanned2025-08-19T02:41:33+00:00
URL http://astanet.com/robots.txt
Redirect https://www.asta.org/robots.txt
Redirect Domain www.asta.org
Redirect Base asta.org
Domain IPs 209.17.116.163
Redirect IPs 104.26.4.147, 104.26.5.147, 172.67.72.20, 2606:4700:20::681a:493, 2606:4700:20::681a:593, 2606:4700:20::ac43:4814
Response IP 172.67.72.20
Found Yes
Hash ad6e4809c6713eb8534fdbdd1dc3844ab072f184a5e7c4e48fe93f9bc4b4588c
SimHash 01465c255913

Groups

*

Rule Path
Disallow /Sitefinity/
Disallow /Sitefinity/Configuration/
Disallow /Sitefinity/Temp/
Disallow /Sitefinity/Logs/
Disallow /Sitefinity/Sitefinity.lic
Disallow /Contacts/
Disallow /Images/
Disallow /js/
Disallow /App_Master/
Disallow /App_Themes/
Disallow /bin/
Disallow /Custom/
Disallow /Flash/
Disallow /Images/

Other Records

Field Value
sitemap https://www.asta.org/sitemap/sitemap-index.xml