astanet.com
robots.txt
Robots Exclusion Standard data for astanet.com
Resource Scan
Scan Details
Site Domain | astanet.com |
Base Domain | astanet.com |
Scan Status | Ok |
Last Scan | 2025-08-19T02:41:33+00:00 |
Next Scan | 2025-09-18T02:41:33+00:00 |
Last Scan
Scanned | 2025-08-19T02:41:33+00:00 |
URL | http://astanet.com/robots.txt |
Redirect | https://www.asta.org/robots.txt |
Redirect Domain | www.asta.org |
Redirect Base | asta.org |
Domain IPs | 209.17.116.163 |
Redirect IPs | 104.26.4.147, 104.26.5.147, 172.67.72.20, 2606:4700:20::681a:493, 2606:4700:20::681a:593, 2606:4700:20::ac43:4814 |
Response IP | 172.67.72.20 |
Found | Yes |
Hash | ad6e4809c6713eb8534fdbdd1dc3844ab072f184a5e7c4e48fe93f9bc4b4588c |
SimHash | 01465c255913 |
Groups
*
Rule | Path |
---|---|
Disallow | /Sitefinity/ |
Disallow | /Sitefinity/Configuration/ |
Disallow | /Sitefinity/Temp/ |
Disallow | /Sitefinity/Logs/ |
Disallow | /Sitefinity/Sitefinity.lic |
Disallow | /Contacts/ |
Disallow | /Images/ |
Disallow | /js/ |
Disallow | /App_Master/ |
Disallow | /App_Themes/ |
Disallow | /bin/ |
Disallow | /Custom/ |
Disallow | /Flash/ |
Disallow | /Images/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.asta.org/sitemap/sitemap-index.xml |