astcrm.com
robots.txt

Robots Exclusion Standard data for astcrm.com

Resource Scan

Scan Details

Site Domain astcrm.com
Base Domain astcrm.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-11-21T05:39:29+00:00
Next Scan 2025-12-21T05:39:29+00:00

Last Successful Scan

Scanned2025-10-21T22:12:50+00:00
URL https://astcrm.com/robots.txt
Domain IPs 109.237.138.13
Response IP 109.237.138.13
Found Yes
Hash 5ad6f7dc49ddbcbff3ae2d45fd115e2080f245536ee67c563df5fe4d3e8ece91
SimHash 7b09c956abb1

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.astcrm.com/sitemap.xml
sitemap https://www.astcrm.com/sitemapindex.xml
sitemap https://www.astcrm.com/sitemapmobileindex.xml
sitemap https://www.astcrm.com/sitemap-hot-2996999.xml
sitemap https://www.astcrm.com/sitemap-hot-2994999.xml
sitemap https://www.astcrm.com/sitemap-hot-2992999.xml
sitemap https://www.astcrm.com/sitemap-hot-2990999.xml
sitemap https://www.astcrm.com/sitemap-hot-2988999.xml
sitemap https://www.astcrm.com/sitemap-hot-2986999.xml
sitemap https://www.astcrm.com/sitemap-hot-2984999.xml
sitemap https://www.astcrm.com/sitemap-hot-2982999.xml
sitemap https://www.astcrm.com/sitemap-hot-2980999.xml
sitemap https://www.astcrm.com/sitemap-hot-2978999.xml
sitemap https://www.astcrm.com/sitemap-hot-2976999.xml
sitemap https://www.astcrm.com/sitemap-hot-2974999.xml
sitemap https://www.astcrm.com/sitemap-hot-2972999.xml
sitemap https://www.astcrm.com/sitemap-hot-2970999.xml
sitemap https://www.astcrm.com/sitemap-hot-2968999.xml
sitemap https://www.astcrm.com/sitemap-hot-2966999.xml