agle1.me
robots.txt

Robots Exclusion Standard data for agle1.me

Resource Scan

Scan Details

Site Domain agle1.me
Base Domain agle1.me
Scan Status Ok
Last Scan2025-10-02T19:13:26+00:00
Next Scan 2025-11-01T19:13:26+00:00

Last Scan

Scanned2025-10-02T19:13:26+00:00
URL http://www.agle1.me/robots.txt
Redirect https://www.agilecrm.com/robots.txt
Redirect Domain www.agilecrm.com
Redirect Base agilecrm.com
Domain IPs 96.45.82.161, 96.45.82.29, 96.45.83.240, 96.45.83.63
Redirect IPs 104.26.14.81, 104.26.15.81, 172.67.68.206, 2606:4700:20::681a:e51, 2606:4700:20::681a:f51, 2606:4700:20::ac43:44ce
Response IP 104.26.14.81
Found Yes
Hash 8e4eee5623c8ba68def0c7e09d3d0e2053966f3f363c1e8fa6166a094ac3575f
SimHash 989fb1006c1b

Groups

*

Rule Path
Disallow /blog/tag/
Disallow /blog/category/
Disallow /blog/wp-admin/
Disallow /*?utm_source
Disallow /*?utm_medium
Disallow /*?utm_campaign
Disallow /landing/
Disallow /newsletter/
Disallow /blog/author/
Disallow /blog/sample-page/
Disallow /test/
Disallow /registration-success
Disallow /blog/page/
Disallow /legalese/

Other Records

Field Value
sitemap https://www.agilecrm.com/sitemap.xml