agf.com
robots.txt

Robots Exclusion Standard data for agf.com

Resource Scan

Scan Details

Site Domain agf.com
Base Domain agf.com
Scan Status Ok
Last Scan2024-09-07T14:20:23+00:00
Next Scan 2024-10-07T14:20:23+00:00

Last Scan

Scanned2024-09-07T14:20:23+00:00
URL https://agf.com/robots.txt
Redirect https://www.agf.com/robots.txt
Redirect Domain www.agf.com
Redirect Base agf.com
Domain IPs 20.116.252.51
Redirect IPs 20.116.252.51
Response IP 20.116.252.51
Found Yes
Hash f31abadd6f15c456feba46c78102d1d27f7b6f11857e4cdd57833bd86180f7c6
SimHash c25edfb64475

Groups

*

Rule Path
Allow /
Allow /ca/fr/_url/
Allow /ca/en/_url/
Allow /capitalpartners/_url/
Allow /us/_url/
Disallow /t2scr/sharedDistT2scrWeb/
Disallow /t2scr/static/
Disallow /t2scr/fundprices/
Disallow /static/
Disallow /html5/
Disallow /ca/en/app/
Disallow /ca/fr/app/
Disallow /ca/en/email/
Disallow /ca/fr/courriel/
Disallow /jsp/
Disallow /t2scr/authmgmt/
Disallow /t2scr/static/app/ps_fundfinder/
Disallow demo.agf.com/
Disallow go.agf.com/
Disallow /_cascade/
Disallow /funpricesdownloadWeb/
Disallow /t2scr/authmgmt/
Disallow /t2scr/fundPricesWeb/public/
Disallow /t2scr/perfCalcWeb/
Disallow www.agfinvestments.com/
Disallow 199.43.0.131/
Disallow www.agfassetmanagement.com/
Disallow www.agfadvisor.com/
Disallow /ca/fr/_url/fund-links/fund-page-list-no-crawl.jsp
Disallow /ca/en/_url/fund-links/fund-page-list-no-crawl.jsp
Disallow /ca/en/products/common-sense/
Disallow /ca/en/products/concert/
Disallow /ca/fr/produits/simple-bon-sens/
Disallow /ca/fr/produits/concert/

Other Records

Field Value
sitemap https://www.agf.com/sitemap.xml