cafpimaroc.com
robots.txt

Robots Exclusion Standard data for cafpimaroc.com

Resource Scan

Scan Details

Site Domain cafpimaroc.com
Base Domain cafpimaroc.com
Scan Status Ok
Last Scan2025-08-29T07:06:59+00:00
Next Scan 2025-09-28T07:06:59+00:00

Last Scan

Scanned2025-08-29T07:06:59+00:00
URL https://cafpimaroc.com/robots.txt
Redirect https://www.cafpimaroc.com/robots.txt
Redirect Domain www.cafpimaroc.com
Redirect Base cafpimaroc.com
Domain IPs 213.186.33.17
Redirect IPs 213.186.33.17
Response IP 213.186.33.17
Found Yes
Hash 2ac84d97ef3f70f9efe7c51648f34ef489cdc09c07429cba139188a10b47a0aa
SimHash 21d508b2c784

Groups

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /dashboard/
Disallow /user/
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

Comments

  • Allow all search engines to crawl the site
  • Allow everything else
  • Explicitly allow Google Ads resources