crm-buzzee.fr
robots.txt

Robots Exclusion Standard data for crm-buzzee.fr

Resource Scan

Scan Details

Site Domain crm-buzzee.fr
Base Domain crm-buzzee.fr
Scan Status Ok
Last Scan2026-01-07T23:20:14+00:00
Next Scan 2026-02-06T23:20:14+00:00

Last Scan

Scanned2026-01-07T23:20:14+00:00
URL https://crm-buzzee.fr/robots.txt
Redirect https://www.crm-buzzee.fr/robots.txt
Redirect Domain www.crm-buzzee.fr
Redirect Base crm-buzzee.fr
Domain IPs 185.100.6.11
Redirect IPs 185.100.6.11
Response IP 185.100.6.11
Found Yes
Hash 8df688076bd089b71472467c432683919c480b0fb3894af34c366bd1e533bf55
SimHash b90118586703

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/css/
Disallow /wp-content/backupwordpress-a1454e5489-backups/
Disallow /wp-content/cache/
Disallow /wp-content/envato-backups/
Disallow /wp-content/images/
Disallow /wp-content/languages/
Disallow /wp-content/upgrade/
Disallow /readme.html
Disallow /*.txt
Allow *.css
Allow *.js

Other Records

Field Value
sitemap https://www.crm-buzzee.fr/sitemap_index.xml