bslsecurite.com
robots.txt

Robots Exclusion Standard data for bslsecurite.com

Resource Scan

Scan Details

Site Domain bslsecurite.com
Base Domain bslsecurite.com
Scan Status Ok
Last Scan2025-11-30T13:36:26+00:00
Next Scan 2025-12-30T13:36:26+00:00

Last Scan

Scanned2025-11-30T13:36:26+00:00
URL https://bslsecurite.com/robots.txt
Domain IPs 213.186.33.87
Response IP 213.186.33.87
Found Yes
Hash ccd9d72ddb69081aa166a1792f4656a2befc130c4c7b6501ad32ff67ff4f6bcf
SimHash cb495852eb92

Groups

scrapy

Rule Path
Allow /

googlebot

Rule Path
Allow *.css
Allow *.js

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-content/plugins/
Allow /wp-content/themes/
Allow /wp-admin/admin-ajax.php
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /wp-login.php
Disallow /wp-register.php

Comments

  • Googlebot
  • Other bot spider