bnlconsulting.com
robots.txt

Robots Exclusion Standard data for bnlconsulting.com

Resource Scan

Scan Details

Site Domain bnlconsulting.com
Base Domain bnlconsulting.com
Scan Status Ok
Last Scan2024-10-17T09:15:18+00:00
Next Scan 2024-11-16T09:15:18+00:00

Last Scan

Scanned2024-10-17T09:15:18+00:00
URL https://bnlconsulting.com/robots.txt
Redirect https://www.bnlconsulting.com/robots.txt
Redirect Domain www.bnlconsulting.com
Redirect Base bnlconsulting.com
Domain IPs 13.33.30.112, 13.33.30.13, 13.33.30.15, 13.33.30.40
Redirect IPs 13.33.30.112, 13.33.30.13, 13.33.30.15, 13.33.30.40, 2600:9000:229f:4e00:1d:944d:1480:93a1, 2600:9000:229f:6200:1d:944d:1480:93a1, 2600:9000:229f:7600:1d:944d:1480:93a1, 2600:9000:229f:7800:1d:944d:1480:93a1, 2600:9000:229f:a800:1d:944d:1480:93a1, 2600:9000:229f:c600:1d:944d:1480:93a1, 2600:9000:229f:d000:1d:944d:1480:93a1, 2600:9000:229f:ee00:1d:944d:1480:93a1
Response IP 13.33.30.40
Found Yes
Hash 61005eca37cf43eb796a9fe47c3a2798a29bc4993ea2f05989e501b9799540e6
SimHash 301dcd1a0a97

Groups

*

Rule Path
Disallow /*.php$
Disallow /index.php*/
Disallow /*blog/blog
Disallow /*styles/styles/
Disallow /*scripts/scripts/
Disallow /*styles/scripts/
Disallow /*scripts/styles/
Disallow /privacy/

Comments

  • robotstxt.org
  • Disallow all files that end in .php
  • Disallow all files in the /index.php directory
  • Disallow all files that have a pattern matching /blog/blog
  • Disallow all files that have a pattern matching /styles/styles
  • Disallow all files that have a pattern matching /scripts/scripts
  • Disallow all files that have a pattern matching /styles/scripts
  • Disallow all files that have a pattern matching /scripts/styles
  • Disallow privacy