bennadel.com
robots.txt

Robots Exclusion Standard data for bennadel.com

Resource Scan

Scan Details

Site Domain bennadel.com
Base Domain bennadel.com
Scan Status Ok
Last Scan2025-10-24T21:46:05+00:00
Next Scan 2025-11-23T21:46:05+00:00

Last Scan

Scanned2025-10-24T21:46:05+00:00
URL https://bennadel.com/robots.txt
Redirect https://www.bennadel.com/robots.txt
Redirect Domain www.bennadel.com
Redirect Base bennadel.com
Domain IPs 104.21.86.177, 172.67.223.76, 2606:4700:3031::6815:56b1, 2606:4700:3031::ac43:df4c
Redirect IPs 104.21.86.177, 172.67.223.76, 2606:4700:3031::6815:56b1, 2606:4700:3031::ac43:df4c
Response IP 172.67.223.76
Found Yes
Hash 11482c937cdc1b3d9123524ced637ee46e6f6911e9edd21c95821b33f2721c63
SimHash 331d3dc4cad4

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /members/
Disallow /resources/team_nylon/
Disallow /resources/demo/kinky_calendar/
Disallow /resources/projects/kinky_calendar/demo/

Other Records

Field Value
sitemap https://www.bennadel.com/?event=google.sitemap

Comments

  • Robots.txt file created by http://www.webtoolcentral.com
  • For domain: https://www.bennadel.com
  • Point all spiders to my Google sitemap.
  • All robots will spider the domain
  • Disallow directory