brightside.com
robots.txt

Robots Exclusion Standard data for brightside.com

Resource Scan

Scan Details

Site Domain brightside.com
Base Domain brightside.com
Scan Status Ok
Last Scan2024-10-21T17:58:49+00:00
Next Scan 2024-11-20T17:58:49+00:00

Last Scan

Scanned2024-10-21T17:58:49+00:00
URL https://brightside.com/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 6f36ffbfee77b91e27d4512ffc2fba24a66a08954ece6d39584f35f8530bb84e
SimHash 89248822abb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed/*
Disallow /search/*

Comments

  • Reduce crawl waste