boityshair.co.za
robots.txt
Robots Exclusion Standard data for boityshair.co.za
Resource Scan
Scan Details
Site Domain | boityshair.co.za |
Base Domain | boityshair.co.za |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 6/4/2025, 4:08:16 AM |
Next Scan | 6/11/2025, 4:08:16 AM |
Last Successful Scan
Scanned | 5/27/2025, 4:06:06 AM |
URL | https://boityshair.co.za/robots.txt |
Domain IPs | 2a02:4780:84:6e27:5d66:37cd:b11:2665, 84.32.84.64 |
Response IP | 77.37.75.94 |
Found | Yes |
Hash | 44550840e26703f49d978e4aaf216ca614427d40811d7b1d476c04e6e519873f |
SimHash | eaa988022dba |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wc-logs/ |
Disallow | /wp-content/uploads/woocommerce_transient_files/ |
Disallow | /wp-content/uploads/woocommerce_uploads/ |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://boityshair.co.za/sitemap.xml |
sitemap | https://boityshair.co.za/news-sitemap.xml |
sitemap | https://boityshair.co.za/sitemap_index.xml |
Comments