careerguider.org
robots.txt
Robots Exclusion Standard data for careerguider.org
Resource Scan
Scan Details
Site Domain | careerguider.org |
Base Domain | careerguider.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-12T17:44:19+00:00 |
Next Scan | 2024-09-26T17:44:19+00:00 |
Last Successful Scan
Scanned | 2024-08-28T10:27:33+00:00 |
URL | https://careerguider.org/robots.txt |
Domain IPs | 2a02:4780:38:b998:79cd:dd08:1a8:b072, 77.37.66.220 |
Response IP | 77.37.66.58 |
Found | Yes |
Hash | 522b25187a98d0e76b8cf2f2b61e6d24032ed8f3fd6268ba9f922aaf197b225f |
SimHash | eb81a822cf93 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wc-logs/ |
Disallow | /wp-content/uploads/woocommerce_transient_files/ |
Disallow | /wp-content/uploads/woocommerce_uploads/ |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://careerguider.org/sitemap_index.xml |