constructionjobsnear.me
robots.txt
Robots Exclusion Standard data for constructionjobsnear.me
Resource Scan
Scan Details
Site Domain | constructionjobsnear.me |
Base Domain | constructionjobsnear.me |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-04T16:42:36+00:00 |
Next Scan | 2025-06-02T16:42:36+00:00 |
Last Successful Scan
Scanned | 2023-11-11T03:56:21+00:00 |
URL | https://constructionjobsnear.me/robots.txt |
Domain IPs | 104.21.84.40, 172.67.186.21, 2606:4700:3030::ac43:ba15, 2606:4700:3033::6815:5428 |
Response IP | 172.67.186.21 |
Found | Yes |
Hash | eb5cd795b3fd3b338f2bb40231f28c4940548126676af1997448f96894035a01 |
SimHash | 6001884043b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-content/uploads/ |
Allow | /wp-content/plugins/autoptimize/classes/external/* |
Allow | /wp-content/plugins/guten-post-layout/src/assets/js/custom.js |
Allow | /wp-content/plugins/guten-post-layout/src/assets/js/slick.min.js |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://constructionjobsnear.me/sitemap_index.xml |