mygulfcareer.com
robots.txt
Robots Exclusion Standard data for mygulfcareer.com
Resource Scan
Scan Details
| Site Domain | mygulfcareer.com |
| Base Domain | mygulfcareer.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 6/2/2025, 11:50:08 AM |
| Next Scan | 6/9/2025, 11:50:08 AM |
Last Successful Scan
| Scanned | 5/25/2025, 11:49:38 AM |
| URL | https://mygulfcareer.com/robots.txt |
| Domain IPs | 2a02:4780:84:3f02:508d:8b70:693d:dafc, 84.32.84.98 |
| Response IP | 84.32.84.237 |
| Found | Yes |
| Hash | 0ff8019574835edea63d3fcb7adf7ea87934bac888cb1e1064b167ef9dfa2051 |
| SimHash | 6930d9004db0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /*/page/ |
| Disallow | /tag/ |
| Disallow | /feed/ |
| Disallow | /author/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://mygulfcareer.com/sitemap_index.xml |