work180.com
robots.txt
Robots Exclusion Standard data for work180.com
Resource Scan
Scan Details
| Site Domain | work180.com |
| Base Domain | work180.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T01:56:22+00:00 |
| Next Scan | 2024-10-20T01:56:22+00:00 |
Last Scan
| Scanned | 2024-09-20T01:56:22+00:00 |
| URL | https://work180.com/robots.txt |
| Redirect | https://work180.com/en-us/robots.txt |
| Domain IPs | 76.76.21.21 |
| Response IP | 76.76.21.21 |
| Found | Yes |
| Hash | ecaca1296a1833617ee95c5a41828d5a4c036c44a975acceff6942db4571f0a4 |
| SimHash | 4f4877a2efb4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /r/ |
| Disallow | /for-women/employer/preview/ |
| Disallow | /job-search?* |
| Disallow | /job-search/*?* |
| Disallow | /api/ |
| Disallow | /wp-content/ |
| Disallow | /*/wp-content/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://work180.com/sitemap.xml |
| sitemap | https://work180.com/en-au/sitemap.xml |
| sitemap | https://work180.com/en-gb/sitemap.xml |
| sitemap | https://work180.com/en-us/server-sitemap.xml |
| sitemap | https://work180.com/en-gb/server-sitemap.xml |
| sitemap | https://work180.com/en-au/server-sitemap.xml |
| sitemap | https://work180.com/global/sitemap.xml |
Warnings
- `host` is not a known field.
Comments