work180.co
robots.txt

Robots Exclusion Standard data for work180.co

Resource Scan

Scan Details

Site Domain work180.co
Base Domain work180.co
Scan Status Ok
Last Scan2024-10-07T02:29:58+00:00
Next Scan 2024-11-06T02:29:58+00:00

Last Scan

Scanned2024-10-07T02:29:58+00:00
URL https://work180.co/robots.txt
Redirect https://work180.com/en-us/robots.txt
Redirect Domain work180.com
Redirect Base work180.com
Domain IPs 13.35.238.119, 13.35.238.13, 13.35.238.52, 13.35.238.72
Redirect IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash ecaca1296a1833617ee95c5a41828d5a4c036c44a975acceff6942db4571f0a4
SimHash 4f4877a2efb4

Groups

*

Rule Path
Disallow /r/
Disallow /for-women/employer/preview/
Disallow /job-search?*
Disallow /job-search/*?*
Disallow /api/
Disallow /wp-content/
Disallow /*/wp-content/

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://work180.com/sitemap.xml
sitemap https://work180.com/en-au/sitemap.xml
sitemap https://work180.com/en-gb/sitemap.xml
sitemap https://work180.com/en-us/server-sitemap.xml
sitemap https://work180.com/en-gb/server-sitemap.xml
sitemap https://work180.com/en-au/server-sitemap.xml
sitemap https://work180.com/global/sitemap.xml

Comments

  • *
  • SemrushBot
  • Host
  • Sitemaps
  • Wordpress Sitemap

Warnings

  • `host` is not a known field.