workme.net
robots.txt

Robots Exclusion Standard data for workme.net

Resource Scan

Scan Details

Site Domain workme.net
Base Domain workme.net
Scan Status Ok
Last Scan2025-12-01T06:26:01+00:00
Next Scan 2025-12-08T06:26:01+00:00

Last Scan

Scanned2025-12-01T06:26:01+00:00
URL https://workme.net/robots.txt
Domain IPs 176.9.11.135
Response IP 176.9.11.135
Found Yes
Hash 76090bb68533ae6f9b9aa2c0caa55ab9a48ec3a0bd68289990827a28c3cf4e7d
SimHash 6470bc014310

Groups

*

Rule Path
Disallow /tag/
Disallow */feed
Disallow */trackback
Disallow */page
Disallow /author/*
Disallow /201*
Disallow /template.html
Disallow /readme.html
Disallow *?replytocom
Disallow /register
Disallow /shop
Disallow /contact-us
Disallow /candidate-account
Disallow /employer-account
Disallow /es/*
Disallow */articles/*
Disallow */category/*
Disallow */search*
Disallow */items*
Disallow */news*
Allow */uploads
Allow *.js
Allow *.css
Allow *.png
Allow *.gif

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://workme.net/sitemap_index.xml

Warnings

  • `host` is not a known field.