jwarm.net
robots.txt

Robots Exclusion Standard data for jwarm.net

Resource Scan

Scan Details

Site Domain jwarm.net
Base Domain jwarm.net
Scan Status Ok
Last Scan2026-03-10T05:09:26+00:00
Next Scan 2026-04-09T05:09:26+00:00

Last Scan

Scanned2026-03-10T05:09:26+00:00
URL https://jwarm.net/robots.txt
Redirect https://www.jwarm.net/robots.txt
Redirect Domain www.jwarm.net
Redirect Base jwarm.net
Domain IPs 211.1.228.74
Redirect IPs 211.1.228.74
Response IP 211.1.228.74
Found Yes
Hash 3667dfa74ccdc425159ce47cfc8547cf215b4780d3c37408dbad52fb8b0d70d3
SimHash 485ddc607493

Groups

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

Other Records

Field Value
sitemap https://www.jwarm.net/sitemap_xml/sitemap.xml
sitemap https://www.jwarm.net/sitemap_xml/job_list.xml
sitemap https://www.jwarm.net/sitemap_xml/job_detail.xml