jobseeker.com
robots.txt

Robots Exclusion Standard data for jobseeker.com

Resource Scan

Scan Details

Site Domain jobseeker.com
Base Domain jobseeker.com
Scan Status Ok
Last Scan2024-10-21T20:24:39+00:00
Next Scan 2024-11-04T20:24:39+00:00

Last Scan

Scanned2024-10-21T20:24:39+00:00
URL https://jobseeker.com/robots.txt
Redirect https://www.jobseeker.com/robots.txt
Redirect Domain www.jobseeker.com
Redirect Base jobseeker.com
Domain IPs 13.35.238.123, 13.35.238.44, 13.35.238.5, 13.35.238.91, 2600:9000:2085:1c00:4:9e5c:9c40:93a1, 2600:9000:2085:5e00:4:9e5c:9c40:93a1, 2600:9000:2085:6600:4:9e5c:9c40:93a1, 2600:9000:2085:7000:4:9e5c:9c40:93a1, 2600:9000:2085:7200:4:9e5c:9c40:93a1, 2600:9000:2085:be00:4:9e5c:9c40:93a1, 2600:9000:2085:c200:4:9e5c:9c40:93a1, 2600:9000:2085:e00:4:9e5c:9c40:93a1
Redirect IPs 13.35.238.123, 13.35.238.44, 13.35.238.5, 13.35.238.91, 2600:9000:2085:3e00:4:9e5c:9c40:93a1, 2600:9000:2085:400:4:9e5c:9c40:93a1, 2600:9000:2085:4600:4:9e5c:9c40:93a1, 2600:9000:2085:7c00:4:9e5c:9c40:93a1, 2600:9000:2085:c200:4:9e5c:9c40:93a1, 2600:9000:2085:de00:4:9e5c:9c40:93a1, 2600:9000:2085:f000:4:9e5c:9c40:93a1, 2600:9000:2085:fe00:4:9e5c:9c40:93a1
Response IP 13.35.238.91
Found Yes
Hash d6ad781e78e710a45c9236400795d725da3680164dfa0b3767d1f103bfb80df1
SimHash 60188b4a8f23

Groups

*

Rule Path
Disallow *?title=
Disallow *%26title%3D
Disallow *?v=
Disallow *%26v%3D
Disallow *?pub=
Disallow *?cid=
Disallow *?reid=
Disallow *?inf=
Disallow *?act=
Disallow *?compid=
Disallow /cgi-sys/
Disallow */cancel-subscription*
Disallow */manage-subscription*
Disallow /api*
Disallow /app/*
Disallow /admin*
Allow /api/media/*
Allow /api/faq/*

Other Records

Field Value
sitemap https://www.jobseeker.com/sitemap.xml