Log In Sign Up

jobseeker.com
robots.txt

Robots Exclusion Standard data for jobseeker.com

Resource Scan

Scan Details

Site Domain jobseeker.com
Base Domain jobseeker.com
Scan Status Ok
Last Scan2024-05-20T10:52:16+00:00
Next Scan 2024-06-03T10:52:16+00:00

Last Scan

Scanned2024-05-20T10:52:16+00:00
URL https://jobseeker.com/robots.txt
Redirect https://www.jobseeker.com/robots.txt
Redirect Domain www.jobseeker.com
Redirect Base jobseeker.com
Domain IPs 13.33.88.3, 13.33.88.4, 13.33.88.75, 13.33.88.82, 2600:9000:223b:4000:4:9e5c:9c40:93a1, 2600:9000:223b:4a00:4:9e5c:9c40:93a1, 2600:9000:223b:5200:4:9e5c:9c40:93a1, 2600:9000:223b:5e00:4:9e5c:9c40:93a1, 2600:9000:223b:9600:4:9e5c:9c40:93a1, 2600:9000:223b:e600:4:9e5c:9c40:93a1, 2600:9000:223b:f400:4:9e5c:9c40:93a1, 2600:9000:223b:f600:4:9e5c:9c40:93a1
Redirect IPs 13.33.88.3, 13.33.88.4, 13.33.88.75, 13.33.88.82, 2600:9000:223b:3800:4:9e5c:9c40:93a1, 2600:9000:223b:4000:4:9e5c:9c40:93a1, 2600:9000:223b:6800:4:9e5c:9c40:93a1, 2600:9000:223b:8a00:4:9e5c:9c40:93a1, 2600:9000:223b:9e00:4:9e5c:9c40:93a1, 2600:9000:223b:a00:4:9e5c:9c40:93a1, 2600:9000:223b:ae00:4:9e5c:9c40:93a1, 2600:9000:223b:c000:4:9e5c:9c40:93a1
Response IP 13.33.88.75
Found Yes
Hash dbc0acc66dcdb0c6583a8ee7e181f68751da0b9c88381110eb1a2b46a280a325
SimHash 60088b4a8f23

Groups

*

Rule Path
Disallow *?title=
Disallow *%26title%3D
Disallow *?v=
Disallow *%26v%3D
Disallow *?pub=
Disallow *?cid=
Disallow *?reid=
Disallow *?inf=
Disallow *?act=
Disallow *?compid=
Disallow /cgi-sys/
Disallow */cancel-subscription*
Disallow */manage-subscription*
Disallow /api*
Disallow /app/*
Disallow /admin*
Allow /api/media/*
Allow /api/faq/*
Allow /api/user/report
Back to top

Other Records

Field Value
sitemap https://www.jobseeker.com/sitemap.xml
Back to top