Log In Sign Up

jobseeker.software
robots.txt

Robots Exclusion Standard data for jobseeker.software

Resource Scan

Scan Details

Site Domain jobseeker.software
Base Domain jobseeker.software
Scan Status Ok
Last Scan2026-03-07T20:41:59+00:00
Next Scan 2026-04-06T20:41:59+00:00

Last Scan

Scanned2026-03-07T20:41:59+00:00
URL https://jobseeker.software/robots.txt
Domain IPs 104.21.5.141, 172.67.154.165, 2606:4700:3030::6815:58d, 2606:4700:3035::ac43:9aa5
Response IP 172.67.154.165
Found Yes
Hash cb1ad9534f38b0ce785340826db0ad2164226a41115a683ab72ec8ef326bb19e
SimHash 62b0f093efb5

Groups

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot
gptbot
ccbot
google-extended

Rule Path
Disallow /en/
Disallow /id/
Disallow /vacancy/
Disallow /id_id/
Disallow /tag/
Disallow /?s=*
Allow /

googlebot
bingbot

Rule Path
Disallow /en/
Disallow /id/
Disallow /vacancy/
Disallow /id_id/
Disallow /tag/
Disallow /?s=*
Allow /

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-admin/
Disallow /en/
Disallow /id/
Disallow /vacancy/
Disallow /id_id/
Disallow /tag/
Disallow /?s=*
Disallow */ads.txt
Disallow */apple-app-site-association
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://jobseeker.software/sitemap_index.xml
Back to top

Comments

  • Allow AI search and agent use
  • Allow traditional search indexing
  • Disallow access to admin areas for all bots
Back to top