bossjob.id
robots.txt

Robots Exclusion Standard data for bossjob.id

Resource Scan

Scan Details

Site Domain bossjob.id
Base Domain bossjob.id
Scan Status Ok
Last Scan2025-12-27T14:33:03+00:00
Next Scan 2026-01-03T14:33:03+00:00

Last Scan

Scanned2025-12-27T14:33:03+00:00
URL https://bossjob.id/robots.txt
Domain IPs 172.66.40.157, 172.66.43.99, 2606:4700:3108::ac42:289d, 2606:4700:3108::ac42:2b63
Response IP 172.66.40.157
Found Yes
Hash f31d1afd838ee577ea468005cc34094da6d489df3d7e8b5bd0ae42422f42ad5d
SimHash 491745e2a1d0

Groups

*

Rule Path
Allow /$
Allow /remote-job
Allow /en-us/remote-job
Allow /zh-cn/remote-job
Allow /zh-tw/remote-job
Allow /ja/remote-job
Allow /es-es/remote-job
Allow /pt-br/remote-job
Allow /ms/remote-job
Allow /id/remote-job
Allow /tr/remote-job
Allow /ar/remote-job
Allow /onsite-job
Allow /en-us/onsite-job
Allow /zh-cn/onsite-job
Allow /zh-tw/onsite-job
Allow /ja/onsite-job
Allow /es-es/onsite-job
Allow /pt-br/onsite-job
Allow /ms/onsite-job
Allow /id/onsite-job
Allow /tr/onsite-job
Allow /ar/onsite-job
Allow /web3-job
Allow /en-us/web3-job
Allow /zh-cn/web3-job
Allow /zh-tw/web3-job
Allow /ja/web3-job
Allow /es-es/web3-job
Allow /pt-br/web3-job
Allow /ms/web3-job
Allow /id/web3-job
Allow /tr/web3-job
Allow /ar/web3-job
Disallow /openhouse/
Disallow /resumetemplate
Disallow /*?*page=
Disallow /*?*sort=
Disallow /*?*filter=
Disallow /*?*region=
Disallow /*?*jobType=
Disallow /*?*salary=
Disallow /*?*salaryType=
Disallow /404
Disallow /en-us/404
Disallow /zh-cn/404
Disallow /zh-tw/404
Disallow /ja/404
Disallow /es-es/404
Disallow /pt-br/404
Disallow /ms/404
Disallow /id/404
Disallow /tr/404
Disallow /ar/404
Disallow /jobs-hiring
Disallow /en-us/jobs-hiring
Disallow /zh-cn/jobs-hiring
Disallow /zh-tw/jobs-hiring
Disallow /ja/jobs-hiring
Disallow /es-es/jobs-hiring
Disallow /pt-br/jobs-hiring
Disallow /ms/jobs-hiring
Disallow /id/jobs-hiring
Disallow /tr/jobs-hiring
Disallow /ar/jobs-hiring
Disallow /remote-jobs-hiring
Disallow /en-us/remote-jobs-hiring
Disallow /zh-cn/remote-jobs-hiring
Disallow /zh-tw/remote-jobs-hiring
Disallow /ja/remote-jobs-hiring
Disallow /es-es/remote-jobs-hiring
Disallow /pt-br/remote-jobs-hiring
Disallow /ms/remote-jobs-hiring
Disallow /id/remote-jobs-hiring
Disallow /tr/remote-jobs-hiring
Disallow /ar/remote-jobs-hiring
Disallow /web3-jobs-hiring
Disallow /en-us/web3-jobs-hiring
Disallow /zh-cn/web3-jobs-hiring
Disallow /zh-tw/web3-jobs-hiring
Disallow /ja/web3-jobs-hiring
Disallow /es-es/web3-jobs-hiring
Disallow /pt-br/web3-jobs-hiring
Disallow /ms/web3-jobs-hiring
Disallow /id/web3-jobs-hiring
Disallow /tr/web3-jobs-hiring
Disallow /ar/web3-jobs-hiring
Disallow /my-jobs
Disallow /en-us/my-jobs
Disallow /zh-cn/my-jobs
Disallow /zh-tw/my-jobs
Disallow /ja/my-jobs
Disallow /es-es/my-jobs
Disallow /pt-br/my-jobs
Disallow /ms/my-jobs
Disallow /id/my-jobs
Disallow /tr/my-jobs
Disallow /ar/my-jobs
Disallow /remote-jobs
Disallow /en-us/remote-jobs
Disallow /zh-cn/remote-jobs
Disallow /zh-tw/remote-jobs
Disallow /ja/remote-jobs
Disallow /es-es/remote-jobs
Disallow /pt-br/remote-jobs
Disallow /ms/remote-jobs
Disallow /id/remote-jobs
Disallow /tr/remote-jobs
Disallow /ar/remote-jobs

Other Records

Field Value
sitemap http://bossjob.id/sitemap.xml

Comments

  • Allow multilingual /remote-job
  • Allow multilingual /onsite-job
  • Allow multilingual /web3-job
  • Disallow useless or duplicate content
  • Disallow multilingual /404
  • Disallow multilingual /jobs-hiring
  • Disallow multilingual /remote-jobs-hiring
  • Disallow multilingual /web3-jobs-hiring
  • Disallow multilingual /my-jobs
  • Disallow multilingual /remote-jobs
  • Sitemap declarations