jobs.jawatan-kerja.com
robots.txt

Robots Exclusion Standard data for jobs.jawatan-kerja.com

Resource Scan

Scan Details

Site Domain jobs.jawatan-kerja.com
Base Domain jawatan-kerja.com
Scan Status Ok
Last Scan2025-05-28T18:59:40+00:00
Next Scan 2025-06-27T18:59:40+00:00

Last Scan

Scanned2025-05-28T18:59:40+00:00
URL https://jobs.jawatan-kerja.com/robots.txt
Domain IPs 104.21.94.183, 172.67.139.122, 2606:4700:3030::ac43:8b7a, 2606:4700:3034::6815:5eb7
Response IP 104.21.94.183
Found Yes
Hash 403b37e13023e3280404cf904c9951b30abf03326478b5827f7b474dee419ba4
SimHash 4a0d50778e10

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

wget

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://jobs.jawatan-kerja.com/sitemap.xml.gz