maukerja.my
robots.txt

Robots Exclusion Standard data for maukerja.my

Resource Scan

Scan Details

Site Domain maukerja.my
Base Domain maukerja.my
Scan Status Ok
Last Scan2024-11-16T01:29:34+00:00
Next Scan 2024-11-23T01:29:34+00:00

Last Scan

Scanned2024-11-16T01:29:34+00:00
URL https://maukerja.my/robots.txt
Redirect https://www.maukerja.my/robots.txt
Redirect Domain www.maukerja.my
Redirect Base maukerja.my
Domain IPs 104.26.10.67, 104.26.11.67, 172.67.75.193, 2606:4700:20::681a:a43, 2606:4700:20::681a:b43, 2606:4700:20::ac43:4bc1
Redirect IPs 104.26.10.67, 104.26.11.67, 172.67.75.193, 2606:4700:20::681a:a43, 2606:4700:20::681a:b43, 2606:4700:20::ac43:4bc1
Response IP 104.26.11.67
Found Yes
Hash e625882d88648b224b043de31f7c3cb090491766b9882124dd241812a4d802ef
SimHash c2154a42fe10

Groups

*

Rule Path
Disallow /jobseeker-login$
Disallow /jobseeker$
Disallow /job/apply-job?*
Disallow /api/*
Disallow /v3mkapi/*
Disallow /search/*
Disallow /v1/*
Disallow /mkrbapi/*
Disallow /adhjobclick/*
Disallow /*/apply.php?
Disallow /job-region/
Disallow /en/job-region/
Disallow /ms/job-region/
Disallow /zh/job-region/
Disallow /rnetjobclick/
Disallow /jobs/
Disallow /en/jobs/
Disallow /ms/jobs/
Disallow /zh/jobs/
Disallow /content/search*
Disallow /en/content/search*
Disallow /ms/content/search*
Disallow /zh/content/search*
Disallow /v3-company-service/*
Disallow /job/read/
Disallow /job/*/search
Disallow /v3/search/
Disallow /job-impresion/

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /