ricebowl.my
robots.txt

Robots Exclusion Standard data for ricebowl.my

Resource Scan

Scan Details

Site Domain ricebowl.my
Base Domain ricebowl.my
Scan Status Ok
Last Scan2024-09-20T09:31:19+00:00
Next Scan 2024-09-27T09:31:19+00:00

Last Scan

Scanned2024-09-20T09:31:19+00:00
URL https://ricebowl.my/robots.txt
Redirect https://www.ricebowl.my/robots.txt
Redirect Domain www.ricebowl.my
Redirect Base ricebowl.my
Domain IPs 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b
Redirect IPs 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b
Response IP 172.67.74.75
Found Yes
Hash e625882d88648b224b043de31f7c3cb090491766b9882124dd241812a4d802ef
SimHash c2154a42fe10

Groups

*

Rule Path
Disallow /jobseeker-login$
Disallow /jobseeker$
Disallow /job/apply-job?*
Disallow /api/*
Disallow /v3mkapi/*
Disallow /search/*
Disallow /v1/*
Disallow /mkrbapi/*
Disallow /adhjobclick/*
Disallow /*/apply.php?
Disallow /job-region/
Disallow /en/job-region/
Disallow /ms/job-region/
Disallow /zh/job-region/
Disallow /rnetjobclick/
Disallow /jobs/
Disallow /en/jobs/
Disallow /ms/jobs/
Disallow /zh/jobs/
Disallow /content/search*
Disallow /en/content/search*
Disallow /ms/content/search*
Disallow /zh/content/search*
Disallow /v3-company-service/*
Disallow /job/read/
Disallow /job/*/search
Disallow /v3/search/
Disallow /job-impresion/

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /