ricebowl.my
robots.txt
Robots Exclusion Standard data for ricebowl.my
Resource Scan
Scan Details
Site Domain | ricebowl.my |
Base Domain | ricebowl.my |
Scan Status | Ok |
Last Scan | 2024-11-15T10:00:42+00:00 |
Next Scan | 2024-11-22T10:00:42+00:00 |
Last Scan
Scanned | 2024-11-15T10:00:42+00:00 |
URL | https://ricebowl.my/robots.txt |
Redirect | https://www.ricebowl.my/robots.txt |
Redirect Domain | www.ricebowl.my |
Redirect Base | ricebowl.my |
Domain IPs | 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b |
Redirect IPs | 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b |
Response IP | 172.67.74.75 |
Found | Yes |
Hash | e625882d88648b224b043de31f7c3cb090491766b9882124dd241812a4d802ef |
SimHash | c2154a42fe10 |
Groups
*
Rule | Path |
---|---|
Disallow | /jobseeker-login$ |
Disallow | /jobseeker$ |
Disallow | /job/apply-job?* |
Disallow | /api/* |
Disallow | /v3mkapi/* |
Disallow | /search/* |
Disallow | /v1/* |
Disallow | /mkrbapi/* |
Disallow | /adhjobclick/* |
Disallow | /*/apply.php? |
Disallow | /job-region/ |
Disallow | /en/job-region/ |
Disallow | /ms/job-region/ |
Disallow | /zh/job-region/ |
Disallow | /rnetjobclick/ |
Disallow | /jobs/ |
Disallow | /en/jobs/ |
Disallow | /ms/jobs/ |
Disallow | /zh/jobs/ |
Disallow | /content/search* |
Disallow | /en/content/search* |
Disallow | /ms/content/search* |
Disallow | /zh/content/search* |
Disallow | /v3-company-service/* |
Disallow | /job/read/ |
Disallow | /job/*/search |
Disallow | /v3/search/ |
Disallow | /job-impresion/ |