workabroad.ph
robots.txt
Robots Exclusion Standard data for workabroad.ph
Resource Scan
Scan Details
Site Domain | workabroad.ph |
Base Domain | workabroad.ph |
Scan Status | Ok |
Last Scan | 2025-09-06T07:36:46+00:00 |
Next Scan | 2025-10-06T07:36:46+00:00 |
Last Scan
Scanned | 2025-09-06T07:36:46+00:00 |
URL | https://workabroad.ph/robots.txt |
Redirect | https://www.workabroad.ph/robots.txt |
Redirect Domain | www.workabroad.ph |
Redirect Base | workabroad.ph |
Domain IPs | 104.18.41.198, 172.64.146.58 |
Redirect IPs | 104.18.38.243, 172.64.149.13, 2606:4700:4401::ac40:950d, 2a06:98c1:3106::6812:26f3 |
Response IP | 172.64.149.13 |
Found | Yes |
Hash | eed25dcbc53e2a863a8d7c1bf76dd9186917c0b56b0bdc1b112f752b8f9d2d79 |
SimHash | 0f786bc9c4a0 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
mediapartners-google*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /adspage/ |
Disallow | /aws/ |
Disallow | /bannerads/ |
Disallow | /build/ |
Disallow | /captcha/ |
Disallow | /cgi-bin/ |
Disallow | /cronjobs/ |
Disallow | /facebook_api/ |
Disallow | /fc/ |
Disallow | /image_crop/ |
Disallow | /jenkins/ |
Disallow | /jobseekers/ |
Disallow | /likod/ |
Disallow | /paci/ |
Disallow | /recaptcha/ |
Disallow | /recruiters/ |
Disallow | /services/ |
Disallow | /webservice/ |
Disallow | /application/ |
Disallow | /system/ |
Disallow | /backoffice/ |
Disallow | /non-agency/ |
Disallow | /download/ |
Disallow | /services/ |
Disallow | /services-v15/ |
Disallow | /tour/ |
*
Rule | Path |
---|---|
Disallow | /ads/ |
Disallow | /adspage/ |
Disallow | /aws/ |
Disallow | /bannerads/ |
Disallow | /build/ |
Disallow | /captcha/ |
Disallow | /cgi-bin/ |
Disallow | /cronjobs/ |
Disallow | /facebook_api/ |
Disallow | /fc/ |
Disallow | /image_crop/ |
Disallow | /jenkins/ |
Disallow | /jobseekers/ |
Disallow | /likod/ |
Disallow | /paci/ |
Disallow | /recaptcha/ |
Disallow | /recruiters/ |
Disallow | /services/ |
Disallow | /webservice/ |
Disallow | /application/ |
Disallow | /system/ |
Disallow | /backoffice/ |
Disallow | /non-agency/ |
Disallow | /download/ |
Disallow | /services/ |
Disallow | /services-v15/ |
Disallow | /tour/ |