workabroad.ph
robots.txt

Robots Exclusion Standard data for workabroad.ph

Resource Scan

Scan Details

Site Domain workabroad.ph
Base Domain workabroad.ph
Scan Status Ok
Last Scan2025-09-06T07:36:46+00:00
Next Scan 2025-10-06T07:36:46+00:00

Last Scan

Scanned2025-09-06T07:36:46+00:00
URL https://workabroad.ph/robots.txt
Redirect https://www.workabroad.ph/robots.txt
Redirect Domain www.workabroad.ph
Redirect Base workabroad.ph
Domain IPs 104.18.41.198, 172.64.146.58
Redirect IPs 104.18.38.243, 172.64.149.13, 2606:4700:4401::ac40:950d, 2a06:98c1:3106::6812:26f3
Response IP 172.64.149.13
Found Yes
Hash eed25dcbc53e2a863a8d7c1bf76dd9186917c0b56b0bdc1b112f752b8f9d2d79
SimHash 0f786bc9c4a0

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mediapartners-google*

Rule Path
Disallow /ads/
Disallow /adspage/
Disallow /aws/
Disallow /bannerads/
Disallow /build/
Disallow /captcha/
Disallow /cgi-bin/
Disallow /cronjobs/
Disallow /facebook_api/
Disallow /fc/
Disallow /image_crop/
Disallow /jenkins/
Disallow /jobseekers/
Disallow /likod/
Disallow /paci/
Disallow /recaptcha/
Disallow /recruiters/
Disallow /services/
Disallow /webservice/
Disallow /application/
Disallow /system/
Disallow /backoffice/
Disallow /non-agency/
Disallow /download/
Disallow /services/
Disallow /services-v15/
Disallow /tour/

*

Rule Path
Disallow /ads/
Disallow /adspage/
Disallow /aws/
Disallow /bannerads/
Disallow /build/
Disallow /captcha/
Disallow /cgi-bin/
Disallow /cronjobs/
Disallow /facebook_api/
Disallow /fc/
Disallow /image_crop/
Disallow /jenkins/
Disallow /jobseekers/
Disallow /likod/
Disallow /paci/
Disallow /recaptcha/
Disallow /recruiters/
Disallow /services/
Disallow /webservice/
Disallow /application/
Disallow /system/
Disallow /backoffice/
Disallow /non-agency/
Disallow /download/
Disallow /services/
Disallow /services-v15/
Disallow /tour/

ia_archiver

Rule Path
Disallow /download/