afablabor.com
robots.txt

Robots Exclusion Standard data for afablabor.com

Resource Scan

Scan Details

Site Domain afablabor.com
Base Domain afablabor.com
Scan Status Ok
Last Scan2025-08-30T22:00:52+00:00
Next Scan 2025-09-29T22:00:52+00:00

Last Scan

Scanned2025-08-30T22:00:52+00:00
URL https://afablabor.com/robots.txt
Redirect https://www.afablabor.com/robots.txt
Redirect Domain www.afablabor.com
Redirect Base afablabor.com
Domain IPs 199.34.228.152
Redirect IPs 199.34.228.152
Response IP 199.34.228.152
Found Yes
Hash e086f3e5f4e9f60aad20fb9403935a78a8187a0bdd203ba400dc2fbb0ae808f3
SimHash 431dfa66df96

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /samid.html
Disallow /request-board.html
Disallow /index.html
Disallow /fab-id-request.html
Disallow /samgp.html
Disallow /services-offered.html
Disallow /manpower-registration.html
Disallow /endorsement-for-gatepass.html
Disallow /anything-under-the-sun.html
Disallow /recruitment-assistance.html
Disallow /for-job-hunters.html
Disallow /about-us.html
Disallow /forlocatorshr.html
Disallow /masterlist.html
Disallow /watch-list-report.html
Disallow /apply-now.html
Disallow /http%3A//afab.gov.ph/
Disallow /online-referral-enrollment.html
Disallow /peso-referral-page.html
Disallow /peos-programs-and-activities.html
Disallow /job-quick-search.html
Disallow /samplemain.html
Disallow /pbrc_masterlist.html
Disallow /smfi_masterlist.html
Disallow /newhome.html
Disallow /home2.html
Disallow /osh-reports.html

Other Records

Field Value
sitemap https://www.afablabor.com/sitemap.xml