fejobs.com
robots.txt
Robots Exclusion Standard data for fejobs.com
Resource Scan
Scan Details
| Site Domain | fejobs.com |
| Base Domain | fejobs.com |
| Scan Status | Ok |
| Last Scan | 2026-01-30T08:14:08+00:00 |
| Next Scan | 2026-02-06T08:14:08+00:00 |
Last Scan
| Scanned | 2026-01-30T08:14:08+00:00 |
| URL | https://www.fejobs.com/robots.txt |
| Domain IPs | 81.19.56.208 |
| Response IP | 81.19.56.208 |
| Found | Yes |
| Hash | 6c342ac04511ef1717c3a74e0e04056d7b678694f1476770b8c79d083fcbc1c7 |
| SimHash | 6d32d237dbf3 |
Groups
googlebot-image
| Rule | Path |
|---|---|
| Disallow | /*.gif$ |
| Disallow | /*.jpg$ |
| Allow | /*/emp_logos/* |
| Allow | /*/Emp_logos/* |
| Allow | /*/Emp_Logos/* |
| Disallow | /*/Emp_Logos/*.*?* |
| Disallow | /*/new_emp_logos/*.*?* |
| Disallow | /*/emp_logos/*.*?* |
| Allow | /datafiles/sitemap/* |
| Allow | /media/ |
facebookbot
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 5 | 1 page per 5 seconds |
facebot
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 5 | 1 page per 5 seconds |
*
| Rule | Path |
|---|---|
| Disallow | *.axd |
| Disallow | /DATAFILES/* |
| Disallow | /SECUREDATAFILES/* |
| Disallow | /*.doc |
| Disallow | /*.docx |
| Disallow | /*.txt |
| Disallow | |
| Disallow | /datafiles/* |
| Disallow | /SecureDataFiles/* |
| Disallow | /securedatafiles/* |
| Allow | /*/emp_logos/* |
| Allow | /*/Emp_logos/* |
| Allow | /*/Emp_Logos/* |
| Allow | /datafiles/sitemap/* |
| Disallow | /printvacancy/* |
| Disallow | /*?redirecturl=* |
| Disallow | /*?dm_t=* |
| Disallow | /*?dm_i=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?Mobile=* |
| Disallow | /*?emailremoved* |
| Disallow | /*?VacancyExpired=* |
| Disallow | /*?populateJBE=* |
| Disallow | /*?contactmeforjob=* |
| Disallow | /*?userid=* |
| Disallow | /*?type=* |
| Disallow | /*?utm_creative=* |
| Disallow | /*?hl=* |
| Disallow | /*?jtid=* |
| Disallow | /*?fapp=* |
| Disallow | /*?vacid=* |
| Disallow | /*?ref=* |
| Disallow | /jobs*oo%3Dkw* |
| Disallow | /jobs*?*pagesize=* |
| Disallow | /jobs*?*orderby=* |
| Disallow | /*/Emp_Logos/*.*?* |
| Disallow | /*/new_emp_logos/*.*?* |
| Disallow | /*/emp_logos/*.*?* |
| Allow | /jobseekers/job/ |
| Disallow | /jobseekers/ |
| Allow | /jobseekers$ |
| Disallow | /jobs*?*pt=* |
| Disallow | /application-form/ |