fldcjobs.com
robots.txt

Robots Exclusion Standard data for fldcjobs.com

Resource Scan

Scan Details

Site Domain fldcjobs.com
Base Domain fldcjobs.com
Scan Status Ok
Last Scan2024-09-12T11:12:51+00:00
Next Scan 2024-10-12T11:12:51+00:00

Last Scan

Scanned2024-09-12T11:12:51+00:00
URL https://www.fldcjobs.com/robots.txt
Redirect https://www.fldocjobs.com/robots.txt
Redirect Domain www.fldocjobs.com
Redirect Base fldocjobs.com
Domain IPs 34.238.11.122
Redirect IPs 76.76.21.93, 76.76.21.98
Response IP 76.76.21.22
Found Yes
Hash f46c514f10ca01c5d39c41ae5832a6b0ffb0d9e75064b471fea7adcdd30ba58a
SimHash 681151c1c0f1

Groups

*

Rule Path
Disallow /

googlebot
bingbot
bingpreview
msnbot
slurp
duckduckbot
applebot
ia_archiver
facebookexternalhit
twitterbot
linkedinbot

Rule Path
Allow /
Disallow /admin/
Disallow /site_admin/
Disallow /search
Disallow /search/
Disallow /content/search
Disallow /content/advancedsearch
Disallow /content/tipafriend
Disallow /layout/set/print
Disallow /rss
Disallow /media/
Disallow /ezinfo/
Disallow /user/
Disallow /test-area/

Comments

  • Disallow all
  • But allow only important bots