etaxjobs.com
robots.txt

Robots Exclusion Standard data for etaxjobs.com

Resource Scan

Scan Details

Site Domain etaxjobs.com
Base Domain etaxjobs.com
Scan Status Ok
Last Scan2024-06-09T08:16:31+00:00
Next Scan 2024-07-09T08:16:31+00:00

Last Scan

Scanned2024-06-09T08:16:31+00:00
URL https://etaxjobs.com/robots.txt
Redirect https://www.etaxjobs.com/robots.txt
Redirect Domain www.etaxjobs.com
Redirect Base etaxjobs.com
Domain IPs 64.253.47.37
Redirect IPs 64.253.47.37
Response IP 64.253.47.37
Found Yes
Hash 053691e5741c4fb8c7cf9b997b519559b0a56099bfd57b32347c7ee0ec1c95ae
SimHash 4f12ffe90d33

Groups

baiduspider

Rule Path
Disallow /

yandexcatalog

Rule Path
Disallow /

yandexfavicons

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

jakarta commons

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

powermarks

Rule Path
Disallow /

offbyone

Rule Path
Disallow /

nutraspace

Rule Path
Disallow /

nutch

Rule Path
Disallow /

jobcrawlerbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sightupbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

wise-guys

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

java

Rule Path
Disallow /

www-mechanize

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

spbot

Rule Path
Disallow /

docomo

Rule Path
Disallow /

pingdom.com_bot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

obot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

innosense

Rule Path
Disallow /

aghaven

Rule Path
Disallow /

jobrapido

Rule Path
Disallow /

mozilla/5.0 (compatible; jobrapido/1.1; +http://www.jobrapido.com)

Rule Path
Disallow /

mozilla/5.0 (jobrapido webpump)

Rule Path
Disallow /

*

Rule Path
Disallow /jobboard/cands/joblistings.asp
Disallow /jobboard/clients/cvget.asp
Disallow /jobboard/cands/JobApply.asp
Disallow /jobboard/cands/jobapply.asp
Disallow /jobboard/cands/jobApply2.asp
Disallow /jobboard/cands/jobApplyCand.asp
Disallow /jobboard/cands/jobApplyFull.asp
Disallow /jobboard/cands/jobApplyLink.asp
Disallow /jobboard/cands/applyemail.asp
Disallow /jobboard/tablet/
Disallow /jobboard/tablet/applyemail.asp
Disallow /jobboard/tablet/applyonlinecv.asp
Disallow /jobboard/mobile/applyemail.asp
Disallow /jobboard/mobile/applylinkedin.asp
Disallow /jobboard/mobile/applyonlinecv.asp
Disallow /jobboard/mobile/applysavedcv.asp

Other Records

Field Value
sitemap https://www.etaxjobs.com/18456EVERTON-sitemap-google.xml

Warnings

  • 2 invalid lines.