nijobs.com
robots.txt

Robots Exclusion Standard data for nijobs.com

Resource Scan

Scan Details

Site Domain nijobs.com
Base Domain nijobs.com
Scan Status Ok
Last Scan2024-11-10T22:56:54+00:00
Next Scan 2024-11-17T22:56:54+00:00

Last Scan

Scanned2024-11-10T22:56:54+00:00
URL https://nijobs.com/robots.txt
Redirect https://www.nijobs.com:443/robots.txt
Redirect Domain www.nijobs.com
Redirect Base nijobs.com
Domain IPs 52.19.66.145, 54.75.153.26, 99.81.5.137
Redirect IPs 23.210.105.94
Response IP 23.210.105.94
Found Yes
Hash 17299899fa8bdd7b3c6926c6e8feef0f637acc36576b8c3f5c054a4438bece18
SimHash f6c55aa97322

Groups

adidxbot
twitterbot

Product Comment
adidxbot GA 13/04/23
twitterbot GA 13/04/23
Rule Path Comment
Allow /$ GA 13/04/23
Allow /job/ GA 13/04/23
Allow /jobs/ GA 13/04/23
Allow /account/register$ GA 13/04/23
Allow /careeradvice/ GA 13/04/23
Allow /*?WT.mc_id= GA 13/04/23
Allow /*%26WT.mc_id%3D GA 13/04/23
Allow /*DCMP%3D GA 13/04/23
Allow /*campaign-id%3D GA 13/04/23
Allow /recruiters/ GA 13/04/23
Allow /recruiters-news/ MA 13/04/23

applebot
bingbot
bingpreview
msnbot
slurp

Rule Path Comment
Allow /$ -
Allow /JobSearch/ -
Allow /job/ -
Disallow /job/*? -
Allow /jobs/ -
Allow /jobs/*?q= -
Disallow /jobs/*?q=*& -
Disallow /jobs/*? -
Allow /jobs-at/ -
Disallow /jobs-at/*? -
Allow /careeradvice/ GA 15/11/22
Disallow /careeradvice/*? GA 15/11/22
Disallow /salary-checker/ GA 15/11/22
Disallow /salary-checker/*? -
Allow /recruiters/ -
Disallow /recruiters/*? -
Disallow /insidejob/ GA 15/11/22
Disallow /insidejob/*? -
Allow /courses/ -
Disallow /courses/*? -
Disallow / -
Allow /.well-known/ RD 25/8/22

*

Rule Path Comment
Allow /*?*&crawl=true$ -
Allow /*WT.mc_id%3DA_RE_GOOORG* -
Allow /*WT.mc_id%3DA_SE_Go* added 28/01/2020
Allow /*WT.mc_id%3DR_AE_* added 05/05/2020
Allow /*WT.mc_id%3DB2B-* added 06/05/2021 RD
Disallow /*WT.mc_id%3D -
Disallow /courses/search-results? -
Disallow /CompanySearch/CompanyLogoLink.asp -
Disallow /CompanySearch/CompanyVacancies.aspx -
Disallow /LearnDirect/ -
Disallow /*w%3D*%26as%3D -
Disallow /*DCMP%3D -
Disallow /*campaign-id%3D -
Disallow /*utm_medium%3D -
Disallow /browse-jobs?redir=*&CompanyTerm= -
Disallow /browse-jobs?redir=*&Keywords=& -
Disallow /*/main.asp -
Disallow /entry -
Disallow /*Visitor-Source%3D -
Allow /*?q*&page= 8/9/2017
Disallow /*%3D%3D$ 2/11/2016
Disallow /*.ashx$ -
Disallow /*%26page%3D this is where there is a page parameter on a facited link - its a catch all
Disallow /*similarjobsmodal%3D -
Disallow /*entryUrl%3D 5/10/18 RD
Disallow /*entryurl%3D 5/10/18 RD
Disallow /job/*Visitor-Source%3D 5/10/18 RD
Disallow /jsd/ -
Disallow /insidejob/wp-admin/ -
Disallow /*/apply? -
Disallow /*/apply$ -
Disallow /Login/ -
Disallow /savedjobs -
Disallow /personalisation/ -
Disallow /Accessible/ -
Disallow /Authenticated/ -
Disallow /authenticated/ -
Disallow /cannedsearch/ -
Disallow /CannedSearch/ -
Disallow /CompanySearch/CompanyProfileFrameset.aspx -
Disallow /*/JobSearch/JobContactDetails.aspx -
Disallow /*/JobSearch/JobPrinterFriendlyDetails.aspx -
Disallow /*/JobSearch/Results.aspx -
Disallow /*/JobSearch/SendToAFriend.aspx -
Disallow /*/JobSearch/UnAuthApplyOnline.aspx -
Disallow /*Broaden%3D -
Disallow /*Rate%3D -
Disallow /*RateType%3D -
Disallow /*ValidFromDay%3D -
Disallow /*CompanyType%3D -
Disallow /*JobTitle%3D -
Disallow /*Discipline%3D -
Disallow /*JobType1%3D -
Disallow /*JobType%3D -
Disallow /*Radius%3D -
Disallow /*companytype%3D 5/10/18 RD
Disallow /*%26radius%3D -
Disallow /*?radius= -
Disallow /*industry%3D 2/12/20 RD
Disallow /*Industry%3D -
Disallow /*salary%3D -
Disallow /*Salary%3D -
Disallow /*jobtype%3D -
Disallow /*postedwithin%3D -
Disallow /*PostedWithin%3D -
Disallow /*duration%3D 9/4/19 RD
Disallow /JobSearch/JobBasket.aspx -
Disallow /JobSearch/JobContactDetails.aspx -
Disallow /JobSearch/JobPrinterFriendlyDetails.aspx -
Disallow /JobSearch/jobs-on-a-map.aspx -
Disallow /JobSearch/PromotedClick.aspx -
Disallow /JobSearch/SendToAFriend.aspx -
Disallow /JobSearch/UnAuthApplyOnline.aspx -
Disallow /JobSearch/PreExternalApplyOnline.aspx -
Disallow /JobSearch/JobsByEmailSetup.aspx -
Disallow /Jobsearch/Results.aspx -
Disallow /JobSearch/*/api/ -
Disallow /jobsearch/*/api/ -
Disallow /help/ -
Disallow */articledetail.asp -
Disallow */archivedetails.asp -
Disallow /LocationHub/ -
Disallow /jobs-at/jobs/in- -
Disallow /jobs-at/*/jobs/part-time/ -
Disallow /jobs-at/*/jobs/permanent/ -
Disallow /jobs-at/*/jobs/contract/ -
Disallow /jobs-at/*/jobs/temporary/ -
Disallow /mail_rd.asp -
Disallow /newwave_rd.asp -
Disallow /sitecore/*/www. -
Disallow /careeradvice/*/www. GA 15/11/22
Disallow /JobSearch/LocationSelect.aspx -
Disallow /JobSearch/EmailLink.aspx -
Disallow /JobSearch/JobMailRecruiter.aspx -
Disallow /*.swf$ -
Disallow /*/jbe/ -
Disallow /JobsByEmail/ -
Disallow /JobSearch/AdvancedJobSearch.aspx -
Disallow /account/ updated 01/02/15 RD
Allow /account/signin updated 02/12/22 GA
Disallow /Account/ updated 17/07/16 RD
Allow /Account/signin updated 02/12/22 GA
Disallow /*/similarjobs/* -
Disallow /Jobsearch/ApplyViaDocuments.aspx -
Disallow /~/ -
Disallow /login/ -
Disallow /Help/ -
Disallow /SalaryChecker/SalaryCheckerResults.aspx -
Disallow /jobseekers/*_new.asp -
Disallow /tag/ -
Disallow /jobwidget/ -
Allow /advertise- GA 15/11/22
Disallow /JobSearch/RSS.aspx -
Disallow /MSN/ -
Disallow /pgl/ -
Disallow /pjb_ui/ -
Disallow /WebServices/ -
Disallow /Webservices/ -
Disallow /Maintenance.aspx -
Disallow /service/nolayout.aspx -
Disallow /jobs-at/*/jobs/work-from-home/ -
Disallow /harm/ -
Disallow /*?action= -
Disallow /*%26action%3D -
Disallow /recruiters/campaign-* -
Allow /jobs/work-from-home GA 29/05/23 RD 25/10/23
Allow /jobs/temporary GA 29/05/23 RD 25/10/23
Disallow /jobs/permanent GA 29/05/23
Allow /jobs/contract GA 29/05/23 RD 25/10/23
Allow /jobs/part-time GA 29/05/23 RD 25/10/23
Disallow /jobs/work-from-home/*/in-* RD 31/10/23
Disallow /jobs/temporary/*/in-* RD 31/10/23
Disallow /jobs/contract/*/in-* RD 31/10/23
Disallow /jobs/part-time/*/in-* RD 31/10/23
Disallow /membersarea/ -
Disallow /membersarea -
Disallow /headerfooter/ -
Disallow /mya/ -
Disallow /optimizely-edge/ -
Disallow /analytics/analytics-library.js -
Disallow /*%26v%3D* -
Disallow /application/ -

Comments

  • nijobs.com - last edited GA 04/05/23
  • User-agent: AdsBot-Google # GA 13/04/23
  • User-agent: Mediapartners-Google # GA 13/04/23
  • Disallow: /jobs/*&r= # 5/10/18 RD
  • Disallow: /jobs/*?r= # 5/10/18 RD
  • 2/12/20 RD
  • 13/06/22 RD
  • 26/7/22 RD
  • 21/01/23 JM
  • 18/12/23 RD
  • 18/12/23 RD
  • 24/04/24 RD - removed 10/05/24 JM
  • Disallow: /jobs/*/in-*?*cmp=*