recruiter.com
robots.txt
Robots Exclusion Standard data for recruiter.com
Resource Scan
Scan Details
| Site Domain | recruiter.com |
| Base Domain | recruiter.com |
| Scan Status | Ok |
| Last Scan | 2024-09-13T16:22:03+00:00 |
| Next Scan | 2024-10-13T16:22:03+00:00 |
Last Scan
| Scanned | 2024-09-13T16:22:03+00:00 |
| URL | https://recruiter.com/robots.txt |
| Redirect | https://www.recruiter.com/robots.txt |
| Redirect Domain | www.recruiter.com |
| Redirect Base | recruiter.com |
| Domain IPs | 3.165.102.33, 3.165.102.39, 3.165.102.41, 3.165.102.60 |
| Redirect IPs | 3.165.102.33, 3.165.102.39, 3.165.102.41, 3.165.102.60 |
| Response IP | 3.165.102.41 |
| Found | Yes |
| Hash | 1f718b0d18d52bc9162b44aa75059730d55432ea1275332be3c5d77ab4761b38 |
| SimHash | 5660bc6c7635 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*?767013ce0ee0f6d7a07587912eba3104cfaabc15 |
| Disallow | /web/ |
| Disallow | /jobs/web/ |
| Disallow | /*?s= |
| Disallow | /*?k= |
| Disallow | /*?q= |
| Disallow | /*%26p%3D |
| Disallow | /*%26o%3D |
| Disallow | /*/i/tag/ |
| Disallow | /*/i/category/ |
| Disallow | /*/i/taxonomy/ |
| Disallow | /*/i/archive/ |
| Disallow | /*/tag/ |
| Disallow | /*/category/ |
| Disallow | /*/archive/ |
| Disallow | /*.cfm |
| Disallow | /*.csv |
| Disallow | /*wp-admin/ |
| Disallow | /*wp-includes/ |
| Disallow | /*_pr_ |
| Disallow | /*_rw_ |
| Disallow | /*_pm_ |
| Disallow | /*_ts_ |
| Disallow | /*_tr_ |
| Disallow | /*_or_ |
| Disallow | /*_sp_ |
| Disallow | /*_hr_ |
| Disallow | /*_en_ |
| Disallow | /en_ |
| Disallow | /*_p_ |
| Disallow | /*_it_ |
| Disallow | /*_pbn_ |
| Disallow | /*_ep_ |
| Disallow | /*_pespective |
| Disallow | /*_PERSPECTIVE |
| Disallow | /*_OR_ |
| Disallow | /*_HR_ |
| Disallow | /*_P_ |
| Disallow | /*_PR_ |
| Disallow | /*01_ |
| Disallow | /*02_ |
| Disallow | /*03_ |
| Disallow | /*04_ |
| Disallow | /*05_ |
| Disallow | /*06_ |
| Disallow | /*07_ |
| Disallow | /*_TS_ |
| Disallow | /*_SP_ |
| Disallow | /*/recruiter-week- |
| Disallow | /*/wp-login.php |
| Disallow | /*/feed/ |
| Disallow | /a/ |
| Disallow | /articles/wp-content |
| Disallow | /blog/wp-content |
| Disallow | /recruiting-news/wp-content |
| Disallow | /glossary/wp-content |
| Disallow | /exchange/wp-content |
| Disallow | /forum/wp-content |
| Disallow | /career-development/wp-content |
| Disallow | /career-advice/wp-content |
| Disallow | /career-advice/wp-content/uploads |
| Disallow | /articles/wp-admin |
| Disallow | /blog/wp-admin |
| Disallow | /recruiting-news/wp-admin |
| Disallow | /glossary/wp-admin |
| Disallow | /exchange/wp-admin |
| Disallow | /forum/wp-admin |
| Disallow | /career-development/wp-admin |
| Disallow | /career-advice/wp-admin |
| Disallow | /articles/tag |
| Disallow | /blog/tag |
| Disallow | /recruiting-news/tag |
| Disallow | /glossary/tag |
| Disallow | /exchange/tag |
| Disallow | /forum/tag |
| Disallow | /career-development/tag |
| Disallow | /career-advice/tag |
| Disallow | /articles/category |
| Disallow | /blog/category |
| Disallow | /recruiting-news/category |
| Disallow | /glossary/category |
| Disallow | /exchange/category |
| Disallow | /forum/category |
| Disallow | /career-development/category |
| Disallow | /career-advice/category |
| Disallow | /sitemap.php |
| Disallow | /sitemap.html |
| Disallow | /sitemaplegacy.xml |
| Disallow | /sitemap.xml |
| Disallow | /humanresourcesnews.html |
| Disallow | /temporary.html |
| Disallow | /recruiter_privacypolicy.html |
| Disallow | /rw_ |
| Disallow | /tl_ |
| Disallow | /ss_ |
| Disallow | /pm_ |
| Disallow | /mk_ |
| Disallow | /br_ |
| Disallow | /salescontacts/ |
| Disallow | /magazineonline/ |
| Disallow | /featuredprofiles/ |
| Disallow | /enewsletter/ |
| Disallow | /pmnewsletter/ |
| Disallow | /Industrynewsletter/ |
| Disallow | /Technewsletter/ |
| Disallow | /jobtitlenewsletter/ |
| Disallow | /classifieds/ |
| Disallow | /byregion/ |
| Disallow | /byjobtitle/ |
| Disallow | /byindustry/ |
| Disallow | /bymetroarea/ |
| Disallow | /bio_ |
| Disallow | /adproduction |
| Disallow | /admin777 |
| Disallow | /Recruiter_info |
| Disallow | /RW_ |
| Disallow | /ourprofession/ |
| Disallow | /Perspectives/ |
| Disallow | /newsbyspecialty/ |
| Disallow | /newsstory/ |
| Disallow | /newsletter_pr/ |
| Disallow | /casestudies/ |
| Disallow | /clientmant/ |
| Disallow | /bio/ |
| Disallow | /bio_ |
| Disallow | /aboutrecruitercom.html |
| Disallow | /three-in-one.html |
| Disallow | /training_portal.html |
| Disallow | /iponews.html |
| Disallow | /manufacturingnews.html |
| Disallow | /marketnews.html |
| Disallow | /permanent.html |
| Disallow | /salesmarketingnews.html |
| Disallow | /pharmaceuticalnews.html |
| Disallow | /financialservicesnews.html |
| Disallow | /results.cfm |
| Disallow | /healthcarenews.html |
| Disallow | /telecommunicationnews.html |
| Disallow | /serviceprovider.html |
| Disallow | /recruiter_week_ |
| Disallow | /recruiter_services.html |
| Disallow | /magsubscribe.html |
| Disallow | /recruiter_advertise.html |
| Disallow | /magazine_subscriptionintro.html |
| Disallow | /survey.html |
| Disallow | /executivenews.html |
| Disallow | /PR_ |
| Disallow | /PM_ |
| Disallow | /AY/ |
| Disallow | /a/ |
| Disallow | /web/ |
| Disallow | /pespectives |
| Disallow | /Pespectives |
| Disallow | /hr-news.html |
| Disallow | /hr-articles.html |
| Disallow | /hr-glossary.html |
| Disallow | /redirect/ |
| Allow | /*.css?v= |
| Allow | /*.js?v= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.recruiter.com/jobssitemap.xml |
| sitemap | https://www.recruiter.com/careersitemap.xml |
| sitemap | https://www.recruiter.com/resumesitemap.xml |
| sitemap | https://www.recruiter.com/salarysitemap.xml |
| sitemap | https://www.recruiter.com/interviewsitemap.xml |
| sitemap | https://www.recruiter.com/recruiterssitemap.xml |
| sitemap | https://www.recruiter.com/hrsitemap.xml |
| sitemap | https://www.recruiter.com/aboutsitemap.xml |
| sitemap | https://www.recruiter.com/googlenews.xml |
| sitemap | https://www.recruiter.com/jobsitemap_index.xml |