glassdoor.co.nz
robots.txt
Robots Exclusion Standard data for glassdoor.co.nz
Resource Scan
Scan Details
Site Domain | glassdoor.co.nz |
Base Domain | glassdoor.co.nz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-22T10:28:57+00:00 |
Next Scan | 2024-12-21T10:28:57+00:00 |
Last Successful Scan
Scanned | 2023-03-03T06:33:54+00:00 |
URL | https://glassdoor.co.nz/robots.txt |
Redirect | https://www.glassdoor.co.nz/robots.txt |
Redirect Domain | www.glassdoor.co.nz |
Redirect Base | glassdoor.co.nz |
Domain IPs | 104.16.196.89, 104.18.123.89 |
Redirect IPs | 104.16.196.89, 104.18.123.89 |
Response IP | 104.18.123.89 |
Found | Yes |
Hash | 9c8834a135c0581744e18850e503126e11858cf7d2ff7786e5eeba3abeb35525 |
SimHash | 1b9e330945db |
Groups
*
Rule | Path |
---|---|
Disallow | /*?*hostSite=* |
Disallow | /1347171559/ |
Disallow | /about/board/ |
Disallow | /about/contact/ |
Disallow | /about/faq/ |
Disallow | /about/forCareerCenters/ |
Disallow | /about/forLibraries/ |
Disallow | /about/forStudents/ |
Disallow | /about/guidelines/ |
Disallow | /about/index/ |
Disallow | /about/jobs/ |
Disallow | /about/learn/ |
Disallow | /about/overview/ |
Disallow | /about/privacy/ |
Disallow | /about/privacy/ |
Disallow | /about/syndicationCenter/ |
Disallow | /about/team/ |
Disallow | /about/terms/ |
Disallow | /about/widgetTerms/ |
Disallow | /ajax/ |
Disallow | /abtest |
Disallow | /browse/ |
Disallow | /employerinfo/ |
Disallow | /employerInfo/ |
Disallow | /Explore/browse-companies |
Disallow | /getAdSlotContentsAjax.htm |
Disallow | /home/ |
Disallow | /integrations/facebook/glassdoor/eep |
Disallow | /jobview/ |
Disallow | /legal/ |
Disallow | /lists/ |
Disallow | /more/ |
Disallow | /partner/ |
Disallow | /partner-center/ |
Disallow | /partners/company/ |
Disallow | /partners/insights/ |
Disallow | /partners/jobs/ |
Disallow | /partners/reports/ |
Disallow | /partners/resumeView |
Disallow | /partners/settings/ |
Disallow | /parts |
Disallow | /profile/ |
Allow | /profile/login_input.htm |
Allow | /profile/joinNow_input.htm |
Disallow | /Resume/user-profile/ |
Disallow | /rss/* |
Disallow | /Rungs/ |
Disallow | /search/ |
Disallow | /Search/ |
Disallow | /survey/ |
Disallow | /surveys |
Disallow | /util/ |
Disallow | /getAdSlotContentsAjax.htm |
Disallow | /developer/widget/builder/ |
Disallow | /hammer/ |
Disallow | /employers/ec |
Disallow | /slink.htm |
Disallow | /*encryptedUserId |
Disallow | /*followId |
Disallow | /*userValidationKey |
Disallow | */trackClickAsync.htm |
Disallow | /mz-survey/ |
Disallow | /user-activation/ |
Disallow | /member/ |
Disallow | /resume/build/ |
Disallow | /userprofile/ |
Disallow | /sourcing$ |
Disallow | /searchsuggest$ |
Disallow | /knowyourworth/ |
Disallow | /Reviews/index.htm? |
Disallow | */lib$ |
Disallow | */lib/ |
Disallow | */globalize/ |
Disallow | */globalize$ |
Disallow | */ASCIISumThreshold$ |
Disallow | */LogClient$ |
Disallow | */MsgBuilder$ |
Disallow | */UserAgent$ |
Disallow | */Constants$ |
Disallow | */init/ |
Disallow | */init$ |
Disallow | */LogServer$ |
Disallow | */GDLogger$ |
Disallow | */gd-perf$ |
Disallow | */gd-site-hdr-dropdown$ |
Disallow | */bundles$ |
Disallow | */wait$ |
Disallow | */extend$ |
Disallow | */strings$ |
Disallow | */strings/ |
Disallow | */document$ |
Disallow | */*Ajax.htm |
Disallow | */json$ |
Disallow | */json/ |
Disallow | /Compare/choose |
Disallow | /track |
Disallow | /job-listing/details.htm?* |
Disallow | /job-listing/*_IE*.htm |
Disallow | /job-listing/JV.htm?* |
Disallow | /Job/*_IP* |
Disallow | /Jobs/*_P*.htm* |
Disallow | /Jobs/*_IP*.htm* |
Disallow | /Reviews/*_P*.htm* |
Disallow | /Reviews/*_IP*.htm* |
Allow | /Reviews/*-reviews-SRCH_*_IP2.htm* |
Disallow | /Interview/*_P*.htm* |
Disallow | /Interview/*_IP*.htm* |
Disallow | /Benefits/*_IP*.htm* |
Disallow | /Salaries/*_IP*.htm* |
Allow | /Salaries/*_IP2.htm* |
Allow | /Salaries/*_IP3.htm* |
Allow | /Salaries/*_IP4.htm* |
Allow | /Salaries/*_IP5.htm* |
Disallow | /1060761/* |
Disallow | /Reviews/Barbizon-scam-* |
Comments