glassdoor.com.au
robots.txt
Robots Exclusion Standard data for glassdoor.com.au
Resource Scan
Scan Details
| Site Domain | glassdoor.com.au |
| Base Domain | glassdoor.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-22T14:59:59+00:00 |
| Next Scan | 2024-12-21T14:59:59+00:00 |
Last Successful Scan
| Scanned | 2023-03-03T09:54:32+00:00 |
| URL | https://glassdoor.com.au/robots.txt |
| Redirect | https://www.glassdoor.com.au/robots.txt |
| Redirect Domain | www.glassdoor.com.au |
| Redirect Base | glassdoor.com.au |
| Domain IPs | 104.16.153.30, 104.16.203.90 |
| Redirect IPs | 104.16.153.30, 104.16.203.90 |
| Response IP | 104.16.203.90 |
| Found | Yes |
| Hash | 12aef2e3e777f791aa1e1da27c1e68934cb5a8f01dde5aa19d025050e70a7b39 |
| SimHash | 1b9e310945d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*hostSite=* |
| Disallow | /1347171559/ |
| Disallow | /about/board/ |
| Disallow | /about/contact/ |
| Disallow | /about/faq/ |
| Disallow | /about/forCareerCenters/ |
| Disallow | /about/forLibraries/ |
| Disallow | /about/forStudents/ |
| Disallow | /about/guidelines/ |
| Disallow | /about/index/ |
| Disallow | /about/jobs/ |
| Disallow | /about/learn/ |
| Disallow | /about/overview/ |
| Disallow | /about/privacy/ |
| Disallow | /about/privacy/ |
| Disallow | /about/syndicationCenter/ |
| Disallow | /about/team/ |
| Disallow | /about/terms/ |
| Disallow | /about/widgetTerms/ |
| Disallow | /ajax/ |
| Disallow | /abtest |
| Disallow | /browse/ |
| Disallow | /employerinfo/ |
| Disallow | /employerInfo/ |
| Disallow | /Explore/browse-companies |
| Disallow | /getAdSlotContentsAjax.htm |
| Disallow | /home/ |
| Disallow | /integrations/facebook/glassdoor/eep |
| Disallow | /jobview/ |
| Disallow | /legal/ |
| Disallow | /lists/ |
| Disallow | /more/ |
| Disallow | /partner/ |
| Disallow | /partner-center/ |
| Disallow | /partners/company/ |
| Disallow | /partners/insights/ |
| Disallow | /partners/jobs/ |
| Disallow | /partners/reports/ |
| Disallow | /partners/resumeView |
| Disallow | /partners/settings/ |
| Disallow | /parts |
| Disallow | /profile/ |
| Allow | /profile/login_input.htm |
| Allow | /profile/joinNow_input.htm |
| Disallow | /Resume/user-profile/ |
| Disallow | /rss/* |
| Disallow | /Rungs/ |
| Disallow | /search/ |
| Disallow | /Search/ |
| Disallow | /survey/ |
| Disallow | /surveys |
| Disallow | /util/ |
| Disallow | /getAdSlotContentsAjax.htm |
| Disallow | /developer/widget/builder/ |
| Disallow | /hammer/ |
| Disallow | /employers/ec |
| Disallow | /slink.htm |
| Disallow | /*encryptedUserId |
| Disallow | /*followId |
| Disallow | /*userValidationKey |
| Disallow | */trackClickAsync.htm |
| Disallow | /mz-survey/ |
| Disallow | /user-activation/ |
| Disallow | /member/ |
| Disallow | /resume/build/ |
| Disallow | /userprofile/ |
| Disallow | /sourcing$ |
| Disallow | /searchsuggest$ |
| Disallow | /knowyourworth/ |
| Disallow | /Reviews/index.htm? |
| Disallow | */lib$ |
| Disallow | */lib/ |
| Disallow | */globalize/ |
| Disallow | */globalize$ |
| Disallow | */ASCIISumThreshold$ |
| Disallow | */LogClient$ |
| Disallow | */MsgBuilder$ |
| Disallow | */UserAgent$ |
| Disallow | */Constants$ |
| Disallow | */init/ |
| Disallow | */init$ |
| Disallow | */LogServer$ |
| Disallow | */GDLogger$ |
| Disallow | */gd-perf$ |
| Disallow | */gd-site-hdr-dropdown$ |
| Disallow | */bundles$ |
| Disallow | */wait$ |
| Disallow | */extend$ |
| Disallow | */strings$ |
| Disallow | */strings/ |
| Disallow | */document$ |
| Disallow | */*Ajax.htm |
| Disallow | */json$ |
| Disallow | */json/ |
| Disallow | /Compare/choose |
| Disallow | /track |
| Disallow | /job-listing/details.htm?* |
| Disallow | /job-listing/*_IE*.htm |
| Disallow | /job-listing/JV.htm?* |
| Disallow | /Job/*_IP* |
| Disallow | /Jobs/*_P*.htm* |
| Disallow | /Jobs/*_IP*.htm* |
| Disallow | /Reviews/*_P*.htm* |
| Disallow | /Reviews/*_IP*.htm* |
| Allow | /Reviews/*-reviews-SRCH_*_IP2.htm* |
| Disallow | /Interview/*_P*.htm* |
| Disallow | /Interview/*_IP*.htm* |
| Disallow | /Benefits/*_IP*.htm* |
| Disallow | /Salaries/*_IP*.htm* |
| Allow | /Salaries/*_IP2.htm* |
| Allow | /Salaries/*_IP3.htm* |
| Allow | /Salaries/*_IP4.htm* |
| Allow | /Salaries/*_IP5.htm* |
| Disallow | /1060761/* |
| Disallow | /Reviews/Barbizon-scam-* |
Comments