Log In Sign Up

glassdoor.at
robots.txt

Robots Exclusion Standard data for glassdoor.at

Resource Scan

Scan Details

Site Domain glassdoor.at
Base Domain glassdoor.at
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-24T13:06:34+00:00
Next Scan 2024-12-23T13:06:34+00:00

Last Successful Scan

Scanned2023-03-04T16:56:48+00:00
URL https://glassdoor.at/robots.txt
Redirect https://www.glassdoor.at/robots.txt
Redirect Domain www.glassdoor.at
Redirect Base glassdoor.at
Domain IPs 104.16.67.10, 104.16.68.10
Redirect IPs 104.16.67.10, 104.16.68.10
Response IP 104.16.67.10
Found Yes
Hash a3c21b1c8c510c428c8e9b34c3d31e621a5b516f004a5792ba900bd5ba5202ae
SimHash 1091f98ac5d3

Groups

*

Rule Path
Disallow *ls%3Dorg*
Disallow /*?*hostSite=*
Disallow /1347171559/
Disallow /about/board/
Disallow /about/contact/
Disallow /about/faq/
Disallow /about/forCareerCenters/
Disallow /about/forLibraries/
Disallow /about/forStudents/
Disallow /about/guidelines/
Disallow /about/index/
Disallow /about/jobs/
Disallow /about/learn/
Disallow /about/overview/
Disallow /about/privacy/
Disallow /about/privacy/
Disallow /about/syndicationCenter/
Disallow /about/team/
Disallow /about/terms/
Disallow /about/widgetTerms/
Disallow /ajax/
Disallow /abtest
Disallow /browse/
Disallow /employerinfo/
Disallow /employerInfo/
Disallow /Entdecken/unternehmen-entdecken
Disallow /getAdSlotContentsAjax.htm
Disallow /home/
Disallow /integrations/facebook/glassdoor/eep
Disallow /jobview/
Disallow /legal/
Disallow /lists/
Disallow /more/
Disallow /Partner/
Allow /Partner/Konto/erstellen.htm
Disallow /partner/
Disallow /partner-center/
Disallow /partners/company/
Disallow /partners/insights/
Disallow /partners/jobs/
Disallow /partners/reports/
Disallow /partners/resumeView
Disallow /partners/settings/
Disallow /parts
Disallow /profile/
Allow /profile/login_input.htm
Allow /profile/joinNow_input.htm
Disallow /Resume/user-profile/
Disallow /rss/*
Disallow /Rungs/
Disallow /search/
Disallow /Search/
Disallow /survey/
Disallow /surveys
Disallow /util/
Disallow /getAdSlotContentsAjax.htm
Disallow /developer/widget/builder/
Disallow /hammer/
Disallow /employers/ec
Disallow /slink.htm
Disallow /*encryptedUserId
Disallow /*followId
Disallow /*userValidationKey
Disallow */trackClickAsync.htm
Disallow /mz-survey/
Disallow /user-activation/
Disallow /member/
Disallow /resume/build/
Disallow /userprofile/
Disallow /sourcing$
Disallow /searchsuggest$
Disallow /knowyourworth/
Disallow */*Ajax.htm
Disallow */json$
Disallow */json/
Disallow /Bewertungen/index.htm?
Disallow /Vergleich/auswaehlen
Disallow /track
Disallow /job-listing/details.htm?*
Disallow /job-listing/*_IE*.htm
Disallow /job-listing/JV.htm?*
Disallow /Job/*_IP*
Disallow /Jobs/*_P*.htm*
Disallow /Jobs/*_IP*.htm*
Disallow /Bewertungen/*_P*.htm*
Disallow /Bewertungen/*_IP*.htm*
Allow /Bewertungen/*-bewertungen-SRCH_*_IP2.htm*
Disallow /Vorstellungsgespr%C3%A4ch/*_P*.htm*
Disallow /Vorstellungsgespr%C3%A4ch/*_IP*.htm*
Disallow /Zusatzleistungen/*_IP*.htm*
Disallow /Geh%C3%A4lter/*_IP*.htm*
Allow /Geh%C3%A4lter/*_IP2.htm*
Allow /Geh%C3%A4lter/*_IP3.htm*
Allow /Geh%C3%A4lter/*_IP4.htm*
Allow /Geh%C3%A4lter/*_IP5.htm*
Disallow /1060761/*
Disallow /Bewertungen/Barbizon-scam-*

ia_archiver

Rule Path
Disallow /
Allow */index.htm

omniexplorer_bot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

baiduspider

Rule Path
Disallow /
Allow */index.htm
Back to top

Comments

  • Österreich
  • Blocking track urls (ACQ-2468)
  • Blocking non standard job view and job search URLs, and paginated job SERP URLs (TRFC-2831)
  • Blocking pagination on employer infosite
  • Blocking bots from crawling DoubleClick for Publisher and Google Analytics related URL's (which aren't real URL's)
  • TRFC-4037 Block page from being indexed
Back to top