job.kurier.at
robots.txt

Robots Exclusion Standard data for job.kurier.at

Resource Scan

Scan Details

Site Domain job.kurier.at
Base Domain kurier.at
Scan Status Ok
Last Scan2024-09-22T21:30:58+00:00
Next Scan 2024-10-22T21:30:58+00:00

Last Scan

Scanned2024-09-22T21:30:58+00:00
URL https://job.kurier.at/robots.txt
Domain IPs 138.201.75.97
Response IP 138.201.75.97
Found Yes
Hash 37252204c9ae62925746cc392cb4b30a7fb109a3350b44effeb641b71977a4f3
SimHash 0050dd9874c7

Groups

googlebot

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/UseResponsiveness
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

googlebot-image

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/UseResponsiveness
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

googlebot-mobile

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/UseResponsiveness
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

mediapartners-google

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/UseResponsiveness
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

adsbot-google

Rule Path
Disallow /api
Disallow /application
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/UseResponsiveness
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

msnbot

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

slurp

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

teoma

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

ia_archiver

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search.aspx
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

yahoo-mmcrawler

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

psbot

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

lycos_spider_(t-rex)

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

facebookexternalhit

Rule Path
Disallow /api
Disallow /application
Disallow /search
Disallow /Search
Disallow /Lead
Disallow /Toolbar
Disallow /Error
Disallow /error
Disallow /Partner
Disallow /partner
Disallow /UserFeature/NotedOffers
Disallow /UserFeature/RecentOffers
Disallow /UserFeature/LastSearches
Disallow /UserFeature/UseResponsiveness
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants
Allow /

*

Rule Path
Disallow /
Disallow /api
Disallow /application
Disallow /error
Disallow /search
Disallow /Partner
Disallow /partner
Disallow /Bewerben
Disallow /OfferDetail
Disallow /CachedImage
Disallow /RecentSearch
Disallow /Tracking/
Disallow /offerdetailsuggestedjobs
Disallow /tenants

Comments

  • robots.txt