Log In Sign Up

biotech-jobs.ch
robots.txt

Robots Exclusion Standard data for biotech-jobs.ch

Resource Scan

Scan Details

Site Domain biotech-jobs.ch
Base Domain biotech-jobs.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-04T13:36:08+00:00
Next Scan 2024-12-03T13:36:08+00:00

Last Successful Scan

Scanned2024-08-06T13:34:57+00:00
URL https://biotech-jobs.ch/robots.txt
Domain IPs 217.20.195.199
Response IP 217.20.195.199
Found Yes
Hash 7986ab2fff118426504523f541f4ba9251a7a6f0438d6dea7da4af1a93ab2392
SimHash 2d51d3a05051

Groups

googlebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-mobile

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-image

Rule Path
Disallow /user/*
Disallow /job/redirect/*

mediapartners-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

adsbot-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-news

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-video

Rule Path
Disallow /user/*
Disallow /job/redirect/*

slurp

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot-media

Rule Path
Disallow /user/*
Disallow /job/redirect/*

applebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingpreview

Rule Path
Disallow /user/*
Disallow /job/redirect/*

duckduckbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

twitterbot/1.0

Rule Path
Disallow /user/*
Disallow /job/redirect/*

askjeeves

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebookexternalhit/1.1

Rule Path
Disallow /user/*
Disallow /job/redirect/*

*

Rule Path
Disallow /
Back to top