100000jobs.ch
robots.txt

Robots Exclusion Standard data for 100000jobs.ch

Resource Scan

Scan Details

Site Domain 100000jobs.ch
Base Domain 100000jobs.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-08T02:06:58+00:00
Next Scan 2024-12-07T02:06:58+00:00

Last Successful Scan

Scanned2024-08-10T02:05:08+00:00
URL https://100000jobs.ch/robots.txt
Redirect https://www.100000jobs.ch/robots.txt
Redirect Domain www.100000jobs.ch
Redirect Base 100000jobs.ch
Domain IPs 217.20.195.199
Redirect IPs 217.20.195.199
Response IP 217.20.195.199
Found Yes
Hash 7986ab2fff118426504523f541f4ba9251a7a6f0438d6dea7da4af1a93ab2392
SimHash 2d51d3a05051

Groups

googlebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-mobile

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-image

Rule Path
Disallow /user/*
Disallow /job/redirect/*

mediapartners-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

adsbot-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-news

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-video

Rule Path
Disallow /user/*
Disallow /job/redirect/*

slurp

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot-media

Rule Path
Disallow /user/*
Disallow /job/redirect/*

applebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingpreview

Rule Path
Disallow /user/*
Disallow /job/redirect/*

duckduckbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

twitterbot/1.0

Rule Path
Disallow /user/*
Disallow /job/redirect/*

askjeeves

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebookexternalhit/1.1

Rule Path
Disallow /user/*
Disallow /job/redirect/*

*

Rule Path
Disallow /