Log In Sign Up

metallbau-jobs.ch
robots.txt

Robots Exclusion Standard data for metallbau-jobs.ch

Resource Scan

Scan Details

Site Domain metallbau-jobs.ch
Base Domain metallbau-jobs.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-06T07:40:45+00:00
Next Scan 2024-12-05T07:40:45+00:00

Last Successful Scan

Scanned2024-08-08T07:39:52+00:00
URL https://metallbau-jobs.ch/robots.txt
Domain IPs 217.20.195.199
Response IP 217.20.195.199
Found Yes
Hash 7986ab2fff118426504523f541f4ba9251a7a6f0438d6dea7da4af1a93ab2392
SimHash 2d51d3a05051

Groups

googlebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-mobile

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-image

Rule Path
Disallow /user/*
Disallow /job/redirect/*

mediapartners-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

adsbot-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-news

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-video

Rule Path
Disallow /user/*
Disallow /job/redirect/*

slurp

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot-media

Rule Path
Disallow /user/*
Disallow /job/redirect/*

applebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingpreview

Rule Path
Disallow /user/*
Disallow /job/redirect/*

duckduckbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

twitterbot/1.0

Rule Path
Disallow /user/*
Disallow /job/redirect/*

askjeeves

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebookexternalhit/1.1

Rule Path
Disallow /user/*
Disallow /job/redirect/*

*

Rule Path
Disallow /
Back to top