Log In Sign Up

baustellenanzeiger.ch
robots.txt

Robots Exclusion Standard data for baustellenanzeiger.ch

Resource Scan

Scan Details

Site Domain baustellenanzeiger.ch
Base Domain baustellenanzeiger.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-08T06:04:46+00:00
Next Scan 2024-12-07T06:04:46+00:00

Last Successful Scan

Scanned2024-08-10T06:03:35+00:00
URL https://baustellenanzeiger.ch/robots.txt
Domain IPs 217.20.195.199
Response IP 217.20.195.199
Found Yes
Hash 7986ab2fff118426504523f541f4ba9251a7a6f0438d6dea7da4af1a93ab2392
SimHash 2d51d3a05051

Groups

googlebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-mobile

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-image

Rule Path
Disallow /user/*
Disallow /job/redirect/*

mediapartners-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

adsbot-google

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-news

Rule Path
Disallow /user/*
Disallow /job/redirect/*

googlebot-video

Rule Path
Disallow /user/*
Disallow /job/redirect/*

slurp

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

msnbot-media

Rule Path
Disallow /user/*
Disallow /job/redirect/*

applebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

bingpreview

Rule Path
Disallow /user/*
Disallow /job/redirect/*

duckduckbot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

twitterbot/1.0

Rule Path
Disallow /user/*
Disallow /job/redirect/*

askjeeves

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebot

Rule Path
Disallow /user/*
Disallow /job/redirect/*

facebookexternalhit/1.1

Rule Path
Disallow /user/*
Disallow /job/redirect/*

*

Rule Path
Disallow /
Back to top