aerzte-jobs.ch
robots.txt

Robots Exclusion Standard data for aerzte-jobs.ch

Archived Snapshots

Resource Scan

Scan Details

Site Domain	aerzte-jobs.ch
Base Domain	aerzte-jobs.ch
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a client error.
Last Scan	2024-10-08T12:44:42+00:00
Next Scan	2024-12-07T12:44:42+00:00

Last Successful Scan

Scanned	2024-08-10T12:42:39+00:00
URL	https://aerzte-jobs.ch/robots.txt
Domain IPs	217.20.195.199
Response IP	217.20.195.199
Found	Yes
Hash	c598b1726d8dbf3866b20369ea736bbc3863038f1c8873c252141ad2cca30f39
SimHash	2951dba05257

Groups

googlebot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

googlebot-mobile

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

googlebot-image

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

mediapartners-google

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

adsbot-google

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

googlebot-news

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

googlebot-video

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

slurp

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

msnbot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

msnbot-media

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

applebot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

bingbot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

bingpreview

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

duckduckbot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

twitterbot/1.0

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

askjeeves

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

facebot

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

facebookexternalhit/1.1

Rule	Path
Disallow	/user/*
Disallow	/job/redirect/*

Rule

Path

Disallow

/user/*

Disallow

/job/redirect/*

jobrapido

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; jobrapido/1.1; +http://www.jobrapido.com)

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (jobrapido webpump)

Rule	Path
Disallow	/

Rule

Path

Disallow

mozilla/5.0 (compatible; jobrapido/2; +http://www.jobrapido.com)

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/

Rule

Path

Disallow

Warnings

2 invalid lines.

aerzte-jobs.chrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

googlebot

googlebot-mobile

googlebot-image

mediapartners-google

adsbot-google

googlebot-news

googlebot-video

slurp

msnbot

msnbot-media

applebot

bingbot

bingpreview

duckduckbot

twitterbot/1.0

askjeeves

facebot

facebookexternalhit/1.1

jobrapido

mozilla/5.0 (compatible; jobrapido/1.1; +http://www.jobrapido.com)

mozilla/5.0 (jobrapido webpump)

mozilla/5.0 (compatible; jobrapido/2; +http://www.jobrapido.com)

*

Warnings

aerzte-jobs.ch
robots.txt