hierschmeckts.de
robots.txt

Robots Exclusion Standard data for hierschmeckts.de

Resource Scan

Scan Details

Site Domain hierschmeckts.de
Base Domain hierschmeckts.de
Scan Status Ok
Last Scan2024-09-27T17:47:20+00:00
Next Scan 2024-10-04T17:47:20+00:00

Last Scan

Scanned2024-09-27T17:47:20+00:00
URL https://hierschmeckts.de/robots.txt
Redirect https://www.hierschmeckts.de/robots.txt
Redirect Domain www.hierschmeckts.de
Redirect Base hierschmeckts.de
Domain IPs 2a01:4f8:262:1967::4, 5.9.212.229
Redirect IPs 2a01:4f8:262:1967::4, 5.9.212.229
Response IP 5.9.212.229
Found Yes
Hash 9e61a9308e13befcbe5b36b9d77a8052e9c24d7f35d920c89f9365eef2b652b1
SimHash 63f4f782d279

Groups

*

Rule Path
Disallow /suche.php
Disallow /stellensuche.php
Disallow /jobmerkliste.php
Disallow /v.php
Disallow /goto/*
Disallow /red/*
Disallow /Restaurant/Eintrag-aendern/*
Disallow /Restaurant/Eintrag-anlegen/*
Disallow /Restaurant/Eintrag-loeschen/*
Disallow /E-Mail-Service/Aktivieren/*
Disallow /E-Mail-Service/Beenden/*
Disallow /img/numcache/
Disallow /agb_ideenkraftwerk_gmbh.pdf
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

mediapartners-google

Rule Path
Disallow

sistrix

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

msnbot-media

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

psbot

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

magpie-crawler

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

yandeximages

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

yandexmedia

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

yahoo-mmcrawler

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

tineye

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

baiduspider-image

Rule Path
Disallow /images/
Disallow /images/*
Disallow /img/
Disallow /img/*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1