kapstadt.net
robots.txt

Robots Exclusion Standard data for kapstadt.net

Resource Scan

Scan Details

Site Domain kapstadt.net
Base Domain kapstadt.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-07T04:46:21+00:00
Next Scan 2025-01-05T04:46:21+00:00

Last Successful Scan

Scanned2024-03-11T18:47:30+00:00
URL https://kapstadt.net/robots.txt
Redirect https://www.kapstadt.net/robots.txt
Redirect Domain www.kapstadt.net
Redirect Base kapstadt.net
Domain IPs 217.160.0.73
Redirect IPs 217.160.0.73
Response IP 217.160.0.73
Found Yes
Hash f98236ccf974593068d8186baa38d69108617a330a1df4ee112ce5635ea6fd53
SimHash ef1dc6385991

Groups

ahrefsbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baidu

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /neue-anzeige
Disallow /registrieren/
Disallow /mitglieder/
Disallow /*?rCH
Disallow /*?rCH=2
Disallow /*?rCH=-2
Disallow /*?*view=category
Disallow /*?*view=article
Disallow /*?*view=popup
Disallow /*?*view=catid
Disallow /*?*jsn_setmobile=*
Disallow /*?*index.php%3FItemid
Disallow /*?*artikel%3Fcategory_id
Disallow /*?*tmpl=component
Allow /components/com_djclassifieds/images/
Allow /components/com_djclassifieds/assets/images/
Allow /components/com_djclassifieds/assets/js/script.js
Allow /components/com_djclassifieds/themes/default/
Allow /plugins/system/cookiehint/img/little_cookie.png