sexkiste.com
robots.txt

Robots Exclusion Standard data for sexkiste.com

Resource Scan

Scan Details

Site Domain sexkiste.com
Base Domain sexkiste.com
Scan Status Ok
Last Scan2024-10-17T06:47:08+00:00
Next Scan 2024-11-16T06:47:08+00:00

Last Scan

Scanned2024-10-17T06:47:08+00:00
URL https://sexkiste.com/robots.txt
Redirect https://www.sexkiste.com/robots.txt
Redirect Domain www.sexkiste.com
Redirect Base sexkiste.com
Domain IPs 185.52.189.101
Redirect IPs 185.52.189.101
Response IP 185.52.189.101
Found Yes
Hash 9e2002c1db83ee3417f10c12885c94030d2c8d4746348d1190a0f505b5811472
SimHash de1f0161bf9b

Groups

amazonbot

Rule Path
Disallow *

yandex

Rule Path
Disallow *

blexbot

Rule Path
Disallow *

dataforseobot

Rule Path
Disallow *

dotbot

Rule Path
Disallow *

ahrefsbot

Rule Path
Disallow *

mj12bot

Rule Path
Disallow *

semrushbot

Rule Path
Disallow *

barkrowler

Rule Path
Disallow *

gptbot

Rule Path
Disallow *

claudebot

Rule Path
Disallow *

seekportbot

Rule Path
Disallow *

timpibot

Rule Path
Disallow *

metajobbot

Rule Path
Disallow *

awariobot

Rule Path
Disallow *

applebot

Rule Path
Disallow *

mediatoolkitbot

Rule Path
Disallow *

bitsightbot

Rule Path
Disallow *

serpstatbot

Rule Path
Disallow *

ccbot

Rule Path
Disallow *

seznambot

Rule Path
Disallow *

domainstatsbot

Rule Path
Disallow *

friendly_crawler

Rule Path
Disallow *

facebookexternalhit

Rule Path
Disallow *

go-http-client

Rule Path
Disallow *

yandexbot

Rule Path
Disallow *

yandex

Rule Path
Disallow *

amazonbot

Rule Path
Disallow *

*

Rule Path
Disallow /wp-admin/*
Disallow /wp-json/*
Disallow /wp-login.php
Disallow /*/feed/
Disallow /my-account/
Disallow /login/
Disallow /cart/
Disallow /registrierung/
Disallow /sitemap/
Disallow /impressum/
Disallow /checkout/
Disallow /mein-konto/
Disallow /wp-admin/
Disallow /registrierung/
Disallow /impressum/
Disallow /mein-konto/
Disallow /kasse/
Disallow /warenkorb/
Disallow /shop/
Allow /media/
Allow /media/bildergalerien/
Allow /media/models
Allow /media/videos
Allow /sexkontakte/kontaktanzeigen
Allow /sexkontakte/prostituierte
Allow /trends
Allow /verzeichnis/locations
Allow /verzeichnis/events
Allow /*

Other Records

Field Value
sitemap https://www.sexkiste.com/sitemap_index.xml

Comments

  • This is technically redundant but can be kept for clarity if you prefer