poppers-shop.de
robots.txt

Robots Exclusion Standard data for poppers-shop.de

Resource Scan

Scan Details

Site Domain poppers-shop.de
Base Domain poppers-shop.de
Scan Status Ok
Last Scan2025-05-12T21:16:19+00:00
Next Scan 2025-06-11T21:16:19+00:00

Last Scan

Scanned2025-05-12T21:16:19+00:00
URL https://poppers-shop.de/robots.txt
Redirect https://www.poppers-shop.de/robots.txt
Redirect Domain www.poppers-shop.de
Redirect Base poppers-shop.de
Domain IPs 104.26.12.236, 104.26.13.236, 172.67.75.236, 2606:4700:20::681a:cec, 2606:4700:20::681a:dec, 2606:4700:20::ac43:4bec
Redirect IPs 104.26.12.236, 104.26.13.236, 172.67.75.236, 2606:4700:20::681a:cec, 2606:4700:20::681a:dec, 2606:4700:20::ac43:4bec
Response IP 104.26.13.236
Found Yes
Hash 6a0b7962ccc68251e1de0f22b3b5085ede712f3d76648272c7e39f9002993356
SimHash 325ee160c219

Groups

*

Rule Path
Disallow /shop/admin/
Disallow /shop/callback/
Disallow /shop/inc/
Disallow /shop/shopping_cart.php
Disallow /shop/advanced_search.php
Disallow /shop/advanced_search_result.php

aiohttp

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

optimizer

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix optimizer

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.poppers-shop.de/sitemap.xml

Comments

  • List 2024-08-29 (30 Bots)
  • More
  • Plus 2024-09-18
  • Plus 2024-09-26
  • Plus 2024-09-27
  • END