pyroland.de
robots.txt

Robots Exclusion Standard data for pyroland.de

Resource Scan

Scan Details

Site Domain pyroland.de
Base Domain pyroland.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-01T03:51:41+00:00
Next Scan 2025-07-30T03:51:41+00:00

Last Successful Scan

Scanned2024-12-10T03:40:51+00:00
URL https://pyroland.de/robots.txt
Redirect https://www.pyroland.de/robots.txt
Redirect Domain www.pyroland.de
Redirect Base pyroland.de
Domain IPs 104.26.4.93, 104.26.5.93, 172.67.73.22, 2606:4700:20::681a:45d, 2606:4700:20::681a:55d, 2606:4700:20::ac43:4916
Redirect IPs 104.26.4.93, 104.26.5.93, 172.67.73.22, 2606:4700:20::681a:45d, 2606:4700:20::681a:55d, 2606:4700:20::ac43:4916
Response IP 172.67.73.22
Found Yes
Hash 90227936988dabedffb9e140b1a203e8cf6fda80d06fd164abe24e38c3f64bf8
SimHash ea1c5c50ea71

Groups

*

Rule Path
Disallow /navi.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /bestellvorgang.php
Disallow /jtl.php
Disallow /pass.php
Disallow /registrieren.php
Disallow /warenkorb.php
Disallow /admin
Disallow /admin/*
Disallow /dbeS/*

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

seekport

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.pyroland.de/sitemapcms_images.xml
sitemap https://www.pyroland.de/sitemap_index.xml