biggastro.com
robots.txt

Robots Exclusion Standard data for biggastro.com

Resource Scan

Scan Details

Site Domain biggastro.com
Base Domain biggastro.com
Scan Status Ok
Last Scan2025-11-07T19:01:19+00:00
Next Scan 2025-12-07T19:01:19+00:00

Last Scan

Scanned2025-11-07T19:01:19+00:00
URL https://biggastro.com/robots.txt
Domain IPs 104.21.47.83, 172.67.170.202, 2606:4700:3034::6815:2f53, 2606:4700:3034::ac43:aaca
Response IP 172.67.170.202
Found Yes
Hash 43b2bf51e46d3f07c1dd9b18ed0889fb4ef9000dda7b5ec181b5cc9aa3eb87d9
SimHash 6c0c0260ebf7

Groups

bingbot
adidxbot
pinterest
bingpreview
microsoftpreview

Rule Path
Disallow /*__*
Disallow /*%3A*
Disallow /navi.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /bestellvorgang.php
Disallow /jtl.php
Disallow /pass.php
Disallow /registrieren.php
Disallow /warenkorb.php
Disallow /admin
Disallow /admin/*
Disallow /dbeS/*
Disallow /jtl-store/__
Disallow /extension-store/__
Allow *

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /navi.php
Disallow /druckansicht.php
Disallow /suche.php
Disallow /bestellabschluss.php
Disallow /bestellvorgang.php
Disallow /jtl.php
Disallow /pass.php
Disallow /registrieren.php
Disallow /warenkorb.php
Disallow /admin
Disallow /admin/*
Disallow /dbeS/*
Disallow /jtl-store/__
Disallow /extension-store/__
Allow *

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://biggastro.com/sitemap_index.xml

Comments

  • BITTE NICHT LOESCHEN, SERVER-/CRAWLING-OPTIMIERUNG