pyroteam-store.de
robots.txt

Robots Exclusion Standard data for pyroteam-store.de

Resource Scan

Scan Details

Site Domain pyroteam-store.de
Base Domain pyroteam-store.de
Scan Status Ok
Last Scan5/23/2025, 1:14:06 AM
Next Scan 6/22/2025, 1:14:06 AM

Last Scan

Scanned5/23/2025, 1:14:06 AM
URL https://pyroteam-store.de/robots.txt
Redirect https://www.pyroteam-store.de/robots.txt
Redirect Domain www.pyroteam-store.de
Redirect Base pyroteam-store.de
Domain IPs 104.26.8.71, 104.26.9.71, 172.67.74.198, 2606:4700:20::681a:847, 2606:4700:20::681a:947, 2606:4700:20::ac43:4ac6
Redirect IPs 104.26.8.71, 104.26.9.71, 172.67.74.198, 2606:4700:20::681a:847, 2606:4700:20::681a:947, 2606:4700:20::ac43:4ac6
Response IP 104.26.9.71
Found Yes
Hash 12bcaa31b393872c58c4e8145bc5dc16a5ce0c4c979e4f8618c651f12fd41550
SimHash 49344ce086b1

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /includes/
Disallow /cache/
Disallow /templates/
Disallow /tools/
Disallow /uploads/
Disallow /media/
Disallow /export/
Disallow /logs/
Disallow /jtllogs/
Disallow /dl/
Disallow /includes/
Disallow /admin/
Disallow /widgets/
Disallow /media/
Disallow /modules/
Disallow /*.php$
Disallow /*?sCoreId=

googlebot

Rule Path
Allow /templates/
Allow /media/

amazonbot

Rule Path
Disallow /private/

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.pyroteam-store.de/sitemap_index.xml

Comments

  • Allgemeine Anweisungen für alle Bots
  • Beispiel für spezifische Suchmaschinen
  • Beispiel für Amazonbot
  • Pfad zur Sitemap