rarepalmseeds.com
robots.txt

Robots Exclusion Standard data for rarepalmseeds.com

Resource Scan

Scan Details

Site Domain rarepalmseeds.com
Base Domain rarepalmseeds.com
Scan Status Ok
Last Scan2024-06-01T19:02:43+00:00
Next Scan 2024-07-01T19:02:43+00:00

Last Scan

Scanned2024-06-01T19:02:43+00:00
URL https://rarepalmseeds.com/robots.txt
Domain IPs 138.201.230.72
Response IP 138.201.230.72
Found Yes
Hash d5074cc56df8b17562f59391126c8f6a119c3a76c958a4a4d7e02e6f2f1c29f3
SimHash ca3dbc608691

Groups

*

Rule Path
Disallow /account/
Disallow /admin/
Disallow /checkout/

baiduspider
trendictionbot
neofonie
semrushbot
semrushbot
semrushbot-sa
ahrefsbot
blexbot
sogou
the knowledge ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rarepalmseeds.com/sitemap_en.xml
sitemap https://www.rarepalmseeds.com/sitemap_de.xml
sitemap https://www.rarepalmseeds.com/sitemap_es.xml
sitemap https://www.rarepalmseeds.com/sitemap_fr.xml

Comments

  • robots.txt zu https://www.rarepalmseeds.com/
  • gespeerte Dateien
  • gespeerte Verzeichnisse
  • Alte Ordner sperren (oder Eintrag löschen?):
  • Disallow: /pix/
  • Disallow: /de/pix/
  • Disallow: /es/pix/
  • Disallow: /fr/pix/
  • Sitemaps
  • Ausschließen