biostock.se
robots.txt

Robots Exclusion Standard data for biostock.se

Resource Scan

Scan Details

Site Domain biostock.se
Base Domain biostock.se
Scan Status Ok
Last Scan2025-10-21T03:00:43+00:00
Next Scan 2025-11-20T03:00:43+00:00

Last Scan

Scanned2025-10-21T03:00:43+00:00
URL https://biostock.se/robots.txt
Domain IPs 104.26.6.203, 104.26.7.203, 172.67.72.228, 2606:4700:20::681a:6cb, 2606:4700:20::681a:7cb, 2606:4700:20::ac43:48e4
Response IP 104.26.7.203
Found Yes
Hash c1b0da427d878e317a327f5be5516159bd8edaaa35189273d1c4e6faa2a79415
SimHash 4a4143fe8e43

Groups

*

Rule Path
Disallow /da/
Disallow /no/
Disallow /fi/
Disallow /de/
Disallow /es/
Disallow /fr/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /*/wp-admin/
Disallow /*/wp-login.php
Disallow /*/wp-json/
Disallow /*/xmlrpc.php
Disallow /*?*
Allow /en/
Allow /

Comments

  • Blockera språk som INTE ska indexeras
  • Blockera admin & interna endpoints
  • Blockera översatta versioner av admin/endpoints
  • Blockera querysträngar (dubbletter)
  • Tillåt engelska (en) och svenska (huvudspråket)