Log In Sign Up

tarmed-browser.ch
robots.txt

Robots Exclusion Standard data for tarmed-browser.ch

Resource Scan

Scan Details

Site Domain tarmed-browser.ch
Base Domain tarmed-browser.ch
Scan Status Ok
Last Scan2025-12-29T00:03:38+00:00
Next Scan 2026-01-05T00:03:38+00:00

Last Scan

Scanned2025-12-29T00:03:38+00:00
URL https://tarmed-browser.ch/robots.txt
Redirect https://www.tarmed-browser.ch/robots.txt
Redirect Domain www.tarmed-browser.ch
Redirect Base tarmed-browser.ch
Domain IPs 157.230.98.49
Redirect IPs 157.230.98.49
Response IP 157.230.98.49
Found Yes
Hash 4d705e2cd31e6df85ba33ed0566da75e54296ef0de2d18347e5e86d68d62ad27
SimHash f2850d0d7450

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.tarmed-browser.ch/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • User-agent: *
  • Allow: /
Back to top