wer-weiss-was.de
robots.txt

Robots Exclusion Standard data for wer-weiss-was.de

Resource Scan

Scan Details

Site Domain wer-weiss-was.de
Base Domain wer-weiss-was.de
Scan Status Ok
Last Scan2024-11-09T22:00:44+00:00
Next Scan 2024-11-16T22:00:44+00:00

Last Scan

Scanned2024-11-09T22:00:44+00:00
URL https://wer-weiss-was.de/robots.txt
Redirect https://www.wer-weiss-was.de/robots.txt
Redirect Domain www.wer-weiss-was.de
Redirect Base wer-weiss-was.de
Domain IPs 104.26.0.104, 104.26.1.104, 172.67.74.28, 2606:4700:20::681a:168, 2606:4700:20::681a:68, 2606:4700:20::ac43:4a1c
Redirect IPs 104.26.0.104, 104.26.1.104, 172.67.74.28, 2606:4700:20::681a:168, 2606:4700:20::681a:68, 2606:4700:20::ac43:4a1c
Response IP 104.26.1.104
Found Yes
Hash 8877114f73ec5b8042a668c1dfd61bf0a5c734b356eefad4e5d6afe4ccf46e2b
SimHash 0a9c1f85f270

Groups

*

Rule Path
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /users/
Disallow /u/
Disallow /my/
Disallow /badges/
Disallow /search
Disallow /search/
Disallow /tags
Disallow /tags/
Disallow /email/
Disallow /session
Disallow /session/
Disallow /admin
Disallow /admin/
Disallow /user-api-key
Disallow /user-api-key/
Disallow /*?api_key*
Disallow /*?*api_key*
Disallow /groups
Disallow /groups/
Disallow /t/*/*.rss
Disallow /tags/*.rss
Disallow /c/*.rss
Disallow /t/faq/*

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file