willstequatschen.de
robots.txt

Robots Exclusion Standard data for willstequatschen.de

Resource Scan

Scan Details

Site Domain willstequatschen.de
Base Domain willstequatschen.de
Scan Status Ok
Last Scan2024-11-14T21:51:50+00:00
Next Scan 2024-11-21T21:51:50+00:00

Last Scan

Scanned2024-11-14T21:51:50+00:00
URL https://willstequatschen.de/robots.txt
Domain IPs 157.90.209.134
Response IP 157.90.209.134
Found Yes
Hash ed04732e6e8b70230bdd8acf644da5244cdfe3f3d8bdf01275c04493e9381eaf
SimHash 0115eb936370

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

ecosiabot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

slurp

Rule Path
Allow /

startpagebot

Rule Path
Allow /

qwantify

Rule Path
Allow /

metagerbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

Comments

  • Block everything for all Crawlers
  • Allow everything for Google Search
  • Allow everything for Bing Search
  • Allow everything for Ecosia Search
  • Allow everything for DuckDuckGo Search
  • Allow everything for Yahoo Search
  • Allow everything for Startpage Search
  • Allow everything for Qwant Search
  • Allow everything for MetaGer Search
  • Allow everything for Internet Archive