spurnull-magazin.de
robots.txt

Robots Exclusion Standard data for spurnull-magazin.de

Resource Scan

Scan Details

Site Domain spurnull-magazin.de
Base Domain spurnull-magazin.de
Scan Status Ok
Last Scan2024-06-14T19:04:20+00:00
Next Scan 2024-06-21T19:04:20+00:00

Last Scan

Scanned2024-06-14T19:04:20+00:00
URL https://spurnull-magazin.de/robots.txt
Domain IPs 217.160.0.124
Response IP 217.160.0.124
Found Yes
Hash 689fbfff3a279ee2c5854ba2c8935daeed0a166d12c60de760507538c1fe69e0
SimHash 02ec48447e70

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /2009
Disallow /2010
Disallow /2011
Disallow /2012
Disallow /2013
Disallow /2014
Disallow /2015
Disallow /2016
Disallow /2017
Disallow /2018
Disallow /2019
Disallow /2020
Disallow /2021
Disallow /2022

trendictionbot0.5.0

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

echobot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Comments

  • Social Media Bots