softguide.de
robots.txt

Robots Exclusion Standard data for softguide.de

Resource Scan

Scan Details

Site Domain softguide.de
Base Domain softguide.de
Scan Status Ok
Last Scan2024-09-08T14:44:51+00:00
Next Scan 2024-10-08T14:44:51+00:00

Last Scan

Scanned2024-09-08T14:44:51+00:00
URL https://softguide.de/robots.txt
Redirect https://www.softguide.de/robots.txt
Redirect Domain www.softguide.de
Redirect Base softguide.de
Domain IPs 5.9.127.235
Redirect IPs 5.9.127.235
Response IP 5.9.127.235
Found Yes
Hash 4db5a7b9f73b37b8c913ae9cb7cad88a196e14ffdf5078b1b359db0b93e345d4
SimHash 6a6ccce0100a

Groups

*

Rule Path
Disallow /bestellservice-zu/
Disallow /firmenanfrage-zu/
Disallow /programmanfrage-zu/
Disallow /nl/
Disallow /nsa/
Disallow /update/
Disallow /partner/
Disallow /aktu/
Disallow /newsletter-archiv.htm
Disallow /mysoftguide.php
Disallow /anfrage.php
Disallow /service/tools/traffic-monitor-anfragen.php
Disallow /an/

jobs.de-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

vegi bot

Rule Path
Disallow /

toweya.com

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

exabot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

Comments

  • User-agent: Baiduspider
  • Disallow: /
  • User-agent: SEOkicks-Robot
  • Disallow: /
  • User-agent: AhrefsBot
  • Disallow: /