dasgelbeforum.net
robots.txt

Robots Exclusion Standard data for dasgelbeforum.net

Resource Scan

Scan Details

Site Domain dasgelbeforum.net
Base Domain dasgelbeforum.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-06T15:33:24+00:00
Next Scan 2024-07-07T15:33:24+00:00

Last Successful Scan

Scanned2024-06-29T15:32:59+00:00
URL https://dasgelbeforum.net/robots.txt
Domain IPs 89.146.210.212
Response IP 89.146.210.212
Found Yes
Hash 71debae2847e2819d2cd95b5eecf2a9f2665e4c3e4e7b6c5e2a6909f7a631ff5
SimHash 000507514f50

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path Comment
Disallow /30434/ EWF in HTML
Disallow /lang/ LanguageDir
Disallow /linktest/ CSS etc. Tests
Disallow /stats/ StatsDir
Disallow /ticker.php -
Disallow /board_entry.php -
Disallow /contact.php -

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

Comments

  • robots.txt for http://www.dasgelbeforum.net/
  • Disallow: /img/ # ImageDir
  • Disallow: /img2/ # ImageDir
  • Disallow: /php_uploads/
  • User-agent: ia_archiver
  • Disallow: /