datenbank.classic-wow.de
robots.txt

Robots Exclusion Standard data for datenbank.classic-wow.de

Resource Scan

Scan Details

Site Domain datenbank.classic-wow.de
Base Domain classic-wow.de
Scan Status Ok
Last Scan2025-10-30T23:11:31+00:00
Next Scan 2025-11-29T23:11:31+00:00

Last Scan

Scanned2025-10-30T23:11:31+00:00
URL https://datenbank.classic-wow.de/robots.txt
Domain IPs 2a01:4f8:d0a:2397::2, 78.46.4.116
Response IP 78.46.4.116
Found Yes
Hash f97f6d21238d30105ea6836ec479c271a8c188967a1d0f425a479c1a01544571
SimHash d45ede7a12bb

Groups

magpie-crawler
magpie-crawler/1.1
yandex
baiduspider
baiduspider-video
baiduspider-image
mj12bot
seoscanners
obot
blexbot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60