in-greece.de
robots.txt

Robots Exclusion Standard data for in-greece.de

Resource Scan

Scan Details

Site Domain in-greece.de
Base Domain in-greece.de
Scan Status Ok
Last Scan2024-11-02T08:35:38+00:00
Next Scan 2024-11-09T08:35:38+00:00

Last Scan

Scanned2024-11-02T08:35:38+00:00
URL https://in-greece.de/robots.txt
Redirect https://www.in-greece.de/robots.txt
Redirect Domain www.in-greece.de
Redirect Base in-greece.de
Domain IPs 217.160.0.120
Redirect IPs 217.160.0.120
Response IP 217.160.0.120
Found Yes
Hash eaae8a9529b1b7cfd0e42012ebf11ef9e78675c8e89786425abefcfc5fe803a1
SimHash 6b1c1000abe0

Groups

mediapartners-google*

Rule Path
Disallow

psbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

claudebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /
Disallow /

megaindex.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Warnings

  • `uuser-agent` is not a known field.