segler.community
robots.txt

Robots Exclusion Standard data for segler.community

Resource Scan

Scan Details

Site Domain segler.community
Base Domain segler.community
Scan Status Ok
Last Scan2025-09-27T11:49:38+00:00
Next Scan 2025-10-04T11:49:38+00:00

Last Scan

Scanned2025-09-27T11:49:38+00:00
URL https://segler.community/robots.txt
Domain IPs 104.18.28.67, 104.18.29.67, 2606:4700::6812:1c43, 2606:4700::6812:1d43
Response IP 104.18.28.67
Found Yes
Hash 5f8b5aa0141ef170ace00692230fd5c83c56648837db9b41093892508f05db6c
SimHash 932c5021fd13

Groups

*

Rule Path
Disallow /entdecken/
Disallow /activities/

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

admantx-adform

Rule Path
Disallow /

ias-ir/3.1

Rule Path
Disallow /

ias-or/3.1

Rule Path
Disallow /

ias-va/3.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://segler.community/sitemap.xml