radfahrer.community
robots.txt

Robots Exclusion Standard data for radfahrer.community

Resource Scan

Scan Details

Site Domain radfahrer.community
Base Domain radfahrer.community
Scan Status Ok
Last Scan2024-11-02T10:52:56+00:00
Next Scan 2024-11-09T10:52:56+00:00

Last Scan

Scanned2024-11-02T10:52:56+00:00
URL https://radfahrer.community/robots.txt
Domain IPs 104.21.77.169, 172.67.210.129, 2606:4700:3032::6815:4da9, 2606:4700:3037::ac43:d281
Response IP 104.21.77.169
Found Yes
Hash 8f2bc0f7cf6cf830485bf078a3299e844db2e10ef2a712e7b8f49d7f520e65a8
SimHash 932cd020fd13

Groups

*

Rule Path
Disallow /entdecken/
Disallow /activities/

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

admantx-adform

Rule Path
Disallow /

ias-ir/3.1

Rule Path
Disallow /

ias-or/3.1

Rule Path
Disallow /

ias-va/3.1

Rule Path
Disallow /

Other Records

Field Value
sitemap https://radfahrer.community/sitemap.xml