ludwig.guru
robots.txt

Robots Exclusion Standard data for ludwig.guru

Resource Scan

Scan Details

Site Domain ludwig.guru
Base Domain ludwig.guru
Scan Status Ok
Last Scan2024-06-08T12:55:56+00:00
Next Scan 2024-06-15T12:55:56+00:00

Last Scan

Scanned2024-06-08T12:55:56+00:00
URL https://ludwig.guru/robots.txt
Domain IPs 104.22.16.79, 104.22.17.79, 172.67.25.46, 2606:4700:10::6816:104f, 2606:4700:10::6816:114f, 2606:4700:10::ac43:192e
Response IP 172.67.25.46
Found Yes
Hash 48b832aa309981a25da5588bb9233f22de244246d7e411736b65e9ac7afd40e8
SimHash 462ad2e1c311

Groups

*

Rule Path
Disallow /s2
Disallow /s2/*
Disallow /it/s2
Disallow /it/s2/*
Disallow /en/s2
Disallow /en/s2/*
Disallow /zh/s2
Disallow /zh/s2/*
Disallow /account
Disallow /account/*
Disallow /it/account
Disallow /zh/account
Disallow /it/account/*
Disallow /zh/account/*
Disallow /dictionary/*
Disallow /it/dictionary/*
Disallow /zh/dictionary/*
Disallow /share
Disallow /share/*
Disallow /it/share
Disallow /zh/share
Disallow /it/share/*
Disallow /zh/share/*
Disallow /login/limit
Disallow /login/limit/*
Disallow /it/login/limit
Disallow /zh/login/limit
Disallow /it/login/limit/*
Disallow /zh/login/limit/*

googlebot

Rule Path
Allow /
Disallow /account
Disallow /account/*
Disallow /it/account
Disallow /zh/account
Disallow /it/account/*
Disallow /zh/account/*
Disallow /dictionary/*
Disallow /it/dictionary/*
Disallow /zh/dictionary/*
Disallow /share
Disallow /share/*
Disallow /it/share
Disallow /zh/share
Disallow /it/share/*
Disallow /zh/share/*
Disallow /login/limit
Disallow /login/limit/*
Disallow /it/login/limit
Disallow /zh/login/limit
Disallow /it/login/limit/*
Disallow /zh/login/limit/*

yandex

Rule Path
Disallow /dictionary/*
Disallow /it/dictionary/*
Disallow /zh/dictionary/*
Disallow /account
Disallow /account/*
Disallow /it/account
Disallow /zh/account
Disallow /it/account/*
Disallow /zh/account/*
Disallow /share
Disallow /share/*
Disallow /it/share
Disallow /zh/share
Disallow /it/share/*
Disallow /zh/share/*
Disallow /login/limit
Disallow /login/limit/*
Disallow /it/login/limit
Disallow /zh/login/limit
Disallow /it/login/limit/*
Disallow /zh/login/limit/*

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

web-crawler

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20