magazindoma.cz
robots.txt

Robots Exclusion Standard data for magazindoma.cz

Resource Scan

Scan Details

Site Domain magazindoma.cz
Base Domain magazindoma.cz
Scan Status Ok
Last Scan2024-09-18T20:56:13+00:00
Next Scan 2024-09-25T20:56:13+00:00

Last Scan

Scanned2024-09-18T20:56:13+00:00
URL https://magazindoma.cz/robots.txt
Domain IPs 2001:67c:e94:1:1:5bef:c911:1, 91.239.201.17
Response IP 91.239.201.17
Found Yes
Hash d40e7ffcc72ef818677d386203d72d4714009055aae76d9ca461531c4b54c713
SimHash f880086281b3

Groups

*

Rule Path
Disallow /ajax/

timpibot

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://magazindoma.cz/sitemap.xml