magazincestovatel.cz
robots.txt

Robots Exclusion Standard data for magazincestovatel.cz

Resource Scan

Scan Details

Site Domain magazincestovatel.cz
Base Domain magazincestovatel.cz
Scan Status Ok
Last Scan2024-09-18T15:17:07+00:00
Next Scan 2024-09-25T15:17:07+00:00

Last Scan

Scanned2024-09-18T15:17:07+00:00
URL https://magazincestovatel.cz/robots.txt
Domain IPs 2001:67c:e94:1:1:5bef:c911:1, 91.239.201.17
Response IP 91.239.201.17
Found Yes
Hash 6eeaa0df38a8fd587e912c742bc962da5dcd7450ca340fe87241819f86990803
SimHash 6280086481b7

Groups

*

Rule Path
Disallow /ajax/

timpibot

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://magazincestovatel.cz/sitemap.xml