finmag.cz
robots.txt

Robots Exclusion Standard data for finmag.cz

Resource Scan

Scan Details

Site Domain finmag.cz
Base Domain finmag.cz
Scan Status Ok
Last Scan2024-09-16T09:57:18+00:00
Next Scan 2024-09-23T09:57:18+00:00

Last Scan

Scanned2024-09-16T09:57:18+00:00
URL https://finmag.cz/robots.txt
Redirect https://www.finmag.cz/robots.txt
Redirect Domain www.finmag.cz
Redirect Base finmag.cz
Domain IPs 81.95.110.12
Redirect IPs 81.95.110.12
Response IP 81.95.110.12
Found Yes
Hash ce31152a27bf3d227b86def14dfd856502ce4d5499f247f7e91590fbda837fd9
SimHash c15d9d20cf93

Groups

*

Rule Path
Allow /
Disallow /actions/
Disallow */?act=*
Disallow /tests/
Disallow /Files/$
Disallow /Files/obrazky/$
Disallow *?regenerateImage=*

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

machinelearning

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.finmag.cz/sitemap.xml